amazon ec2 - getting started with EC2 for compute-intensive (non-web) parallel application -

-

i'm using libsvm regression analysis. works champ. 3-parameter grid search optimize parameters model maxes out 4 cores on 2.66 ghz intel box, , still have wait couple of hours generate single model.

this seems job amazon ec2.

i've seen plenty of tutorials , introductory material on using ec2 web-related tasks.

but if have small compute-intensive custom ansi-c program want run multiple instances of on ec2? can provide pointers on how (or buzzwords search for)?

i don't think quest different of web application. stack different of course, regardless – the principles remain same.

as commented on question: elastic map reduce might you're looking parallelize work easily, etc.. if limited, cloudera. ready-to-rumble hadoop distribution support ec2 well.

if map-reduce not liking, need setup own instance. speaking, keypoints follows:

  1. you want figure out way start ec2 instances.
  2. you want figure out way bootstrap , configure them.
  3. cluster/network?

starting ec2 instances

if don't require auto-scaling or custom interface, aws console extremely job. have select ami (amazon machine image) suitable project. i'd either official ami or ubuntu-based (if remember correctly, ubuntu used linux on ec2).

but , liking. (and don't know enough project.)

once figured out setup works you, easiest way clone work setup own ami , start instances it, etc..

bootstrapping

bootstrapping can using ec2 calls user-script. allows pass shell script instance, execute calls setup stack, etc.. i'm not sure required in case, etc.. in case comment or extend answer, go detail here.

cluster/networking

this wild guess since i'm not sure code does, or how works, etc.. if it's not necessary, i'd scale out using single instance first. can lot of cores , ram provisioned ec2. depending if work requires more ram or cpu, high-cpu , high-memory instance types.

you can start off t1.micro, can get free even , go there.

let me know if helps!


Comments

Post a Comment

Popular posts from this blog

objective c - Change font of selected text in UITextView -

-
can suggest me how change font of selected text in uitextview.i cannot use uiwebview since have edit text. have seen pages app.how possible in app. see formatting text within uilabel differently . since need editing, should @ javascript-based editors such ckeditor or tinymce . highly recommend wwdc 2011 video session 511: "rich text editing in safari on ios."
Read more

php - Accessing POST data in Facebook cavas app -

-
so i've got simple form in canvas / iframe facebook app, , i'm trying pass along values post. reading on s.o. , fb's latest docs, understand it, data send via post form can accessed on receiving end $_request object. i read on thread on s.o. in order post forms work need pass along input named "signed_request" value current signed_request (i have signed request working ok otherwise...all login , authentication stuff working fine). isnt mentioned anywhere in official fb docs. so problem comes in $_request object signed request, , bunch of other session stuff. form inputs found. the way can read them set method of form "request" isn't real form method. takes of inputs , sends them args in url. horrible. here's sample page canvas app form i'm using try debug (leaving out authentication stuff): <form enctype="application/x-www-form-urlencoded" method="post" target="_top" id="my_form" action=...
Read more

c# - Getting control value when switching a view as part of a multiview -

-
i have following code in aspx page: <asp:button id="display_button" runat="server" text="display" onclick="button1_click" /> &nbsp; <asp:button id="edit_button" runat="server" text="edit" onclick="button2_click" /> &nbsp; <asp:button id="save_button" runat="server" text="save" onclick="button3_click" visible="false" /> &nbsp; <asp:multiview id="multiview1" runat="server" activeviewindex="0"> <asp:view id="view1" runat="server"> <asp:formview id="view_program" runat="server"> <itemtemplate> <%# eval("status").tostring().trim() %> </itemtemplate> </asp:formview> </asp:view> <asp:view id="view2" runat="server"> ...
Read more