Is it worth expanding my spot fleet?

Message boards : Number crunching : Is it worth expanding my spot fleet?

To post messages, you must log in.

AuthorMessage
nick

Send message
Joined: 28 Mar 20
Posts: 7
Credit: 778,267
RAC: 0
Message 92765 - Posted: 31 Mar 2020, 16:14:52 UTC

Hey,

Great project, thanks to everyone's efforts.

I'm a total newbie here and arrived mostly because of COVID-19. I'd like to spend my earned AWS vouchers in c5.2xlarge machines to crunch away (plus my desktop of course). Raised a couple of instances in a spot fleet and was about to raise more but I see I've run out of tasks. Checking the logs I discovered that this happened early during the morning as well.

I was planning on expanding to use 5 instances. But it's going to be worth it only if there's a steady inflow of tasks. Any ideas if this is a temporary issue?
ID: 92765 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 92768 - Posted: 31 Mar 2020, 16:21:37 UTC

Certainly a temporary issue. See post by bcov
Rosetta Moderator: Mod.Sense
ID: 92768 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
nick

Send message
Joined: 28 Mar 20
Posts: 7
Credit: 778,267
RAC: 0
Message 92772 - Posted: 31 Mar 2020, 16:38:40 UTC - in response to Message 92768.  

Great, good to know.

For what it's worth if anyone wants to use AWS to contribute to this, go for Ubuntu and launch C5 spot instances in the Ohio region. This currently brings you down to almost 1 cent per CPU-hour.
ID: 92772 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 92775 - Posted: 31 Mar 2020, 16:52:05 UTC

Wow! Under 2 bucks a week? How long do you suppose that spot price will hold?
Rosetta Moderator: Mod.Sense
ID: 92775 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
nick

Send message
Joined: 28 Mar 20
Posts: 7
Credit: 778,267
RAC: 0
Message 92779 - Posted: 31 Mar 2020, 17:06:02 UTC - in response to Message 92775.  

I haven't the faintest but I'll use this price while it's there.

Looking at the three month history of spot prices for C5 instances in Ohio, they've risen from a bit below 1 cent per CPU hour to a tad above 1 cent per CPU hour (or by 9.41% to be exact). 3.13% per month might be significant if you're running thousands of instances but for my intended purposes seems I won't have to worry about a massive pricing change overnight.
ID: 92779 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 92780 - Posted: 31 Mar 2020, 17:18:44 UTC

I guess I should point out that, in addition to those CPU charges, there are also charges for network usage, and disk storage. If you have a number of hosts, you could have one of them fulfill the role of a proxy (in addition to crunching), and avoid getting the same files for each of the host images.
Rosetta Moderator: Mod.Sense
ID: 92780 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
nick

Send message
Joined: 28 Mar 20
Posts: 7
Credit: 778,267
RAC: 0
Message 92781 - Posted: 31 Mar 2020, 17:25:57 UTC - in response to Message 92780.  

Yeap, good point.

BUT the cost of incoming traffic to AWS is 0, while the cost of outgoing traffic is $0.09 per GB. I assumed that the bulk of the traffic would be incoming to the BOINC client, is that correct?
ID: 92781 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 92794 - Posted: 31 Mar 2020, 18:36:49 UTC

Yep, your only "outgoing" would be scheduler requests and completed out files, which are typically pretty small (100K?)
Rosetta Moderator: Mod.Sense
ID: 92794 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
nick

Send message
Joined: 28 Mar 20
Posts: 7
Credit: 778,267
RAC: 0
Message 93177 - Posted: 3 Apr 2020, 8:00:49 UTC

After the update all seem great. Now AWS-crunching without issues!
ID: 93177 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Message boards : Number crunching : Is it worth expanding my spot fleet?



©2024 University of Washington
https://www.bakerlab.org