internet requirements?

Message boards : Cafe Rosetta : internet requirements?

To post messages, you must log in.

AuthorMessage
BKFC

Send message
Joined: 21 Apr 20
Posts: 34
Credit: 3,160,585
RAC: 0
Message 95026 - Posted: 21 Apr 2020, 1:48:03 UTC

I have several machines running variants of Linux (including an 8-core Ryzen-7 2700x) that I could devote at least partially to this project. That said, my hot spot internet service (not fiber optic) has two issues: (1) It's slow - now down to 1 Mbps or less due I think to neighbors now working from home and running Zoom conferences; (2) it's metered at a max of 100 GB/month. If this project entails transfers back and forth (both are metered) in the multi GB range, then I don't think it will work. If the projects are instead compute bound, then I have the cycles.

I apologize if this issue was addressed elsewhere.
ID: 95026 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
William Albert

Send message
Joined: 22 Mar 20
Posts: 23
Credit: 1,069,070
RAC: 25
Message 95027 - Posted: 21 Apr 2020, 2:28:33 UTC - in response to Message 95026.  
Last modified: 21 Apr 2020, 2:29:21 UTC

Based on what a machine I spot-checked is currently doing, most of the work units are less than a megabyte.

Here's a quick file listing of the Rosetta directory:
485M	database_357d5d93529_n_methyl.zip
68K	Helvetica.txf
5.8M	hgfp_split2_460_data.zip
348K	LiberationSans-Regular.ttf
110M	minirosetta_3.78_x86_64-pc-linux-gnu
270M	minirosetta_database_d0bf94b.zip
47M	minirosetta_graphics_3.78_x86_64-pc-linux-gnu
176K	pass_build.bp_20200412145206_perturb_2790_0001_0001_fragments_data.zip
184K	pass_build.bp_20200412145353_perturb_4974_0001_0001_fragments_data.zip
184K	pass_build.bp_20200412145841_perturb_2744_0001_0001_fragments_data.zip
180K	r3x_1541_data.zip
172K	r3x_5760_data.zip
172K	r3x_5901_data.zip
172K	r4d_1164_data.zip
180K	r4k_11075_data.zip
176K	r4k_12609_data.zip
180K	r4k_15519_data.zip
176K	r4k_17413_data.zip
180K	r4k_6123_data.zip
176K	r4k_6474_data.zip
64K	rb_04_19_21998_21765_ab_t000__h002_robetta.200.18mers.index.gz
88K	rb_04_19_21998_21765_ab_t000__h002_robetta.200.3mers.index.gz
76K	rb_04_19_21998_21765_ab_t000__h002_robetta.200.8mers.index.gz
4.0K	rb_04_19_21998_21765_ab_t000__h002_robetta_FLAGS
4.0K	rb_04_19_21998_21765_ab_t000__h002_robetta.zip
276K	rb_04_19_22030_21740_ab_t000__robetta.200.3mers.index.gz
256K	rb_04_19_22030_21740_ab_t000__robetta.200.6mers.index.gz
252K	rb_04_19_22030_21740_ab_t000__robetta.200.7mers.index.gz
4.0K	rb_04_19_22030_21740_ab_t000__robetta_FLAGS
28K	rb_04_19_22030_21740_ab_t000__robetta.zip
76K	rb_04_19_22040_21638_ab_t000__h001_robetta.200.10mers.index.gz
88K	rb_04_19_22040_21638_ab_t000__h001_robetta.200.3mers.index.gz
84K	rb_04_19_22040_21638_ab_t000__h001_robetta.200.5mers.index.gz
4.0K	rb_04_19_22040_21638_ab_t000__h001_robetta_FLAGS
4.0K	rb_04_19_22040_21638_ab_t000__h001_robetta.zip
232K	rb_04_19_22059_21792_ab_t000__h002_robetta.200.3mers.index.gz
220K	rb_04_19_22059_21792_ab_t000__h002_robetta.200.6mers.index.gz
216K	rb_04_19_22059_21792_ab_t000__h002_robetta.200.7mers.index.gz
4.0K	rb_04_19_22059_21792_ab_t000__h002_robetta_FLAGS
8.0K	rb_04_19_22059_21792_ab_t000__h002_robetta.zip
120M	rosetta_4.15_x86_64-pc-linux-gnu
118M	rosetta_graphics_4.15_x86_64-pc-linux-gnu

1.2G	total

The larger files are application binaries and database files which are downloaded as needed, rather than with every work unit.

Also, unlike most projects, Rosetta@home work units execute for a period of time that you specify, rather than for the amount of work required to "complete" the unit. As such, you can reduce bandwidth usage by increasing the runtime length in your profile preferences.

Finally, the "Computing preferences" section of you account profile gives you an option to explicitly limit how much total data Rosetta will transfer within a given period of time (e.g., 30 days). If you hit that limit, it won't transfer any more data until the time period rolls over.

So in short, you'll be fine. The project welcomes your cycles. :)
ID: 95027 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1699
Credit: 18,186,917
RAC: 24,275
Message 95028 - Posted: 21 Apr 2020, 2:32:01 UTC - in response to Message 95026.  

I have several machines running variants of Linux (including an 8-core Ryzen-7 2700x) that I could devote at least partially to this project. That said, my hot spot internet service (not fiber optic) has two issues: (1) It's slow - now down to 1 Mbps or less due I think to neighbors now working from home and running Zoom conferences; (2) it's metered at a max of 100 GB/month. If this project entails transfers back and forth (both are metered) in the multi GB range, then I don't think it will work. If the projects are instead compute bound, then I have the cycles.
Some of the downloads are very large, but are then used by many Tasks. And the downloads for most of those Tasks are quite small (a few hundred kB). However uploads (returned results) can vary from several hundred KB to 30+ MB. Limiting the number of Tasks you run at a time, would limit the number of results produced, and so the amount of data sent back.
Having said that, i've been running Rosetta for around 3 weeks now, all 6cores/12threads, and my network Data for BOINC (Rosetta being the only project on this computer) has been just under 11GB so far.


Generally you want to have around 1.2GB of RAM (or more) per thread you plan to use (so for 8c/16t then 20GB bare minimum RAM to use all cores/threads and not run in to memory issues at some stage). Some Tasks require 1.5GB per Task, there are soon to be some that may need up to 4GB. And you need to allow BOINC to use at least 1GB of storage space per Task you plan to run.
And a small cache is best (1 day or less). If you run more than one project, a very, very, very small cache is best (.4 days or less).

In your Account, Computing preferences, these are good values to start with. "Setting Use at most 100% of the CPUs" will use less cores/threads if you don't have enough RAM to run all cores & threads without running in to Memory issues.
Computing
   Usage limits	
                                   Use at most 100% of the CPUs
                                   Use at most 100% of CPU time

   When to suspend	
           Suspend when computer is on battery (not selected)
               Suspend when computer is in use (not selected)
 Suspend GPU computing when computer is in use (not selected)
   'In use' means mouse/keyboard input in last 3 minutes
  Suspend when no mouse/keyboard input in last --- minutes
     Suspend when non-BOINC CPU usage is above --- %
                          Compute only between ---

   Other	
                                Store at least 1 days of work
                     Store up to an additional 0.02 days of work
                    Switch between tasks every 60 minutes
     Request tasks to checkpoint at most every 60 seconds

   Disk
                              Use no more than 20 GB
                                Leave at least 2 GB free
                              Use no more than 60 % of total

   Memory
          When computer is in use, use at most 95 %
      When computer is not in use, use at most 95 %
 Leave non-GPU tasks in memory while suspended (not selected)
                   Page/swap file: use at most 75 %

Grant
Darwin NT
ID: 95028 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
BKFC

Send message
Joined: 21 Apr 20
Posts: 34
Credit: 3,160,585
RAC: 0
Message 95050 - Posted: 21 Apr 2020, 15:52:55 UTC

Thanks for those inputs. I've downloaded the app, but I'm pretty much stuck at that point. When I first launched the BOINC app and selected Rosetta@home, it promptly tried to retrieve a project and locked out all other input, including the options tab. I had to kill the processes and reboot to restore the system. The second time it stuck at "Retrieving current status.", again locking out any attempt at setting options (in fact I've never seen the options window content - it just pops up blank - if at all).

From my location I have no way of knowing whether this is due to low bandwidth (now around 0.5 Mbps) or some other setup issue.
ID: 95050 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1699
Credit: 18,186,917
RAC: 24,275
Message 95078 - Posted: 21 Apr 2020, 23:10:40 UTC - in response to Message 95050.  

Thanks for those inputs. I've downloaded the app, but I'm pretty much stuck at that point. When I first launched the BOINC app and selected Rosetta@home, it promptly tried to retrieve a project and locked out all other input, including the options tab. I had to kill the processes and reboot to restore the system. The second time it stuck at "Retrieving current status.", again locking out any attempt at setting options (in fact I've never seen the options window content - it just pops up blank - if at all).

From my location I have no way of knowing whether this is due to low bandwidth (now around 0.5 Mbps) or some other setup issue.
It is best to set the option on the Web site.
Click on your name at the top of this page, then under Preferences, When and how BOINC uses your computer, Computing preferences.
Once you've made & saved the changes, the next time BOINC contacts the project it will get the new settings, or on the BOINC Manager (View, Advanced), just Select Rosetta in the Projects tab, and click on Update.


On my systems, using the BOINC Manager, Computing preferences it can take over 5 seconds of "Communicating with BOINC client" before the Computing preferences come up.
Grant
Darwin NT
ID: 95078 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 95079 - Posted: 21 Apr 2020, 23:14:18 UTC - in response to Message 95050.  

The website shows your machine has been assigned a number of work units. BOINC will have to complete the initial downloads of the larger application and database files before they can being processing. The website doesn't show if you are still downloading files.

If you could be more specific about what series of steps you are taking that brings you to the locked state, that would be helpful. I see your machine is Linux, there are a number of ways to have installed BOINC on Linux. Did you follow a specific series of instructions when you installed BOINC?
Rosetta Moderator: Mod.Sense
ID: 95079 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Message boards : Cafe Rosetta : internet requirements?



©2024 University of Washington
https://www.bakerlab.org