Rosetta's role in fighting coronavirus

Message boards : News : Rosetta's role in fighting coronavirus

To post messages, you must log in.

Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · 9 · 10 . . . 21 · Next

AuthorMessage
Profile pembo
Avatar

Send message
Joined: 11 Oct 16
Posts: 2
Credit: 516,933
RAC: 0
Message 92367 - Posted: 26 Mar 2020, 21:30:00 UTC

Awesome Thankyou!
ID: 92367 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Xech

Send message
Joined: 19 Mar 20
Posts: 2
Credit: 2,118,278
RAC: 0
Message 92376 - Posted: 27 Mar 2020, 7:01:14 UTC

Big thanks for the reply talking about whether this helping. Would love to see further publications on the progress being made with the influx of users, even though it may be lackluster or unintelligible to the layman.

I also get that doing the work itself is of paramount importance, and that takes priority over belly rubs. Even weekly drops of what's on the docket I think would help keep existing users excited and help fuel new users as well.

Thank you again!
ID: 92376 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
bcov
Volunteer moderator
Project developer
Project scientist

Send message
Joined: 8 Nov 16
Posts: 12
Credit: 11,348
RAC: 0
Message 92403 - Posted: 27 Mar 2020, 17:56:08 UTC

has <run out> of tasks right now


As far as I can tell it hasn't run out. I've been submitting to the R@H queue and apparently my jobs need 2G of ram (sorry 1G users...). But with that in mind, I see 1.4M jobs lined up and ready to go.


Also, on the topic of job length, here's the tricky scenario I'm in. Let's say for instance I have 1M proteins that need to be designed. My goal is to do this as fast as possible. But how to best do this? To avoid wasting your CPU cycles, I need to make sure that all jobs have enough proteins to go for 8 hours.

I submit this way, knowing full-well that not all of the proteins will be designed. Some people design for fewer hours, and some people just have slow computers (which are both fine btw). There's also another case where someone is running for 8 hours, but the job gets interrupted a bunch of times and doesn't finish for 2 weeks.

With this in mind, I wait about 2 days after all the jobs have started, at which point I see what has finished, and resubmit anything that hasn't come back yet. This process has to repeat a few times with each submission getting closer and closer to 100% completion, but I typically give up at around 80%-90% and then call it a day. (I don't necessarily need all the outputs, I just need a lot) (Also, when I resubmit, I don't give up on jobs currently running, I just give someone else the same job too.)

So with that in mind, yes, 8 hours is better than 4 hours because our server is under a lot of load at the moment. (More users and these design jobs are roughly 100X worse on the server). But, more importantly than the number of hours is the turnaround time, so if your 8 hour jobs are taking a week to finish, there's nothing wrong with going 4 hours.
ID: 92403 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
RandyF

Send message
Joined: 2 Nov 14
Posts: 6
Credit: 7,744,262
RAC: 0
Message 92406 - Posted: 27 Mar 2020, 18:21:02 UTC

First of all, thank you for what you all do. I am currently running Rosetta on a laptop, a desktop, and trying to get work units for my 3 Android devices. Unfortunately, no matter how many times I reset or update, I haven't received one work unit on any Android device. Any advice? Thank you.
ID: 92406 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile yoerik
Avatar

Send message
Joined: 24 Mar 20
Posts: 128
Credit: 169,525
RAC: 0
Message 92409 - Posted: 27 Mar 2020, 19:09:17 UTC - in response to Message 92406.  

First of all, thank you for what you all do. I am currently running Rosetta on a laptop, a desktop, and trying to get work units for my 3 Android devices. Unfortunately, no matter how many times I reset or update, I haven't received one work unit on any Android device. Any advice? Thank you.


They haven't released units for Android for awhile. In the meantime, please run projects that actively use Android.

Universe@Home, World Community Grid and Asteroids@Home all have Android units available right now. The second Rosetta sends out Android units again (if ever), you'll know.
ID: 92409 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Fritzhuber

Send message
Joined: 19 Jan 16
Posts: 3
Credit: 176,501
RAC: 0
Message 92413 - Posted: 27 Mar 2020, 19:26:29 UTC - in response to Message 92406.  

Since today there are some Android WUs at the Ralp@Home Project (The official alpha test project for Rosetta@home). If those run stable there might be new Android WUs for Rosetta as well. Maybe you can help testing those WUs at Ralp@Home.
ID: 92413 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile yoerik
Avatar

Send message
Joined: 24 Mar 20
Posts: 128
Credit: 169,525
RAC: 0
Message 92414 - Posted: 27 Mar 2020, 19:37:50 UTC - in response to Message 92403.  

has &lt;run out&gt; of tasks right now


As far as I can tell it hasn't run out. I've been submitting to the R@H queue and apparently my jobs need 2G of ram (sorry 1G users...). But with that in mind, I see 1.4M jobs lined up and ready to go.


Also, on the topic of job length, here's the tricky scenario I'm in. Let's say for instance I have 1M proteins that need to be designed. My goal is to do this as fast as possible. But how to best do this? To avoid wasting your CPU cycles, I need to make sure that all jobs have enough proteins to go for 8 hours.

I submit this way, knowing full-well that not all of the proteins will be designed. Some people design for fewer hours, and some people just have slow computers (which are both fine btw). There's also another case where someone is running for 8 hours, but the job gets interrupted a bunch of times and doesn't finish for 2 weeks.

With this in mind, I wait about 2 days after all the jobs have started, at which point I see what has finished, and resubmit anything that hasn't come back yet. This process has to repeat a few times with each submission getting closer and closer to 100% completion, but I typically give up at around 80%-90% and then call it a day. (I don't necessarily need all the outputs, I just need a lot) (Also, when I resubmit, I don't give up on jobs currently running, I just give someone else the same job too.)

So with that in mind, yes, 8 hours is better than 4 hours because our server is under a lot of load at the moment. (More users and these design jobs are roughly 100X worse on the server). But, more importantly than the number of hours is the turnaround time, so if your 8 hour jobs are taking a week to finish, there's nothing wrong with going 4 hours.

Thanks for this.

Have to ask as a noob, though - what is the max ideal turnaround time for a slow PC? The laptops I'm running WUs on can take 10-12 hours per WU - and I can abort the Rosetta queue so I'm not slowing the research down.
ID: 92414 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
RandyF

Send message
Joined: 2 Nov 14
Posts: 6
Credit: 7,744,262
RAC: 0
Message 92415 - Posted: 27 Mar 2020, 19:39:06 UTC - in response to Message 92413.  
Last modified: 27 Mar 2020, 19:39:45 UTC

Thank you! Would love to help test! Pardon my ignorance, but how do I add Ralp@Home work units using the Android blank client? I don't see it listed in a list of projects.
ID: 92415 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile [VENETO] boboviz

Send message
Joined: 1 Dec 05
Posts: 2002
Credit: 9,790,281
RAC: 2,986
Message 92417 - Posted: 27 Mar 2020, 19:56:19 UTC - in response to Message 92415.  

Pardon my ignorance, but how do I add Ralp@Home work units using the Android blank client? I don't see it listed in a list of projects.

There are 3 points top right in project page of Android client, and "add a project by url".
ID: 92417 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
nealburns5

Send message
Joined: 11 May 19
Posts: 37
Credit: 10,184,436
RAC: 0
Message 92418 - Posted: 27 Mar 2020, 21:13:46 UTC - in response to Message 92414.  


Have to ask as a noob, though - what is the max ideal turnaround time for a slow PC? The laptops I'm running WUs on can take 10-12 hours per WU - and I can abort the Rosetta queue so I'm not slowing the research down.


I think they are all supposed to take around 8 hours (of cpu time) no matter how fast or slow the machine. They must be scaling the wus based on benchmarks.
ID: 92418 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile yoerik
Avatar

Send message
Joined: 24 Mar 20
Posts: 128
Credit: 169,525
RAC: 0
Message 92420 - Posted: 27 Mar 2020, 21:18:29 UTC - in response to Message 92418.  


Have to ask as a noob, though - what is the max ideal turnaround time for a slow PC? The laptops I'm running WUs on can take 10-12 hours per WU - and I can abort the Rosetta queue so I'm not slowing the research down.


I think they are all supposed to take around 8 hours (of cpu time) no matter how fast or slow the machine. They must be scaling the wus based on benchmarks.


To clarify - I asked about turnaround time (the time between downloading the WU and submitting it for validation) - as the project team member was talking about. They said they were more concerned about turnaround time, not CPU time. Thanks for trying to help, though!
ID: 92420 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Falconet

Send message
Joined: 9 Mar 09
Posts: 354
Credit: 1,276,393
RAC: 828
Message 92421 - Posted: 27 Mar 2020, 21:34:42 UTC
Last modified: 27 Mar 2020, 21:38:05 UTC

Bcov,

Thanks for the explanation. I assume this is why some WU's end far earlier than the designated CPU time target on the prefs, because they computed all the protein work packaged in the WU. I have my my prefs set at 24 hours for now.
ID: 92421 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Sid Celery

Send message
Joined: 11 Feb 08
Posts: 2146
Credit: 41,570,180
RAC: 8,210
Message 92422 - Posted: 27 Mar 2020, 22:10:18 UTC - in response to Message 92403.  

has &lt;run out&gt; of tasks right now

As far as I can tell it hasn't run out. I've been submitting to the R@H queue and apparently my jobs need 2G of ram (sorry 1G users...). But with that in mind, I see 1.4M jobs lined up and ready to go.

It was for a very short time - so short that it didn't exhaust buffers - and tasks started coming through again shortly after. A pre-emptive comment that was resolved before anyone noticed.

So with that in mind, yes, 8 hours is better than 4 hours because our server is under a lot of load at the moment. (More users and these design jobs are roughly 100X worse on the server). But, more importantly than the number of hours is the turnaround time, so if your 8 hour jobs are taking a week to finish, there's nothing wrong with going 4 hours.

Personally I hold 1.5 days buffer, plus the 8hr runtime, so everything I grab goes back in less than 2 days.

The subject's been discussed here before and you seem to confirm again it's the optimal balance of security of work for users and turnaround time for you.

As such, 4hr task runtimes only serve to double the hit on your servers, which you confirm they can ill-afford, for zero benefit.

If ever you guys need a quicker turnaround time, please pipe up. The adjustment for those who read here and pay attention is trivial.
ID: 92422 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Sid Celery

Send message
Joined: 11 Feb 08
Posts: 2146
Credit: 41,570,180
RAC: 8,210
Message 92423 - Posted: 27 Mar 2020, 22:28:54 UTC - in response to Message 92403.  

Also, on the topic of job length, here's the tricky scenario I'm in. Let's say for instance I have 1M proteins that need to be designed. My goal is to do this as fast as possible. But how to best do this? To avoid wasting your CPU cycles, I need to make sure that all jobs have enough proteins to go for 8 hours.

And on this, I was just about to say something.
My 8-core PC has 16Gb RAM, running 6 tasks needing 1Gb, 1 needing 1.6Gb and 1 needing 2Gb. I'm only just fitting them in.
Same with a 4-core laptop with 8Gb running 4*1Gb tasks right now, but which reported insufficient memory earlier today. The reason is now obvious.
Lots of reports of problems with tasks atm. I'd inspect for demands on memory before reporting.

With the work being run atm, Rosetta is a very demanding project. Users may need to consider whether upgrades are required to support it fully, not just with RAM but also with CPU cooling.
And now may be the time to blow out all those dust-bunnies that've built up in your PC case to run cooler. A little bit of maintenance never did any harm. Make use of those masks you bought too!
ID: 92423 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Sid Celery

Send message
Joined: 11 Feb 08
Posts: 2146
Credit: 41,570,180
RAC: 8,210
Message 92424 - Posted: 27 Mar 2020, 22:37:31 UTC - in response to Message 92422.  

Personally I hold 1.5 days buffer, plus the 8hr runtime, so everything I grab goes back in less than 2 days.

The subject's been discussed here before and you seem to confirm again it's the optimal balance of security of work for users and turnaround time for you.

Inadvertently it seems I provided the answer to later questions from others.
Any task buffer size you chose from the default values to these values are fine, but don't exceed them otherwise tasks are returned too late.
ID: 92424 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Tom

Send message
Joined: 28 Mar 20
Posts: 1
Credit: 245,052
RAC: 0
Message 92440 - Posted: 28 Mar 2020, 10:43:19 UTC

The international team CRUNCHERS SANS FRONTIERES is on board!
Thanks to the Rosetta@home project and its Admins for allowing us to participate in the fight against COVID-19.
Keep crunching hard!
ID: 92440 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Millenium

Send message
Joined: 20 Sep 05
Posts: 68
Credit: 184,283
RAC: 0
Message 92441 - Posted: 28 Mar 2020, 11:00:45 UTC

Welcome to all new crunchers! It is time to crunch!
And it's interesting to learn more about how the project works.
ID: 92441 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 92453 - Posted: 28 Mar 2020, 13:50:56 UTC - in response to Message 92420.  
Last modified: 28 Mar 2020, 20:03:26 UTC


Have to ask as a noob, though - what is the max ideal turnaround time for a slow PC? The laptops I'm running WUs on can take 10-12 hours per WU - and I can abort the Rosetta queue so I'm not slowing the research down.


I think they are all supposed to take around 8 hours (of cpu time) no matter how fast or slow the machine. They must be scaling the wus based on benchmarks.


To clarify - I asked about turnaround time (the time between downloading the WU and submitting it for validation) - as the project team member was talking about. They said they were more concerned about turnaround time, not CPU time. Thanks for trying to help, though!


The time per WU is based on a user preference for preferred runtime. Each machine, regardless of how fast it runs, tries to get as much done within that runtime preference as possible. Keep in mind that the preference refers to actual CPU time, not the "wall-clock" time (see the properties of a specific WU, where both times are shown).

All of the results are used. Regardless of how soon they were returned. I think they were simply saying that you don't need to babysit the machines. Try to set them up to get results returned within 48 hours if that is possible for your situation. You do this by reviewing your network preferences, and letting the machine run for a consistent number of hours per day, so the BOINC Manager can calibrate how much work to request to fill a cache of x.x days requested in the network preferences.
Rosetta Moderator: Mod.Sense
ID: 92453 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Sylphen IT-Systemhaus

Send message
Joined: 21 Oct 06
Posts: 1
Credit: 464,527
RAC: 0
Message 92472 - Posted: 28 Mar 2020, 17:03:22 UTC - in response to Message 92064.  

thats true
--
https://www.Sylphen.com
ID: 92472 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Me

Send message
Joined: 21 Aug 14
Posts: 2
Credit: 376,837
RAC: 0
Message 92477 - Posted: 28 Mar 2020, 17:48:44 UTC - in response to Message 92148.  
Last modified: 28 Mar 2020, 17:50:14 UTC

I agree with james. Lets get some priorities straight over there in the Lab. Doubled CPU time in the last short period... that is only for one reason, Covid19. Someone needs to do some rescheduling.
ID: 92477 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · 9 · 10 . . . 21 · Next

Message boards : News : Rosetta's role in fighting coronavirus



©2024 University of Washington
https://www.bakerlab.org