Downloading far too many WU's - too short period to complete them

Message boards : Number crunching : Downloading far too many WU's - too short period to complete them

To post messages, you must log in.

AuthorMessage
BelgianEnthousiast

Send message
Joined: 25 May 15
Posts: 5
Credit: 1,023,045
RAC: 0
Message 78996 - Posted: 27 Oct 2015, 9:01:17 UTC

Hi,
When syncing Rosetta, the project automatically downloads a huge amount of WU's at once :
- I now have 226 WU's in wait(3 hours each, used to be 6 hours each)
- I'm currently processing 10 WU's on my system.
- The validity period is only 10 or 11 days.

I'm also participating in LHC, Atlas, Climateprediction
which means that I am forced to process all Rosetta's continuously to be able to meet the deadlines and not
losing out on any jobs, effectively halting all other projects.

I have fiddled around with setting "Maintain enough work for an additional (Enforced by version 5.10+)" to 1 day, but Rosetta just seems to ignores this and keeps downloading this many jobs.

Is there any way I can prevent this from happening ?
I'm ok to download quite a few jobs and prefer to have a buffer of say 3 to 4 days to ensure sufficient work even if a server goes down for a couple of days.

But this many jobs is simply choking my system & hindering other projects.

Many thanks for investigating into this !

Kind Regards,

K.
ID: 78996 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile dcdc

Send message
Joined: 3 Nov 05
Posts: 1829
Credit: 117,188,921
RAC: 72,258
Message 78998 - Posted: 27 Oct 2015, 13:31:12 UTC - in response to Message 78996.  

Hi,
When syncing Rosetta, the project automatically downloads a huge amount of WU's at once :
- I now have 226 WU's in wait(3 hours each, used to be 6 hours each)
- I'm currently processing 10 WU's on my system.
- The validity period is only 10 or 11 days.

I'm also participating in LHC, Atlas, Climateprediction
which means that I am forced to process all Rosetta's continuously to be able to meet the deadlines and not
losing out on any jobs, effectively halting all other projects.

I have fiddled around with setting "Maintain enough work for an additional (Enforced by version 5.10+)" to 1 day, but Rosetta just seems to ignores this and keeps downloading this many jobs.

Is there any way I can prevent this from happening ?
I'm ok to download quite a few jobs and prefer to have a buffer of say 3 to 4 days to ensure sufficient work even if a server goes down for a couple of days.

But this many jobs is simply choking my system & hindering other projects.

Many thanks for investigating into this !

Kind Regards,

K.

Hi

The work-fetch is managed by BOINC, rather than Rosetta. If you've changed some settings then that might be why. I wouldn't worry about it though - BOINC will abort the tasks if they're expired, and if they are processed but miss the deadline then they'll still be credited and still be useful.

D
ID: 78998 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 78999 - Posted: 27 Oct 2015, 14:47:44 UTC

If you give the BOINC Manager a day or so, without trying to fix it, it should be able to adjust to request the proper amount of work for your operating environment. As you start any project, the BOINC Manager has to take an initial guess and how to make things work, and it automatically adjusts things from there.

If you have recently increased your preferred WU runtime setting on the R@h website, I'd suggest setting it back and only increasing it gradually over the course of a few days.
Rosetta Moderator: Mod.Sense
ID: 78999 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
BelgianEnthousiast

Send message
Joined: 25 May 15
Posts: 5
Credit: 1,023,045
RAC: 0
Message 79001 - Posted: 28 Oct 2015, 17:11:15 UTC

Hi D & Mod.Sense,

Thanks for the quick response !
I'll wait it out and see how it behaves.

K.
ID: 79001 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Message boards : Number crunching : Downloading far too many WU's - too short period to complete them



©2024 University of Washington
https://www.bakerlab.org