Scheduler to preempt on checkpoint

Message boards : Number crunching : Scheduler to preempt on checkpoint

To post messages, you must log in.

AuthorMessage
Profile Feet1st
Avatar

Send message
Joined: 30 Dec 05
Posts: 1755
Credit: 4,690,520
RAC: 0
Message 18822 - Posted: 16 Jun 2006, 20:41:51 UTC

This is great news. The 5.6 version of BOINC will have a scheduler that waits until checkpoints to preempt applications such as Rosetta.

June 15, 2006
BOINC's CPU scheduler has become smarter: it now waits until an application has checkpointed to preempt it and remove it from memory. This can save significant CPU time, especially on multiprocessors. Technical details are here. The new scheduler is in the development version of BOINC, and will appear in the 5.6 release. Volunteer developer John McLeod VII was the driving force behind the new scheduler.


This means no lost work just because you took the defaults when you set everything up and do not keep applications in memory. This will result in more useful work per day from PCs that are not keeping applications in memory when preempted.
Add this signature to your EMail:
Running Microsoft's "System Idle Process" will never help cure cancer, AIDS nor Alzheimer's. But running Rosetta@home just might!
https://boinc.bakerlab.org/rosetta/
ID: 18822 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile adrianxw
Avatar

Send message
Joined: 18 Sep 05
Posts: 653
Credit: 11,840,739
RAC: 28
Message 18849 - Posted: 17 Jun 2006, 12:15:10 UTC

I wonder what will happen with projects that don't have checkpoints in their application? Will it run the wu to completion "waiting" for a checkpoint that never comes?

uFluids, for example, does not checkpoint, and my last wu there was a 20+ hour beast.
Wave upon wave of demented avengers march cheerfully out of obscurity into the dream.
ID: 18849 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Feet1st
Avatar

Send message
Joined: 30 Dec 05
Posts: 1755
Credit: 4,690,520
RAC: 0
Message 18856 - Posted: 17 Jun 2006, 16:05:28 UTC

Well, with the current approach, my understanding is that unless your computer is on for the 20 hrs straight, and unless no other project preempts it, that the work is thrown away when the uFluids thread is removed from memory (which would depend upon the General preference for whether it is removed)... so for a project like that, a new approach can't be any WORSE than the current approach.
Add this signature to your EMail:
Running Microsoft's "System Idle Process" will never help cure cancer, AIDS nor Alzheimer's. But running Rosetta@home just might!
https://boinc.bakerlab.org/rosetta/
ID: 18856 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile adrianxw
Avatar

Send message
Joined: 18 Sep 05
Posts: 653
Credit: 11,840,739
RAC: 28
Message 18862 - Posted: 17 Jun 2006, 19:13:23 UTC

But the default is not to leave in memory, so a newbie downloading a first uF wu would not know that. So instead of resetting, it runs to completion...?
Wave upon wave of demented avengers march cheerfully out of obscurity into the dream.
ID: 18862 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Feet1st
Avatar

Send message
Joined: 30 Dec 05
Posts: 1755
Credit: 4,690,520
RAC: 0
Message 18877 - Posted: 18 Jun 2006, 5:16:31 UTC

Sorry, I don't know any more than is available on the link. It refers to a number of scheduling changes, and to which has most recently reached a checkpoint. Either way, if it crunched straight through 20hrs of uFluids, then debt would be incurred, and paid back as deadlines and future scheduling allow. It wasn't clear to me if it would only check the preemption if applications are not retained in memory or not.
Add this signature to your EMail:
Running Microsoft's "System Idle Process" will never help cure cancer, AIDS nor Alzheimer's. But running Rosetta@home just might!
https://boinc.bakerlab.org/rosetta/
ID: 18877 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile m.mitch
Avatar

Send message
Joined: 10 Feb 06
Posts: 34
Credit: 1,928,904
RAC: 0
Message 18887 - Posted: 18 Jun 2006, 15:43:58 UTC - in response to Message 18849.  

I wonder what will happen with projects that don't have checkpoints in their application? Will it run the wu to completion "waiting" for a checkpoint that never comes?

uFluids, for example, does not checkpoint, and my last wu there was a 20+ hour beast.


That's a very good question I hope has been taken in to count when the designers spec'd it.

I think uFluids has checkpoints now, doesn't it?




Click here to join the #1 Aussie Alliance on Rosetta
ID: 18887 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Keck_Komputers
Avatar

Send message
Joined: 17 Sep 05
Posts: 211
Credit: 4,246,150
RAC: 0
Message 18912 - Posted: 19 Jun 2006, 2:56:14 UTC - in response to Message 18887.  

I wonder what will happen with projects that don't have checkpoints in their application? Will it run the wu to completion "waiting" for a checkpoint that never comes?

uFluids, for example, does not checkpoint, and my last wu there was a 20+ hour beast.


That's a very good question I hope has been taken in to count when the designers spec'd it.

I think uFluids has checkpoints now, doesn't it?


If the app runs more than double or 1.5 times the switch time it will be forced out. I think they are still working on checkpoints at uFluids, but I havn't checked today so I may be behind.
BOINC WIKI

BOINCing since 2002/12/8
ID: 18912 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Message boards : Number crunching : Scheduler to preempt on checkpoint



©2024 University of Washington
https://www.bakerlab.org