Rosetta work units won't start or run

Message boards : Number crunching : Rosetta work units won't start or run

To post messages, you must log in.

AuthorMessage
Dougga

Send message
Joined: 27 Nov 06
Posts: 28
Credit: 5,248,050
RAC: 0
Message 100919 - Posted: 31 Mar 2021, 6:54:10 UTC

I've switched a miniPC to Rosetta after a year or two and find that nothing runs.
I have work units with a status of 'ready to start' but they never start.
Activity set to 'Run Always' etc... etc...

Computer Id: 6052705
ID: 100919 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1481
Credit: 14,588,202
RAC: 14,796
Message 100920 - Posted: 31 Mar 2021, 7:35:56 UTC

There have been a lot of reports of this issue lately, but no real idea of why they are presently occurring. If you check your Event log, there will probably be messages about not enough available disk space and/or available memory.
In your account, When and how BOINC uses your computer- Computing preferences,
Give these values a go.
Disk
                             Use no more than 20 GB
                               Leave at least 2 GB free
                             Use no more than 60 % of total

Memory
         When computer is in use, use at most 95 %
     When computer is not in use, use at most 95 %
Leave non-GPU tasks in memory while suspended N
                  Page/swap file: use at most 75 %

Save them, then select Roesetta on the BOINC Manager on that system & then Update for the changes to get downloaded.
With luck Tasks should start processing.
If not, check the Event log for further messages.



NB- it would also be worth running the benchmarks on that system so the Credit you get is of a reasonable amount when things finally do start running.
Grant
Darwin NT
ID: 100920 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Bryn Mawr

Send message
Joined: 26 Dec 18
Posts: 374
Credit: 10,701,107
RAC: 5,457
Message 100921 - Posted: 31 Mar 2021, 7:38:50 UTC - in response to Message 100919.  

I've switched a miniPC to Rosetta after a year or two and find that nothing runs.
I have work units with a status of 'ready to start' but they never start.
Activity set to 'Run Always' etc... etc...

Computer Id: 6052705


There have been recent reports of work units requiring lots of memory before they’ll start so how are you setting the parameters? With only 8gb total you should allow 90-95% of memory to be used.

You could also try cutting %cpu from 100 to 50 to see if that will release them.
ID: 100921 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
PorkyPies

Send message
Joined: 6 Apr 20
Posts: 45
Credit: 1,650,779
RAC: 0
Message 100930 - Posted: 31 Mar 2021, 12:09:52 UTC
Last modified: 31 Mar 2021, 12:17:59 UTC

Like the others I had errors in the logs for my Pi4's which have been crunching here for a while without any issues.

Pi4 4GB
Rosetta@home 31/03/2021 10:32:19 PM Message from server: Rosetta needs 6675.72 MB RAM but only 3460.72 MB is available for use.
Rosetta@home 31/03/2021 10:32:19 PM Message from server: Rosetta needs 4037.10MB more disk space. You currently have 4545.97 MB available and it needs 8583.07 MB.

Pi4 8GB
Rosetta@home 31/03/2021 11:29:23 AM Message from server: Rosetta needs 4039.25MB more disk space. You currently have 4543.82 MB available and it needs 8583.07 MB.

Clearly the project has upped the requirements because I haven't changed anything on my side. This might be for new work coming, or maybe its a response to previous work failing due to insufficient memory and/or disk space. New requirements are 6.6GB RAM (per work unit?) and 8.5GB of disk space.

There isn't anything I can do about the RAM on a Raspberry Pi. BOINC takes the min of the various settings, so simply saying it can use 10GB may not be enough, I also had to set the "Use at most" to 70% of available disk space. I'm currently using 16GB micro SD cards. It looks like I need to start using 32GB ones, at least for the Pi's that can continue running Rosetta, the rest will move to other projects.
MarksRpiCluster
ID: 100930 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
mikey
Avatar

Send message
Joined: 5 Jan 06
Posts: 1894
Credit: 8,767,285
RAC: 12,464
Message 100942 - Posted: 1 Apr 2021, 0:32:16 UTC - in response to Message 100930.  

Like the others I had errors in the logs for my Pi4's which have been crunching here for a while without any issues.

Pi4 4GB
Rosetta@home 31/03/2021 10:32:19 PM Message from server: Rosetta needs 6675.72 MB RAM but only 3460.72 MB is available for use.
Rosetta@home 31/03/2021 10:32:19 PM Message from server: Rosetta needs 4037.10MB more disk space. You currently have 4545.97 MB available and it needs 8583.07 MB.

Pi4 8GB
Rosetta@home 31/03/2021 11:29:23 AM Message from server: Rosetta needs 4039.25MB more disk space. You currently have 4543.82 MB available and it needs 8583.07 MB.

Clearly the project has upped the requirements because I haven't changed anything on my side. This might be for new work coming, or maybe its a response to previous work failing due to insufficient memory and/or disk space. New requirements are 6.6GB RAM (per work unit?) and 8.5GB of disk space.

There isn't anything I can do about the RAM on a Raspberry Pi. BOINC takes the min of the various settings, so simply saying it can use 10GB may not be enough, I also had to set the "Use at most" to 70% of available disk space. I'm currently using 16GB micro SD cards. It looks like I need to start using 32GB ones, at least for the Pi's that can continue running Rosetta, the rest will move to other projects.


Einstein BRP tasks can run on the Pi's you have as they are
ID: 100942 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Sid Celery

Send message
Joined: 11 Feb 08
Posts: 1981
Credit: 38,426,190
RAC: 13,225
Message 100947 - Posted: 1 Apr 2021, 1:00:25 UTC - in response to Message 100930.  

There isn't anything I can do about the RAM on a Raspberry Pi. BOINC takes the min of the various settings, so simply saying it can use 10GB may not be enough, I also had to set the "Use at most" to 70% of available disk space. I'm currently using 16GB micro SD cards. It looks like I need to start using 32GB ones, at least for the Pi's that can continue running Rosetta, the rest will move to other projects.

Is it possible you could set Boinc to run 75% of cores if your RAM is restricted?
I'm not sure if that will make it work, but at least worth a try if the alternative is not running any.
ID: 100947 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
PorkyPies

Send message
Joined: 6 Apr 20
Posts: 45
Credit: 1,650,779
RAC: 0
Message 100963 - Posted: 1 Apr 2021, 10:56:34 UTC - in response to Message 100942.  

Einstein BRP tasks can run on the Pi's you have as they are

They were set to run Einstein and Rosetta in a 50/50 split. They'll be doing Einstein once they finish the Rosetta work they have on board.

Asteroids have an armhf app but its painfully slow and doesn't use neon that the Pi2's (ARMv7) and later have.
MarksRpiCluster
ID: 100963 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
PorkyPies

Send message
Joined: 6 Apr 20
Posts: 45
Credit: 1,650,779
RAC: 0
Message 100964 - Posted: 1 Apr 2021, 11:01:36 UTC - in response to Message 100947.  

Is it possible you could set Boinc to run 75% of cores if your RAM is restricted?
I'm not sure if that will make it work, but at least worth a try if the alternative is not running any.

Doesn't make any difference. It looks like it comparing the free memory against the 6.6GB project minimum. The stupid thing is they still have a couple of Rosetta tasks running off that are using around 300MB of memory each, nowhere near 6.6GB.
MarksRpiCluster
ID: 100964 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Sid Celery

Send message
Joined: 11 Feb 08
Posts: 1981
Credit: 38,426,190
RAC: 13,225
Message 100975 - Posted: 1 Apr 2021, 12:59:17 UTC - in response to Message 100964.  

Is it possible you could set Boinc to run 75% of cores if your RAM is restricted?
I'm not sure if that will make it work, but at least worth a try if the alternative is not running any.

Doesn't make any difference. It looks like it comparing the free memory against the 6.6GB project minimum. The stupid thing is they still have a couple of Rosetta tasks running off that are using around 300MB of memory each, nowhere near 6.6GB.

Ugh. At least we (I) know for sure now
ID: 100975 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Dougga

Send message
Joined: 27 Nov 06
Posts: 28
Credit: 5,248,050
RAC: 0
Message 101166 - Posted: 8 Apr 2021, 18:11:43 UTC - in response to Message 100920.  
Last modified: 8 Apr 2021, 18:15:22 UTC

I've not received any messages in the logs concerning lack of memory.
I'm using less than 1G of 8G
Just to be sure, I've set Max memory utilization to 95%


I'll restart my work with Einstein and not worry about Rosetta any more.
ID: 101166 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
CIA

Send message
Joined: 3 May 07
Posts: 100
Credit: 21,059,812
RAC: 0
Message 101189 - Posted: 9 Apr 2021, 17:31:48 UTC - in response to Message 101166.  

Just to chime in here on the 'Ready to Start' situation...

I noticed a few days ago that I was when I would get a work unit or 2 (during the most recent drought) they would stick on "ready to start' for quite some time before actually starting. I was tinkering with one machine trying to get them to start up, but then I got distracted. A few minutes later, the WU's just started up on their own. So basically, while odd, I think patience might be the solution.

Let them sit for awhile a see if they do start up. If they haven't started in 15 minutes then something else is probably wrong.
ID: 101189 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Kissagogo27

Send message
Joined: 31 Mar 20
Posts: 83
Credit: 2,638,385
RAC: 2,168
Message 101193 - Posted: 9 Apr 2021, 20:26:07 UTC

2 computer, same configuration, except 4Go for the one and 2Go only for the second ( E7600 2 cores )

with 4GB of ram, the 2 WU starts immediatly
with 2GB of ram, one start immediatly and the second start 1mn after ...
ID: 101193 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
nwayno

Send message
Joined: 28 May 20
Posts: 6
Credit: 6,971,136
RAC: 435
Message 101229 - Posted: 11 Apr 2021, 5:48:15 UTC - in response to Message 100920.  

I tried these suggestions, and they *DO* work, but only on 8G pi 4.

I am running ubuntu server 20.04 with xubuntu desktop.

There is no thaumaturging that works to make this run a pi 4 with 4G that I have found.

On my desktop machine, A Ryzen 7 with 32G (also running Xubuntu 20.04 lts), I have noticed
that tasks that used to take 8 hours to run, now take 12 hours. 50% longer.

I do wish they'd keep us informed as to minimum requirements, rather then having to
use the trial and error method.

Thanks for getting me going.

Wayno
pkill-9.com
ID: 101229 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile [VENETO] boboviz

Send message
Joined: 1 Dec 05
Posts: 1860
Credit: 8,152,819
RAC: 8,197
Message 101230 - Posted: 11 Apr 2021, 7:10:53 UTC - in response to Message 101229.  
Last modified: 11 Apr 2021, 7:11:05 UTC

I do wish they'd keep us informed as to minimum requirements, rather then having to use the trial and error method.

No admins, here.
No answers, here.
ID: 101230 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1481
Credit: 14,588,202
RAC: 14,796
Message 101232 - Posted: 11 Apr 2021, 10:03:22 UTC - in response to Message 101229.  
Last modified: 11 Apr 2021, 10:04:22 UTC

On my desktop machine, A Ryzen 7 with 32G (also running Xubuntu 20.04 lts), I have noticed that tasks that used to take 8 hours to run, now take 12 hours. 50% longer.
The default processing time is 8 hours. There is a 10 hour watchdog timer that allows a Task that can't be done in 8 hours to be killed off if it can be completed within 18hours.

However the extra Runtimes you are having with your Ryzen 7 3700X is a problem with the system itself, not the Tasks.
The CPU time is still 8 hours, however the actual Run time is 13+ hours. This indicates the system is busy doing things other than processing BOINC work. I suggest you find out what else is consuming half of your CPU's time.
Grant
Darwin NT
ID: 101232 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Kissagogo27

Send message
Joined: 31 Mar 20
Posts: 83
Credit: 2,638,385
RAC: 2,168
Message 101243 - Posted: 11 Apr 2021, 21:03:07 UTC

curious thing ...

last WU https://boinc.bakerlab.org/rosetta/result.php?resultid=1365594541 with FLOPS maximum de l'appareil 1.00 GFLOPS

but here https://boinc.bakerlab.org/rosetta/show_host_detail.php?hostid=5926525 7.2Gflops ...
ID: 101243 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Falconet

Send message
Joined: 9 Mar 09
Posts: 350
Credit: 1,017,068
RAC: 435
Message 101244 - Posted: 11 Apr 2021, 21:26:42 UTC - in response to Message 101243.  
Last modified: 11 Apr 2021, 21:27:55 UTC

curious thing ...

last WU https://boinc.bakerlab.org/rosetta/result.php?resultid=1365594541 with FLOPS maximum de l'appareil 1.00 GFLOPS

but here https://boinc.bakerlab.org/rosetta/show_host_detail.php?hostid=5926525 7.2Gflops ...



Possibly the benchmarks hadn't been run yet when that WU was returned.
ID: 101244 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Message boards : Number crunching : Rosetta work units won't start or run



©2024 University of Washington
https://www.bakerlab.org