Problems and Technical Issues with Rosetta@home

Message boards : Number crunching : Problems and Technical Issues with Rosetta@home

To post messages, you must log in.

Previous · 1 . . . 147 · 148 · 149 · 150 · 151 · 152 · 153 . . . 274 · Next

AuthorMessage
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5658
Credit: 5,670,291
RAC: 2,328
Message 103873 - Posted: 21 Dec 2021, 23:28:06 UTC - in response to Message 103870.  

I'm using vbox v6.1. My job requires a lot of virtualisation so I'm always running the latest stable virtualbox.

Interesting that python doesn't like it. I'm running python 3.9.7 which I am guessing isn't "old python".

Any legacy Rosetta is running fine after I made the changes suggested above so I'm happy for the moment. Again, BOINC for me is set and forget - the only thing I adjust is the %CPU it uses on my desktop whilst I'm working. Overnight 100%, email, doco etc it gets 80%, if I'm coding it gets none.

Thanks, Grant.



Well...just let the old pythons pass through your system and let someone else using V5.xx of Vbox run them.
I am on 6.x now of Vbox and I am getting only the new work which is stable.
ID: 103873 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1467
Credit: 14,322,361
RAC: 16,418
Message 103875 - Posted: 22 Dec 2021, 6:54:41 UTC

Looks like we've finished the most recent batch of Rosetta 4.20 Tasks.
Grant
Darwin NT
ID: 103875 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
tullio

Send message
Joined: 10 May 20
Posts: 63
Credit: 630,125
RAC: 0
Message 103876 - Posted: 22 Dec 2021, 12:08:21 UTC

I am running two tasks at a time on my PC with 12 GB RAM. A third one is waiting for more memory but it has done some running too. A fourth one is ready to run.
Tullio
ID: 103876 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Paddles

Send message
Joined: 15 Mar 15
Posts: 11
Credit: 4,883,483
RAC: 3,984
Message 103878 - Posted: 22 Dec 2021, 14:03:12 UTC

I too was having problems with too many of the vbox jobs trying to run at once, leaving not enough resources resulting in Rosetta and other project tasks not being able to run, resulting in lower overall performance. In my case, lowering Rosetta's resource from 200 (out of 500 - 40% share) to 100 (out of 400 - 25% share) is giving me 10-15% more work completed across all projects. I haven't had any vbox jobs that had to be aborted since then.

BOINC is allowed 11/12 cores, 75% of 32GB RAM. Other projects are WCG and Yoyo.
ID: 103878 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Scottie McKinley

Send message
Joined: 14 Jan 21
Posts: 5
Credit: 2,376,461
RAC: 0
Message 103879 - Posted: 22 Dec 2021, 14:09:51 UTC - in response to Message 103878.  

Yeah, looks like vbox only jobs running. My 8 phyton tasks only show using 20gb ram. It seems vbox reserves so much more ram than it actually uses.
ID: 103879 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
.clair.

Send message
Joined: 2 Jan 07
Posts: 274
Credit: 26,399,595
RAC: 3
Message 103882 - Posted: 23 Dec 2021, 14:08:42 UTC

Having great difficulty getting any work, can`t even get pythons on systems that are set up for it [and been running them], anyone else seeing this.
I have seen 5000 python ready to send on the server status page,
most work requests get the `no tasks sent` and no reason why message.
ID: 103882 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jim1348

Send message
Joined: 19 Jan 06
Posts: 881
Credit: 52,257,545
RAC: 0
Message 103883 - Posted: 23 Dec 2021, 14:38:06 UTC - in response to Message 103882.  
Last modified: 23 Dec 2021, 14:40:02 UTC

I have been getting pythons regularly (most recently 3 hours ago) on two Ryzen 3900X's. So it much be a machine or network problem.

But the errors ("0 CPU" and "Vm job unmanageable") are getting too annoying for me. I will wait until later to get more, and maybe they will have it fixed. Though they do not even indicate that they know there are problems, so it could be a while.
ID: 103883 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jim1348

Send message
Joined: 19 Jan 06
Posts: 881
Credit: 52,257,545
RAC: 0
Message 103884 - Posted: 23 Dec 2021, 16:38:46 UTC - in response to Message 103882.  

most work requests get the `no tasks sent` and no reason why message.

Do you have any of the "Vm job unmanageable" ones on you machine? That will prevent any more from downloading.
You need to reboot to fix it. Or find another project.
ID: 103884 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
.clair.

Send message
Joined: 2 Jan 07
Posts: 274
Credit: 26,399,595
RAC: 3
Message 103885 - Posted: 23 Dec 2021, 20:19:02 UTC - in response to Message 103884.  

most work requests get the `no tasks sent` and no reason why message.

Do you have any of the "Vm job unmanageable" ones on you machine? That will prevent any more from downloading.
You need to reboot to fix it. Or find another project.

I luckily have never had any `unmanageable` jobs or things like that,
and I only have 5 error tasks and one of them was `cancelled by server` another three where the `one minit wunders` that run for hours and do nothing , aborted them.
I did reboot the computer earlier today anyway, just in case something had gone funky
Just had a look at the server status, only three R4.2 jobs in que.
ID: 103885 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jonathan

Send message
Joined: 4 Oct 17
Posts: 42
Credit: 1,337,472
RAC: 60
Message 103886 - Posted: 23 Dec 2021, 20:29:37 UTC - in response to Message 103885.  

Check the details tab of your individual computer(s) on this website and see if "VirtualBox VM jobs" is showing Skip. If you want VM / Python jobs, that has to say Allow
ID: 103886 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5658
Credit: 5,670,291
RAC: 2,328
Message 103887 - Posted: 23 Dec 2021, 23:20:25 UTC - in response to Message 103884.  

most work requests get the `no tasks sent` and no reason why message.

Do you have any of the "Vm job unmanageable" ones on you machine? That will prevent any more from downloading.
You need to reboot to fix it. Or find another project.



Jim, have a look here at a older reddit thread.
Its to late at night here in the EU to try and understand what this person is saying, but maybe you understand it?
ID: 103887 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
.clair.

Send message
Joined: 2 Jan 07
Posts: 274
Credit: 26,399,595
RAC: 3
Message 103888 - Posted: 23 Dec 2021, 23:46:18 UTC - in response to Message 103886.  

Check the details tab of your individual computer(s) on this website and see if "VirtualBox VM jobs" is showing Skip. If you want VM / Python jobs, that has to say Allow

I have two computers that are worth running VM jobs on and for both of them the button "VirtualBox VM jobs" is showing "Allow"
For some strange reason they stopped getting ANY work, one has now got two ordinary R4.2 tasks ,
The pythons don't want to come out of their cages and get crunched.
It may just be a strange scheduler thing that will work itself out in time.
ID: 103888 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1467
Credit: 14,322,361
RAC: 16,418
Message 103891 - Posted: 24 Dec 2021, 6:50:55 UTC - in response to Message 103888.  

Check the details tab of your individual computer(s) on this website and see if "VirtualBox VM jobs" is showing Skip. If you want VM / Python jobs, that has to say Allow

I have two computers that are worth running VM jobs on and for both of them the button "VirtualBox VM jobs" is showing "Allow"
For some strange reason they stopped getting ANY work, one has now got two ordinary R4.2 tasks ,
The pythons don't want to come out of their cages and get crunched.
It may just be a strange scheduler thing that will work itself out in time.
Or there were issues with them & they were black listed by the server.
Grant
Darwin NT
ID: 103891 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mad_Max

Send message
Joined: 31 Dec 09
Posts: 207
Credit: 23,098,389
RAC: 13,153
Message 103893 - Posted: 24 Dec 2021, 8:16:04 UTC - in response to Message 103718.  
Last modified: 24 Dec 2021, 8:17:02 UTC

I had gone as far to untick all the disk space boxes to give it unlimited use of the disk
The boxes aren't tickable, they require values. And one value in any one of the options overrides the values in any of the other two when it comes to what disk space is actually available.

They are quite tickable - there are checkboxes to the left of each value box which turn off corresponding limit.

I was referring to the web based settings.
If you've only got one system, local Setting are ok. More than one, web based settings make life much easier.

web based settings also have same checkboxes for disk and network usage limits as local settings do. At least here on Rosetta server web based settings for BOINC.
ID: 103893 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1467
Credit: 14,322,361
RAC: 16,418
Message 103894 - Posted: 24 Dec 2021, 9:01:04 UTC - in response to Message 103893.  

I had gone as far to untick all the disk space boxes to give it unlimited use of the disk
The boxes aren't tickable, they require values. And one value in any one of the options overrides the values in any of the other two when it comes to what disk space is actually available.

They are quite tickable - there are checkboxes to the left of each value box which turn off corresponding limit.

I was referring to the web based settings.
If you've only got one system, local Setting are ok. More than one, web based settings make life much easier.

web based settings also have same checkboxes for disk and network usage limits as local settings do. At least here on Rosetta server web based settings for BOINC.
Hmm.
That's new.
Clicked on Edit and up come the check boxes with the value boxes next to them.
Grant
Darwin NT
ID: 103894 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jim1348

Send message
Joined: 19 Jan 06
Posts: 881
Credit: 52,257,545
RAC: 0
Message 103896 - Posted: 24 Dec 2021, 14:44:04 UTC - in response to Message 103887.  

Jim, have a look here at a older reddit thread.

Thanks, but I think Project Lasso is for Windows. I am on Linux, and don't change the default priorities.

You may be able to avoid the problem by running only one or two cores, but that defeats the purpose for me.
They have to fix it at the Rosetta end. LHC has managed to do so with their own Vbox wrapper.
ID: 103896 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
.clair.

Send message
Joined: 2 Jan 07
Posts: 274
Credit: 26,399,595
RAC: 3
Message 103897 - Posted: 24 Dec 2021, 15:27:41 UTC - in response to Message 103891.  

Check the details tab of your individual computer(s) on this website and see if "VirtualBox VM jobs" is showing Skip. If you want VM / Python jobs, that has to say Allow

I have two computers that are worth running VM jobs on and for both of them the button "VirtualBox VM jobs" is showing "Allow"
For some strange reason they stopped getting ANY work, one has now got two ordinary R4.2 tasks ,
The pythons don't want to come out of their cages and get crunched.
It may just be a strange scheduler thing that will work itself out in time.
Or there were issues with them & they were black listed by the server.

Grant (SSSF) YOU GOT IT I am now getting Pythons again. 35 running.
The buttons work backwards {sort of}
If the button is showing "Allow" That computer is set on "skip" and will NOT get VB/Python work.
To get VB/Python work click the "Allow" button to get work again, and the button changes to "Skip" {for those that don`t want them etc}
After doing the `click and collect` I got this message on the webpage ....
------------------------------
Host updated
This host can now run VirtualBox VM jobs
This change will take effect the next time the host communicates with this project. If VM jobs cannot run due VirtualBox errors, this host will be flagged again to skip VM jobs.
_________________________
And so whoever it is [that has been blacklisted] will have to click the "Allow" button again to get tasks again to order in another takeaway of Pythons {oops sorry wrong website :), }
ID: 103897 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5658
Credit: 5,670,291
RAC: 2,328
Message 103898 - Posted: 24 Dec 2021, 17:29:44 UTC - in response to Message 103896.  
Last modified: 24 Dec 2021, 18:20:48 UTC

Jim, have a look here at a older reddit thread.

Thanks, but I think Project Lasso is for Windows. I am on Linux, and don't change the default priorities.

You may be able to avoid the problem by running only one or two cores, but that defeats the purpose for me.
They have to fix it at the Rosetta end. LHC has managed to do so with their own Vbox wrapper.


I keep losing QuChem to that problem. I am now reducing it to a single task and core from 2.
I thought python was causing troubles, that does not seem to be the case.
ID: 103898 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
computezrmle

Send message
Joined: 9 Dec 11
Posts: 63
Credit: 9,680,103
RAC: 0
Message 103903 - Posted: 25 Dec 2021, 11:52:29 UTC - in response to Message 103896.  

... Project Lasso is for Windows. I am on Linux ...

On Linux systemd slices can be used to group processes and modify/control their priorities.
The following steps can be used on a Linux system running cgroups v2.
Cgroups v1 used by older kernels have a slightly different syntax as well as different default values.


Shutdown BOINC and create/modify the systemd configuration as follows

1.
Create a slice description /etc/systemd/system/boinc.slice
Content:
[Unit]
Description=BOINC main Slice
Before=slices.target
Requires=-.slice
After=-.slice


2.
Add this to the [Service] section of your BOINC service file (usually /etc/systemd/system/boinc-client):
Slice=boinc.slice


3.
Run "systemctl daemon-reload" (or reboot) and restart BOINC.
To check whether BOINC (and all processes started by BOINC or below) is running as part of the boinc slice run "systemctl status boinc-client.service" and check for:
CGroup: /boinc.slice



The default priority for all slices on the same level is 100.
This means system(slice), user(slice) and boinc(slice) are now running at the same priority relative to each other.

This simple example (permanently) modifies the mentioned scheduler parameters:
systemctl set-property boinc.slice CPUWeight=70 CPUQuota=300% CPUQuotaPeriodSec=400ms

CPUWeight=70: reduces the relative priority of all processes running in this slice to 70
=> System processes and interactive (user) processes stay responsive even on fully loaded systems
CPUQuota=300%: limits the slice to never use more than 3 cores, even if the system has many more and even if BOINC runs many more tasks.
CPUQuotaPeriodSec=400ms: Tries to keep a process active for the given timespan (Linux default: 100ms)
=> usually better CPU cache efficiency for long running background processes

Further information can be found in the systemd manual and the kernel manual.
ID: 103903 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jim1348

Send message
Joined: 19 Jan 06
Posts: 881
Credit: 52,257,545
RAC: 0
Message 103905 - Posted: 25 Dec 2021, 16:52:36 UTC - in response to Message 103903.  

On Linux systemd slices can be used to group processes and modify/control their priorities.

I have tried modifying priorities on a temporary basis, but have never found any that correct the "Vm job unmanageable" problem.

This should be done by the project anyway, but thanks for the procedure.
ID: 103905 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Previous · 1 . . . 147 · 148 · 149 · 150 · 151 · 152 · 153 . . . 274 · Next

Message boards : Number crunching : Problems and Technical Issues with Rosetta@home



©2024 University of Washington
https://www.bakerlab.org