Rosetta hogging resources, CPU cores inactive!

Questions and Answers : Unix/Linux : Rosetta hogging resources, CPU cores inactive!

To post messages, you must log in.

AuthorMessage
ProDigit

Send message
Joined: 6 Dec 18
Posts: 26
Credit: 2,112,998
RAC: 6,993
Message 96697 - Posted: 21 May 2020, 17:33:08 UTC
Last modified: 21 May 2020, 17:35:48 UTC

I have a Ryzen 3900x system with 24 threads, and only 16GB of RAM.
I noticed when there are more than 15 projects of Rosetta running, that some (like 5) CPU cores are passive (not crunching) because the projects are waiting for memory.
This also causes my CPU to run at lower frequencies, hogging down the entire crunching process, huring other project's progress as well!
The Ryzen 9 3900x in my machine is set to run most optimal with all cores loaded at 100% utilization.

I want to limit Rosetta to 12 cores max on this PC.
I know the access is in /var/lib/boinc/projects/ (the rosetta folder), app_config.xml

I have it currently as:
                                                             
<app_config>
<app>
<name>Rosetta</name>
<max_concurrent>12</max_concurrent>
</app>
</app_config>


Boinc MGR doesn't complain about it being a wrong name, but it also doesn't adhere to the limitation.
The project WU name is 'Rosetta 4.20', but I know app_config doesn't allow a space in the name.
I haven't been able to make it work so far...
What else do I need to do?
ID: 96697 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
ProDigit

Send message
Joined: 6 Dec 18
Posts: 26
Credit: 2,112,998
RAC: 6,993
Message 96698 - Posted: 21 May 2020, 17:43:45 UTC
Last modified: 21 May 2020, 17:44:15 UTC

For now I just did some redundant lines, all meaning basically the same thing, in the hopes that at least 1 triggers the command:

<app_config>
<app>
<name>Rosetta</name>
<max_concurrent>12</max_concurrent>
<gpu_versions></gpu_versions>
</app>
<app_version>
<app_name>Rosetta</app_name>
<avg_ncpus>12</avg_ncpus>
</app_version>
<project_max_concurrent>12</project_max_concurrent>
</app_config>
ID: 96698 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 754
Credit: 5,212,861
RAC: 21,719
Message 96700 - Posted: 21 May 2020, 18:44:44 UTC - in response to Message 96697.  

Boinc MGR doesn't complain about it being a wrong name, but it also doesn't adhere to the limitation.
You did exit & restart BOINC, or use "Options, Read config files" after editing app_config.xml?
Grant
Darwin NT
ID: 96700 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Bryn Mawr

Send message
Joined: 26 Dec 18
Posts: 158
Credit: 4,850,825
RAC: 8,918
Message 96721 - Posted: 22 May 2020, 11:38:45 UTC - in response to Message 96697.  

I have a Ryzen 3900x system with 24 threads, and only 16GB of RAM.
I noticed when there are more than 15 projects of Rosetta running, that some (like 5) CPU cores are passive (not crunching) because the projects are waiting for memory.
This also causes my CPU to run at lower frequencies, hogging down the entire crunching process, huring other project's progress as well!
The Ryzen 9 3900x in my machine is set to run most optimal with all cores loaded at 100% utilization.

I want to limit Rosetta to 12 cores max on this PC.
I know the access is in /var/lib/boinc/projects/ (the rosetta folder), app_config.xml

I have it currently as:
                                                             
<app_config>
<app>
<name>Rosetta</name>
<max_concurrent>12</max_concurrent>
</app>
</app_config>


Boinc MGR doesn't complain about it being a wrong name, but it also doesn't adhere to the limitation.
The project WU name is 'Rosetta 4.20', but I know app_config doesn't allow a space in the name.
I haven't been able to make it work so far...
What else do I need to do?


Firstly the xml should allow a space if you enclose the string in quotes.

Secondly, as you want the limit to be project wide and not app specific all you need is :-

<app_config>
<project_max_concurrent>12</project_max_concurrent>
</app_config>
ID: 96721 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Questions and Answers : Unix/Linux : Rosetta hogging resources, CPU cores inactive!



©2020 University of Washington
https://www.bakerlab.org