free up a core for GPU

Message boards : Number crunching : free up a core for GPU

To post messages, you must log in.

AuthorMessage
Robby1959

Send message
Joined: 10 May 07
Posts: 38
Credit: 9,298,741
RAC: 0
Message 78809 - Posted: 17 Sep 2015, 17:19:04 UTC

is there a way to run just 3 rosettas on a 4 core cpu as it starves the GPU units I run
ID: 78809 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
rjs5

Send message
Joined: 22 Nov 10
Posts: 273
Credit: 22,246,595
RAC: 13,325
Message 78811 - Posted: 17 Sep 2015, 21:08:14 UTC - in response to Message 78809.  

is there a way to run just 3 rosettas on a 4 core cpu as it starves the GPU units I run


I have the following XML in the Rosetta directory. The following should limit minirosetta jobs to a maximum of 3.

<app_config>
<app> <name> minirosetta </name> <max_concurrent> 3 </max_concurrent> </app>
</app_config>


Here is the path of the directory on my Windows machine:
C:ProgramDataBOINCprojectsboinc.bakerlab.org_rosetta


Some project have multiple named tasks and you would need 1 line for each one. If you misspell the task name, the project will display the list of valid name in the MESSAGE log.
ID: 78811 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Betting Slip

Send message
Joined: 26 Sep 05
Posts: 71
Credit: 5,702,246
RAC: 0
Message 78812 - Posted: 17 Sep 2015, 21:40:55 UTC - in response to Message 78811.  
Last modified: 17 Sep 2015, 21:41:24 UTC

is there a way to run just 3 rosettas on a 4 core cpu as it starves the GPU units I run


I have the following XML in the Rosetta directory. The following should limit minirosetta jobs to a maximum of 3.

<app_config>
<app> <name> minirosetta </name> <max_concurrent> 3 </max_concurrent> </app>
</app_config>


Here is the path of the directory on my Windows machine:
C:ProgramDataBOINCprojectsboinc.bakerlab.org_rosetta


Some project have multiple named tasks and you would need 1 line for each one. If you misspell the task name, the project will display the list of valid name in the MESSAGE log.


Or you could just restrict your CPU usage to 75% on a logical 4 core processor.
ID: 78812 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
rjs5

Send message
Joined: 22 Nov 10
Posts: 273
Credit: 22,246,595
RAC: 13,325
Message 78813 - Posted: 17 Sep 2015, 22:14:58 UTC - in response to Message 78812.  

is there a way to run just 3 rosettas on a 4 core cpu as it starves the GPU units I run


I have the following XML in the Rosetta directory. The following should limit minirosetta jobs to a maximum of 3.

<app_config>
<app> <name> minirosetta </name> <max_concurrent> 3 </max_concurrent> </app>
</app_config>


Here is the path of the directory on my Windows machine:
C:ProgramDataBOINCprojectsboinc.bakerlab.org_rosetta


Some project have multiple named tasks and you would need 1 line for each one. If you misspell the task name, the project will display the list of valid name in the MESSAGE log.


Or you could just restrict your CPU usage to 75% on a logical 4 core processor.


I like your way better. I was thinking that the GPU job might be allocated a fraction of a CPU and the BOINC scheduler would idle another CPU ... leaving only 2 Rosetta CPU jobs running. The schedule makes my brain hurt.
ID: 78813 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile dcdc

Send message
Joined: 3 Nov 05
Posts: 1829
Credit: 118,231,691
RAC: 32,962
Message 78814 - Posted: 17 Sep 2015, 22:49:45 UTC

But isn't the xml method Rosetta only, whereas the BOINC setting will mean that if the GPU project is BOINC-based then it'll not use that core either...
ID: 78814 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jim1348

Send message
Joined: 19 Jan 06
Posts: 881
Credit: 52,257,545
RAC: 0
Message 78816 - Posted: 18 Sep 2015, 0:17:39 UTC - in response to Message 78814.  
Last modified: 18 Sep 2015, 0:18:44 UTC

But isn't the xml method Rosetta only, whereas the BOINC setting will mean that if the GPU project is BOINC-based then it'll not use that core either...

No, that setting is for the CPU projects only, but does not affect the GPU support. For example, I have my "use at most % of the CPUs" set at 50%, and it uses 4 (out of 8) CPU cores on the CPU projects (e.g. 2 on Rosetta and 2 on DENIS at the moment), while another core is free to support my GPU on POEM. So I have 5 cores total in use on BOINC projects.
ID: 78816 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
rjs5

Send message
Joined: 22 Nov 10
Posts: 273
Credit: 22,246,595
RAC: 13,325
Message 78827 - Posted: 19 Sep 2015, 16:08:06 UTC - in response to Message 78816.  

But isn't the xml method Rosetta only, whereas the BOINC setting will mean that if the GPU project is BOINC-based then it'll not use that core either...

No, that setting is for the CPU projects only, but does not affect the GPU support. For example, I have my "use at most % of the CPUs" set at 50%, and it uses 4 (out of 8) CPU cores on the CPU projects (e.g. 2 on Rosetta and 2 on DENIS at the moment), while another core is free to support my GPU on POEM. So I have 5 cores total in use on BOINC projects.



The BOINC scheduling algorithm makes my head hurt.
I use it to control the GPU jobs too.
My xml script was for only Rosetta but a script could be put into each of the project directories to control workload.

I also use the xml scripts to run multiple Seti@Home jobs in parallel on my NVIDIA GeForce GTX 970 because GPU-Z indicates that my GPU was only 40% loaded with 1 Seti task. MilkyWay will use 100% of the GPU no matter what GPU you have. Runtimes can get pretty short.

My xml suggestion answers his specific question about Rosetta but did not raise the "unasked" questions about tweaking the scheduling for other projects.

I tend to use the xml scripts to throttle particular projects to allow for more than one to make progress because I am constantly meddling.

My Seti script .... I left the 4 lines in to show how I "think" it works ... I ran 3 jobs for awhile but the average elapsed time per job did not change much beyond the 2 concurrent job setting so I left it at 2.

<app_config>

<app> <name>setiathome_v7 </name> <max_concurrent> 1 </max_concurrent> <gpu_versions> <cpu_usage> 0.3 </cpu_usage> <gpu_usage> 1.0 </gpu_usage> </gpu_versions> </app>
<app> <name>setiathome_v7 </name> <max_concurrent> 4 </max_concurrent> <gpu_versions> <cpu_usage> 0.3 </cpu_usage> <gpu_usage> 0.25 </gpu_usage> </gpu_versions> </app>
<app> <name>setiathome_v7 </name> <max_concurrent> 3 </max_concurrent> <gpu_versions> <cpu_usage> 0.3 </cpu_usage> <gpu_usage> 0.33 </gpu_usage> </gpu_versions> </app>
<app> <name>setiathome_v7 </name> <max_concurrent> 2 </max_concurrent> <gpu_versions> <cpu_usage> 0.3 </cpu_usage> <gpu_usage> 0.5 </gpu_usage> </gpu_versions> </app>

</app_config
ID: 78827 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jim1348

Send message
Joined: 19 Jan 06
Posts: 881
Credit: 52,257,545
RAC: 0
Message 78828 - Posted: 19 Sep 2015, 21:18:02 UTC - in response to Message 78827.  

My xml suggestion answers his specific question about Rosetta but did not raise the "unasked" questions about tweaking the scheduling for other projects.

Yes, it is inconsistent at best. I use "app_config.xml" to require each of my GPUs to use a single CPU core when I am running BOINC projects on all 8 cores of my dedicated machines, to prevent GPU starvation. But it works differently on Cosmology, at least when running their new "boinc2docker" betas, than on ATLAS, for example.

I am still sorting it out. You pretty much have to try it out and see what works best for your particular combination of projects; there may be no setting that is correct for all cases.

ID: 78828 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Robby1959

Send message
Joined: 10 May 07
Posts: 38
Credit: 9,298,741
RAC: 0
Message 78830 - Posted: 20 Sep 2015, 5:25:29 UTC

thanks guys - I just found a validate error issure on one box I bet its from gpugrid sharing a cpu core . every GPU app is running like a rocket with its own core
ID: 78830 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Message boards : Number crunching : free up a core for GPU



©2024 University of Washington
https://www.bakerlab.org