Posts by mikey

21) Message boards : Number crunching : problem with app_config.xml (Message 103130)
Posted 8 Nov 2021 by mikey
Post:
When i put this in app config i still sometimes get rosetta tasks instead of rosetta_python_projects
<app_config>
<app>
        <name>rosetta</name>
            <max_concurrent>0</max_concurrent>
		   
    </app>
	<app>
        <name>rosetta_python_projects</name>
            <max_concurrent>1</max_concurrent>



		   
    </app>
	</app_config>


The option of what tasks to send to someone is SOLELY on the Project side and BEFORE the Boinc Manager gets involved in reading any app_config files, it's solely on on the Boinc Manager saying 'hey I need some new tasks' and the Project saying 'okay here you go'. What the app config does is say 'run these tasks not those tasks'.

Fortunately Rosetta does not punish us for aborting the tasks we don't want to run so feel free to abort all the regular tasks and keep trying to get the Python tasks you do want.
22) Message boards : Number crunching : Not getting any python work (Message 103103)
Posted 4 Nov 2021 by mikey
Post:
One last thought for Win10. If you have ever enabled "Hyper-V", be sure to disable it (in "Turn Windows features on or off").
It is incompatible with VirtualBox.



For me, I Hyper V is not on. Never has been.
There is no way I am wiping out my OS to get some stubborn tasks.
There has to be something else holding up Python tasks.
Something that can be done without wiping out windows and spending hours reinstalling and re configuring.


How much of your cpu are you allowing it to use, in both number of cores and percentage of actual cpu usage, ie I allow 50% of the cores and 90% of cpu time?

Also what other projects are you running and what is their resource percentages? I'm thinking maybe your cache is already full.

Also what is your cache size, ie mine is 2.5 days and 1.5 days? I'm thinking if yours is set to say 0.01 for both maybe Rosetta thinks you don't have enough cache time to get tasks.


It can use as much as it wants. Right now it is using 15/16 cores 100% run (restricted 1 core for system and GPU support). GPU's are running Einstein and FAH.
With this all running it is using only 66% of the memory.
Cache is run 1 full day and store .25 days. - and this should not matter.
As stated elsewhere, I run around 16 hrs a day, no app_config scripts or anything else.
No deadlines have passed, all work has been returned in time.


Try suspending all your other Projects, except the gpu ones, and then request work from Rosetta. I'm still thinking your cache is sooo full Boinc doesn't think you will finish a task in time with a 3 day deadline. Boinc is fricking weird sometimes and has to be manhandled to do what we want it to do.

On your list it says:
11/1/2021 8:47:09 PM | Rosetta@home | [rr_sim] Result degrader_site_5fnu_3h_graft_bcov_1_SAVE_ALL_OUT_IGNORE_THE_REST_1vo2xp9r_1803973_2_0 projected to miss deadline.

Which is what i just said you have too much work from other Projects for Rosetta to send you any tasks.


Maybe I did not include it, but it did complete in time. A couple of minutes later.
I'm not doing anything different in cache, BOINC knows how long it takes to complete stuff, its been crunching this version of a task since it first came out. I didn't change anything to the plus or minus since I got my first Python work. So it has to be something else. Besides, if BOINC thinks the work will not complete in time, then why is it downloading so much work to begin with? It is a 'manager' program so it should manage.

Note: I just opened up BOINC Tasks and had a look. Degrader and the other stuff from here are running high priority, but.....the deadline is 2 days away and for the stuff that just started it will be done in say 12+ hrs (because of the run 4 hrs and switch tasks option)
Other tasks are near completion and they have a remaining time of maximum 4 hrs.


That's exactly why no Rosetta tasks are coming thru too much work from other Projects, Boinc is running in panic mode, ie High Priority, because it THINKS it won't be able to finish the tasks in time otherwise.
23) Message boards : Number crunching : Not getting any python work (Message 103093)
Posted 2 Nov 2021 by mikey
Post:
One last thought for Win10. If you have ever enabled "Hyper-V", be sure to disable it (in "Turn Windows features on or off").
It is incompatible with VirtualBox.



For me, I Hyper V is not on. Never has been.
There is no way I am wiping out my OS to get some stubborn tasks.
There has to be something else holding up Python tasks.
Something that can be done without wiping out windows and spending hours reinstalling and re configuring.


How much of your cpu are you allowing it to use, in both number of cores and percentage of actual cpu usage, ie I allow 50% of the cores and 90% of cpu time?

Also what other projects are you running and what is their resource percentages? I'm thinking maybe your cache is already full.

Also what is your cache size, ie mine is 2.5 days and 1.5 days? I'm thinking if yours is set to say 0.01 for both maybe Rosetta thinks you don't have enough cache time to get tasks.


It can use as much as it wants. Right now it is using 15/16 cores 100% run (restricted 1 core for system and GPU support). GPU's are running Einstein and FAH.
With this all running it is using only 66% of the memory.
Cache is run 1 full day and store .25 days. - and this should not matter.
As stated elsewhere, I run around 16 hrs a day, no app_config scripts or anything else.
No deadlines have passed, all work has been returned in time.


Try suspending all your other Projects, except the gpu ones, and then request work from Rosetta. I'm still thinking your cache is sooo full Boinc doesn't think you will finish a task in time with a 3 day deadline. Boinc is fricking weird sometimes and has to be manhandled to do what we want it to do.

On your list it says:
11/1/2021 8:47:09 PM | Rosetta@home | [rr_sim] Result degrader_site_5fnu_3h_graft_bcov_1_SAVE_ALL_OUT_IGNORE_THE_REST_1vo2xp9r_1803973_2_0 projected to miss deadline.

Which is what i just said you have too much work from other Projects for Rosetta to send you any tasks.
24) Message boards : Number crunching : Not getting any python work (Message 103092)
Posted 2 Nov 2021 by mikey
Post:


Also what is your cache size, ie mine is 2.5 days and 1.5 days? I'm thinking if yours is set to say 0.01 for both maybe Rosetta thinks you don't have enough cache time to get tasks.


I have my cache set to 0.1 and 0.1 but I still get CPDN tasks that take 10 days so it cannot be that.


CPDN tasks have a due date of 365 days while Rosetta tasks have a due date of 3 days from the day you get them.
25) Message boards : Number crunching : Windows 11 features (Message 103078)
Posted 1 Nov 2021 by mikey
Post:
4.20 is x86_64


Yeaph. I took a quick look at rosetta.exe (with IDA64) and seems to be 64 bit native, whitout wrapper.


I think there are still quite a few 32 bits os out there, but I'd think they are a minority.
Either way, old OS are likely unpatched and vulnerable to virus, malware, ransomware infection.
i think that old intel compute stick ran a 32 bit os, because its bios is 32 bits, it is one of those things that causes limitations to upgrades.


There are still Projects sending out tasks to only 32bit machines so they are still needed by some projects but yes most Projects have gone to only 64bit apps.
26) Message boards : Number crunching : Why does rosetta python requires 6.94gb for a vm image? (Message 103077)
Posted 1 Nov 2021 by mikey
Post:
Why does rosetta python requires 6.94gb for a vm image?


It's a programmer thing and we've asked that they reduce it, which they have somewhat, but it still seems way to big.
27) Message boards : Number crunching : Not getting any python work (Message 103076)
Posted 1 Nov 2021 by mikey
Post:
One last thought for Win10. If you have ever enabled "Hyper-V", be sure to disable it (in "Turn Windows features on or off").
It is incompatible with VirtualBox.



For me, I Hyper V is not on. Never has been.
There is no way I am wiping out my OS to get some stubborn tasks.
There has to be something else holding up Python tasks.
Something that can be done without wiping out windows and spending hours reinstalling and re configuring.


How much of your cpu are you allowing it to use, in both number of cores and percentage of actual cpu usage, ie I allow 50% of the cores and 90% of cpu time?

Also what other projects are you running and what is their resource percentages? I'm thinking maybe your cache is already full.

Also what is your cache size, ie mine is 2.5 days and 1.5 days? I'm thinking if yours is set to say 0.01 for both maybe Rosetta thinks you don't have enough cache time to get tasks.
28) Message boards : Number crunching : Friend (Message 103042)
Posted 28 Oct 2021 by mikey
Post:
I am, by nature and experience, somewhat dubious of forum friend requests. Is it possible to unfriend an individual?


I don't have any friend here so checked at Collatz and saw this:

This person is a friend Cancel friendship

the "Cancel friendship" was a link to cancel the friendship. It's under your home page
29) Message boards : News : Outage notice (Message 103041)
Posted 28 Oct 2021 by mikey
Post:
Mikey, still nothing on my system:

CPU type AuthenticAMD
AMD Ryzen 7 3700X 8-Core Processor [Family 23 Model 113 Stepping 0]
Number of processors 16
Coprocessors [2] NVIDIA NVIDIA GeForce GTX 1080 (4095MB) driver: 472.12 OpenCL: 3.0
Operating System Microsoft Windows 10
Professional x64 Edition, (10.00.19043.00)
BOINC version 7.16.20
Memory 24501.59 MB
Cache 512 KB


They have 40 TIMES as many regular tasks as Python tasks in progress, keep aborting the regular ones and the Python ones will eventually come thru. I have Rosetta set at a resource share of 1 out of 100 and got sooo many Python units I couldn't finish them all before the deadline by keeping aborting the regular tasks. Be aware each units takes the same 8gb minimum free ram to even get, so what I did was set my running projects to no new tasks or suspended if they were more than about 30 minutes, that way the only Project fighting for tasks was Rosetta and after a couple retires they started flowing. I then resumed the other Projects but set them to run 1 less task than the amount I allow for Boinc and set Rosetta to only run 1 task at a time on my 16gb machine. I have now upgraded that machine to 64gb so will try again in a couple days once I reach a goal at WCG.
30) Message boards : Number crunching : Tells us your thoughts on granting credit for large protein, long-running tasks (Message 103026)
Posted 27 Oct 2021 by mikey
Post:
Intel's next generation of CPUs actually looks like it might be not just competitive against AMDs current offerings, but possibly even better.


(Jim 1348 said)
We can hope so, but they have some sort of high speed/low speed combination of processors.
That might work for ordinary use, but how about BOINC projects? I don't feel at all comfortable about it until I see some tests.


Some early tests for you for the 'Intel Core i5-12600K CPU Up To 50% Faster Than Ryzen 5 5600X'

https://wccftech.com/intel-core-i5-12600k-cpu-faster-than-ryzen-5-5600x-blows-away-rocket-lake-core-i9-11900k-leaked-benchmarks/
31) Message boards : News : Outage notice (Message 103024)
Posted 26 Oct 2021 by mikey
Post:
I found that R@H can overload the computer
The solution to solve the technical problem is to go in the boinc manager and tu réduce the number of used processors to around 70% or 65% to work easy

Guy




I'm guessing you got the Python work units. Those use a lot of RAM.


DING DING DING we have a winner...he is running Python units and their system is:

CPU type GenuineIntel
Intel(R) Core(TM) i7-9700F CPU @ 3.00GHz [Family 6 Model 158 Stepping 13]
Number of processors 8
Coprocessors NVIDIA NVIDIA GeForce RTX 2060 (4095MB) driver: 471.96 OpenCL: 3.0
Operating System Microsoft Windows 10
Core x64 Edition, (10.00.19043.00)
BOINC version 7.16.11
Memory 16257.86 MB

They need to use a simple app_config.xml file to limit the number of tasks that can run at one time AND reduce the cache size so they don't get too many units.

<app_config>
<project_max_concurrent>1</project_max_concurrent>
</app_config>
32) Message boards : Number crunching : New Docker image with Virtualbox and Nvidia GPU passthrough support (Message 103004)
Posted 22 Oct 2021 by mikey
Post:

FAH barely uses my 1050 and 1070. But I have yet to find a good science GPU project.
I might just have to reattach to primegrid or something to get things going.


Try Einstein they have both "Gravitational Wave search O3 All-Sky" and "Gamma-ray pulsar binary search #1 (GPU)" tasks right now
with the 2nd one giving 3 times the credit of the 1st one.


I see what the problem is...a certain power supply software that I was looking at for temp monitoring and some other things is way off on its values. I had a look at MSI afterburner and its showing 98% usage which makes sense because my temps are high enough and I can hear my fans blowing.


Yup that does make sense
33) Message boards : Number crunching : New Docker image with Virtualbox and Nvidia GPU passthrough support (Message 102996)
Posted 21 Oct 2021 by mikey
Post:

FAH barely uses my 1050 and 1070. But I have yet to find a good science GPU project.
I might just have to reattach to primegrid or something to get things going.


Try Einstein they have both "Gravitational Wave search O3 All-Sky" and "Gamma-ray pulsar binary search #1 (GPU)" tasks right now
with the 2nd one giving 3 times the credit of the 1st one.
34) Message boards : Number crunching : Ways to opt out from Python projects (Message 102989)
Posted 20 Oct 2021 by mikey
Post:
Mikey, that's the whole thing....when Python first started I got a bunch. Then something went wrong and I stopped getting them. I am trying to isolate 4.2 but I can't get that to happen. I aborted 21 4.2 tasks and the server didn't blink.

Are you sure that you have re-enabled VirtualBox? The only time I don't get the pythons is on the machines where it is not installed. Otherwise, you should get a regular supply, though that is not to say that it is constant. It varies.



Jim, I run LHC ATLAS it requires Vbox.
I cleared out some old remains in there that looked to be Python.
(This was in 6.12.7 version)

I just installed 6.12.8 and related extension pack.
See if that makes any difference, but it will be tonight (EU time) before I see any results if at all due to the queue of 4.2 tasks needing to be run.


What version of VBox are you running? I'm running Version 6.1.26 r145957 (Qt5.6.2) on my Windows 11 Home laptop. I know in the past Rosetta has had issues with people running a version that is too new or too old.
35) Message boards : Number crunching : New Docker image with Virtualbox and Nvidia GPU passthrough support (Message 102988)
Posted 20 Oct 2021 by mikey
Post:
The paper is quoting a run time of a $880 GPU. 90 minutes. So put that down on our level....at least double if not triple that time.

So, what's the problem? I'm crunching Folding@Home on my entry-level gpu with wus longer than 24hs.
And, in the Boinc's world, there are a lot of people with high-end gpus


GPU has been asked for over and over again and the response is the same or ignored.

That's for sure

P.S.
Don't forget that a gpu client will attract a lot of volunteers.


Not if a task tasks 3 or 4 days to run it though, yes most of us run tasks non stop but our gpu's do get a slight break between tasks even if we are running multiple tasks at once, but running the same task nonstop for 3 or 4 days could burn out a gpu if the settings aren't right.
36) Message boards : Number crunching : Ways to opt out from Python projects (Message 102976)
Posted 17 Oct 2021 by mikey
Post:
Hello,

I was a little bit delighted, when Rosetta started to use VirtualBox in some projects. Many other project are using it for a while.

But also many users not want to use projects with VirtualBox, they slow down computer, it is not possible to adjust CPU temperature with TThrottle etc.

So I was delighted, when I was not able to find any selection in Rosetta preferences to disable projects with VirtualBox. Here is no way to choose Rosetta applications, which I want to run.

I don't want to opt out from Rosetta, so I tried to search some workarounds.

1. It is possible to uninstall VirtualBox form PC. But I need it to some other BOINC projects and for other activities.
2. It is possible to disable VirtualBox in BOINC. I created cc_config.xml file in BOINC data directory with:
<cc_config>
<options>
<dont_use_vbox>1</dont_use_vbox>
</options>
</cc_config>

But this way also not solved my problem. It is not possible to use VirtualBox for other projects.
3. It is possible to reduce count of tasks running in one time. I created app_config.xml in BOINC data / Rosetta data directory with:
<app_config>
<app>
<name>rosetta_python_projects</name>
<max_concurrent>1</max_concurrent>
</app>
</app_config>
.
Now I am running 7 normal BOINC tasks and 1 with VirtualBox in one time. It is small problem with queue of VirtualBox tasks, but it is best way which I found.

Maybe You have more suggestions?

Thank You.



There is one flaw in your idea.
Like for me, I use VM for LHC ATLAS, so what if I want to keep that running, but want to block Python?
That is the one thing I am unable to find, how to block a specific task set.
With the MD5 hash problem, a person kept getting python, but no one has figured out how to block Python and keep 4.20 tasks running.


Can you just change the number above from 1 to a zero in max_concurrent?

As for me though I'm the other way around I want Rosetta to ONLY send me Python tasks and NO 4.20 regular tasks. I'm wondering if adding another set of lines to the above app_config file will let me do that?


You might be on to something there..change the python to 4.2.
I am looking to do the same thing.
Someone in another thread said abort the 4.2 and the server should catch on.
21 tasks over 24hrs and nothing changed. So maybe the app_config would change that.


Your app_config.xml file refers to an unknown application 'rosetta_python_projects'. Known applications: 'rosetta'


so no
plus from LHC a few years ago: BOINC doesn't allow to include or exclude subprojects via app_config.xml.
This can only be done via the preferences on the project website.

And since there is no application preferences we have no control of which apps we can run or not run. You can only limit the number of concurrent tasks or cpu cores (don't try this).


This part "Your app_config.xml file refers to an unknown application 'rosetta_python_projects'. Known applications: 'rosetta'" just means you haven't gotten any Python tasks yet, once you get some you should stop getting that message.
37) Message boards : Number crunching : 1.03 (vbox64) is out for rosetta python projects (Message 102952)
Posted 14 Oct 2021 by mikey
Post:
But there aren't any on two Ryzen 3950X with 48 GB of memory (with 32 virtual cores).

I now have four pythons on one of the 3950X and five on the other, in the buffer.
So I have enough memory for them to download. Maybe they limit how many run at a time, or at least BOINC does I hope.


I have an AMD Ryzen 7 4800 series cpu with 8/16 cores and 16gb of ram and Rosetta tried to run 8 Pyton units at one time, I have Boinc set to only use 50% of the cpu's. Of course everything slowed to a crawl so I made it so Rosetta only runs 1 task at a time and things are working but the 6 hour time estimate to run the tasks is not even close as I'm seeing closer to 24 hours to finish a task. BUT the Rosetta website says I'm only using 8k to 16k seconds to run a task so something is still not right.
38) Message boards : Number crunching : Windows 11 features (Message 102951)
Posted 14 Oct 2021 by mikey
Post:
Benchmarked: Do Windows 11’s Security Features Really Hobble Gaming Performance? Yes, if Virualization Based Security (VBS) is enabled.

The fix: How to Disable VBS and Speed Up Windows 11


My Windows 11 version is an update from Windows 10 Home and VBS is turned off, so yes what you are saying is true.
39) Message boards : Number crunching : Lots of computer time, little credit (Message 102949)
Posted 14 Oct 2021 by mikey
Post:
Greg_BE wrote
I know FAH is separate, but I included it in the mix so you see what all is running.
I use the term "Boinc" loosely to describe the whole thing.
I reduced Boinc usage to 14 cores(90%). This should leave 1 core FAH and 1 core GPU control. I was 95% for 15 cores.

I still see 100% commit in processes (looking users tab 99.8 to a low of 96.1)
Performance shows the processor speed gained a little. Now running 3.98 to 4.02
Processes shows "Boinc" at 86% max
FAH seems steady at the moment. Now 7-8.2%
Vbox just showed up, which is LHC running, that is 4.8% max.

Probably better for the life of the chip in this configuration.


The problem is Boinc, and most other computer applications, run at 100% for as many clock cycles as they are allocated, so yes Boinc runs at 100% for ie 9 clock cycles but then it backs off for ie 1 clock cycle and then runs at 100% again for ie 9 clock cycles and keeps repeating this process until it's either changed or stopped. Those numbers are based on a 10 count clock cycle and Boinc could be using a 100 count clock cycle or even a 1000 count clock cycle but you get the idea. The result is that in the overall average Boinc does 90%, based on your setting, but at times will still be running at 100%.

As for not using all 16 cpu cores at 100% 100% of the time yes I do that too to prolong the life of my parts, now if I had millions or billions of dollars, euros, whatevers to throw at the pc's then yes I would run them all at 100% and just replace the parts when they break, but my budget doesn't allow me to do that.
40) Message boards : Number crunching : Ways to opt out from Python projects (Message 102946)
Posted 13 Oct 2021 by mikey
Post:
Hello,

I was a little bit delighted, when Rosetta started to use VirtualBox in some projects. Many other project are using it for a while.

But also many users not want to use projects with VirtualBox, they slow down computer, it is not possible to adjust CPU temperature with TThrottle etc.

So I was delighted, when I was not able to find any selection in Rosetta preferences to disable projects with VirtualBox. Here is no way to choose Rosetta applications, which I want to run.

I don't want to opt out from Rosetta, so I tried to search some workarounds.

1. It is possible to uninstall VirtualBox form PC. But I need it to some other BOINC projects and for other activities.
2. It is possible to disable VirtualBox in BOINC. I created cc_config.xml file in BOINC data directory with:
<cc_config>
<options>
<dont_use_vbox>1</dont_use_vbox>
</options>
</cc_config>

But this way also not solved my problem. It is not possible to use VirtualBox for other projects.
3. It is possible to reduce count of tasks running in one time. I created app_config.xml in BOINC data / Rosetta data directory with:
<app_config>
<app>
<name>rosetta_python_projects</name>
<max_concurrent>1</max_concurrent>
</app>
</app_config>
.
Now I am running 7 normal BOINC tasks and 1 with VirtualBox in one time. It is small problem with queue of VirtualBox tasks, but it is best way which I found.

Maybe You have more suggestions?

Thank You.



There is one flaw in your idea.
Like for me, I use VM for LHC ATLAS, so what if I want to keep that running, but want to block Python?
That is the one thing I am unable to find, how to block a specific task set.
With the MD5 hash problem, a person kept getting python, but no one has figured out how to block Python and keep 4.20 tasks running.


Can you just change the number above from 1 to a zero in max_concurrent?

As for me though I'm the other way around I want Rosetta to ONLY send me Python tasks and NO 4.20 regular tasks. I'm wondering if adding another set of lines to the above app_config file will let me do that?


Previous 20 · Next 20



©2024 University of Washington
https://www.bakerlab.org