Message boards : Number crunching : New kind of app on Ralph
Previous · 1 · 2 · 3 · 4
Author | Message |
---|---|
eiernacken1983 Send message Joined: 30 May 19 Posts: 5 Credit: 34,992,832 RAC: 11 |
I already had an app_config for setting a general task limit for Rosetta with <project_max_concurrent>.... Adding the limitation for the python tasks obviously confused the BOINC manager. It started requesting (and getting) a lot of additional tasks. The amount of tasks being ready for execution now easily exceeds my limit of 0.4 days. Did it on two out of three machines. Those two machines were flooded with new tasks. The third machine hasn't VM installed, so there was no need for changing app_config an it didn't get too much tasks. |
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
Actually, I would set up a machine that did only the Pythons if they allowed me to select. And it would have enough memory to do the job. But as it is, a lot of them probably fail. There appear to be some resends going out, but not much more. |
[VENETO] boboviz Send message Joined: 1 Dec 05 Posts: 1994 Credit: 9,598,427 RAC: 8,864 |
My Threadripper is running some Rosetta python projects 1.02 (vbox 64): That's strange. I've crunched about ten python wus, with almost the correct runtime (4 hs "standard" wus, 6 hs python wus). |
eiernacken1983 Send message Joined: 30 May 19 Posts: 5 Credit: 34,992,832 RAC: 11 |
I had succesfull python tasks too running about 6 - 8 hours (target runtime 8 h). Now the first 2day+ tasks have exceeded their deadline. Running only 3 of them concurrently for the last 3 hours didn't speed them up. I aborted one of them. Here is the result: https://boinc.bakerlab.org/rosetta/result.php?resultid=1388271825 |
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
Running only 3 of them concurrently for the last 3 hours didn't speed them up.Did you reboot after reducing the number? If you have "leave application in memory" enabled, the old ones could still be taking up memory space. |
biodoc Send message Joined: 19 Feb 06 Posts: 14 Credit: 30,717,792 RAC: 0 |
I wonder if the the "rosetta python projects" app is an implementation of PyRosetta for boinc. |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1679 Credit: 17,806,826 RAC: 22,676 |
I had succesfull python tasks too running about 6 - 8 hours (target runtime 8 h). Now the first 2day+ tasks have exceeded their deadline. Running only 3 of them concurrently for the last 3 hours didn't speed them up.Looks like there was a problem with that Task Run time 2 days 14 hours 37 min 23 sec CPU time 6 min 20 secThe CPU wasn't actually doing any processing of the Task. This is from one you completed & Validated without issue. Run time 4 hours 11 min 46 sec CPU time 4 hours 11 min 39 sec Grant Darwin NT |
[VENETO] boboviz Send message Joined: 1 Dec 05 Posts: 1994 Credit: 9,598,427 RAC: 8,864 |
I wonder if the the "rosetta python projects" app is an implementation of PyRosetta for boinc. Old post (April 2020) from Rosetta admins: We have a version of TrRosetta (a model much like the published version but also including PDB templates) that has been benchmarked and continues to be benchmarked on CAMEO as a hidden server. It undoubtedly performs better than the current prediction method used by Robetta for medium to hard targets, which is (Robetta) consistently the best performing server among public servers. We plan to add the latest protocols that will be tested in this coming CASP to Robetta in the near future and open it up to the public. This will not only improve the prediction quality for most targets, but will also significantly reduce the cpu computing requirements. We also are looking into the possibility of running these ML models and minimization modeling strategies to R@h which will make use of GPUs. This may require the ability to run python, Tensor Flow, and PyRosetta on BOINC clients. |
mmonnin Send message Joined: 2 Jun 16 Posts: 58 Credit: 23,734,892 RAC: 48,568 |
... as well as being able to run more than once at a time. If the PC has memory.But have you seen more than one running at a time? For the 3rd time. YES. This is possible. I have seen it with my own eyes on my own PC. 64gb of memory on that PC and usage was not even 50%. |
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
For the 3rd time. YES. This is possible. I have seen it with my own eyes on my own PC. 64gb of memory on that PC and usage was not even 50%. You haven't been reading my posts. I had a discussion of it. And you probably did not see the part about "leave application in memory". Who knows what state you are in. |
Falconet Send message Joined: 9 Mar 09 Posts: 353 Credit: 1,227,479 RAC: 1,506 |
First official info on TrRosetta at Rosetta@home: https://twitter.com/RosettaAtHome/status/1403057126541447170 |
Billy Send message Joined: 29 May 06 Posts: 13 Credit: 1,536,368 RAC: 0 |
On my old iMac, I had 2 of these running at once with 2 regular Rosetta tasks. These new ones take up a lot of memory. As long as I was away for the day and the computer wasn't touched, they ran to completion. I had 2 others running at the same time and when I started to look at videos and do my email they sort of choked on the memory constraints and stopped themselves with an error message on Boinc Manager. When I shut everything off and restarted the computer to get them going again, they appeared to attempt to restart but failed. I don't remember now what happened after that. |
[VENETO] boboviz Send message Joined: 1 Dec 05 Posts: 1994 Credit: 9,598,427 RAC: 8,864 |
Yesterday they released the 0.21 version of Python app |
dcdc Send message Joined: 3 Nov 05 Posts: 1831 Credit: 119,591,196 RAC: 10,281 |
First official info on TrRosetta at Rosetta@home: https://twitter.com/RosettaAtHome/status/1403057126541447170 This needs posting in "News"! I should get a chance to do that later today. Does anyone know if there's a way to see which of your computers have Virtualbox installed without checking each one manually? |
[VENETO] boboviz Send message Joined: 1 Dec 05 Posts: 1994 Credit: 9,598,427 RAC: 8,864 |
I'm testing some 0.21 on Ralph and there is a problem Can admins read this thread and say what i have to do? |
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
Can admins read this thread and say what i have to do? Try this one: https://boinc.bakerlab.org/rosetta/forum_thread.php?id=1000 |
[VENETO] boboviz Send message Joined: 1 Dec 05 Posts: 1994 Credit: 9,598,427 RAC: 8,864 |
Try this one:https://boinc.bakerlab.org/rosetta/forum_thread.php?id=1000 Thank you. But I posted this message on other Ralph thread, before reading your suggestion: Some tests: |
Message boards :
Number crunching :
New kind of app on Ralph
©2024 University of Washington
https://www.bakerlab.org