Message boards : Number crunching : New kind of app on Ralph
Previous · 1 · 2 · 3 · 4 · Next
Author | Message |
---|---|
[VENETO] boboviz Send message Joined: 1 Dec 05 Posts: 1994 Credit: 9,551,716 RAC: 6,403 |
I would suggest posting about these issues in the Ralph forums. No sense. - ralph forum is a desert (i think admins don't read both the project forums) - different numbers of app (1.02 here and 0.20 on Ralph). Is the same app? We don't know - 1.02 is in production and not in beta on Ralph. So we post here bugs |
mmonnin Send message Joined: 2 Jun 16 Posts: 58 Credit: 23,383,187 RAC: 23,498 |
Apparently, when i got one and another one is in waiting the CPU crunches one of the pythons ones and nothing else. You're out of memory. 7.6GB required per task. |
[VENETO] boboviz Send message Joined: 1 Dec 05 Posts: 1994 Credit: 9,551,716 RAC: 6,403 |
You're out of memory. 7.6GB required per task. Uh, i'll need other ram modules! |
Daedalus Send message Joined: 1 Aug 08 Posts: 39 Credit: 10,103,850 RAC: 425 |
Apparently, when i got one and another one is in waiting the CPU crunches one of the pythons ones and nothing else. When i have one of these python jobs i can force rosetta to crunch classical WU's by cancelling all the pythons in the queue. Anyway it doesn't finish them all. I get a unmanageable VM message after several hours of my electricity wasted so i killed the tasks. Edit: the funny thing is i don't get -of course- those python VM jobs on another machine which has no virtualbox installed. So a radical solution to this problem could be to uninstall virtualbox. I won't.I use it. |
Sid Celery Send message Joined: 11 Feb 08 Posts: 2121 Credit: 41,179,074 RAC: 11,480 |
I downloaded other 5 python wsus. Peak working set size 3,058.41 MB Peak swap size 4,704.56 MB Peak disk usage 9,051.43 MB No complaints about resource demands if they turn out to require this much to run... |
biodoc Send message Joined: 19 Feb 06 Posts: 14 Credit: 30,717,792 RAC: 0 |
Apparently, when i got one and another one is in waiting the CPU crunches one of the pythons ones and nothing else. An alternative to uninstalling VBOX is to add this line to the "options" section of your cc_config.xml file and then restart the boinc client. <dont_use_vbox>1</dont_use_vbox> |
Daedalus Send message Joined: 1 Aug 08 Posts: 39 Credit: 10,103,850 RAC: 425 |
Thank you a lot ! Will do. |
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
Peak disk usage: 9,559.60 MB on good Rosetta task. Good grief. And we can't select. I think my 32 core Ryzen 3950X's (two of them) will need to find other things to do. Their habit of ignoring their crunchers will be reciprocated very shortly. |
[VENETO] boboviz Send message Joined: 1 Dec 05 Posts: 1994 Credit: 9,551,716 RAC: 6,403 |
When i have one of these python jobs i can force rosetta to crunch classical WU's by cancelling all the pythons in the queue. Anyway it doesn't finish them all. I get a unmanageable VM message after several hours of my electricity wasted so i killed the tasks. This is why is a good idea to permit the choose of apps on user's profile. |
marmot Send message Joined: 10 Nov 15 Posts: 17 Credit: 2,454,767 RAC: 492 |
And we can't select. I see this complaint often and I share it. It's not hard to give us the ability to choose app/WU types. |
[VENETO] boboviz Send message Joined: 1 Dec 05 Posts: 1994 Credit: 9,551,716 RAC: 6,403 |
Peak disk usage: 9,559.60 MB on good Rosetta task. A couple of 4Tb SSD and the problem is solved :-P Despite the joke, this is a new page (maybe important) in Rosetta scientific research, but it's a pity that volunteers are ignored |
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
I have taken a preemptive strike, and will run half the cores of my Ryzen 3950X's on WCG (mostly MCM). They don't take much memory or disk space. Maybe I can still devote half the cores to Rosetta, but if they don't give us any choice on how many to run, I have to plan for the worst case. It would be nice if they allowed us to set the maximum number of Python's that we could run. That would make it more manageable. By the way, I am running my first 1.02 Rosetta Python now, and BoincTasks is showing that it is using 7.6 GB of memory. So disk space is not the only thing we need to worry about. I agree that it may be a great project, but their customer relations are dismal, or non-existent to be more accurate. How do they expect them to be crunched, anyway? |
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
By the way, I am running my first 1.02 Rosetta Python now, and BoincTasks is showing that it is using 7.6 GB of memory. It completed successfully, but errored out on another machine that had only 8 GB. I think this will be a learning experience. https://boinc.bakerlab.org/rosetta/result.php?resultid=1388548962 But maybe they will send you only one at a time? Even one will catch some people by surprise. Some control at our end would be better. |
Daedalus Send message Joined: 1 Aug 08 Posts: 39 Credit: 10,103,850 RAC: 425 |
I haven't changed my cc_config.xml yet but i don't receive python tasks anymore. |
mmonnin Send message Joined: 2 Jun 16 Posts: 58 Credit: 23,383,187 RAC: 23,498 |
By the way, I am running my first 1.02 Rosetta Python now, and BoincTasks is showing that it is using 7.6 GB of memory. I already mentioned the memory and disk space requirements as well as being able to run more than once at a time. If the PC has memory. |
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
... as well as being able to run more than once at a time. If the PC has memory.But have you seen more than one running at a time? |
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
Never mind. Looking through my logs, I see I was running four at a time, which completed on 31 May, and then nothing more until the next day. They ran from about 4 hours 50 minutes to 5 hours 45 minutes. Maybe more would have downloaded if I had more memory. (I have 48 GB on that machine). |
eiernacken1983 Send message Joined: 30 May 19 Posts: 5 Credit: 34,992,832 RAC: 13 |
My Threadripper is running some Rosetta python projects 1.02 (vbox 64): The work units are now running for 2 days and 6 hours. Progress is 99.8 %, and further progress is advancing extremely slow. Is there any chance of getting them done succesfully. Deadline is getting closer (7 hours left)... |
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
The work units are now running for 2 days and 6 hours. Progress is 99.8 %, and further progress is advancing extremely slow. It looks like you have 20 of them downloaded. Depending on how many are trying to run at one time, you may be running into cache limitations, or even worse swapping out memory to disk. I would limit the number running to maybe four or so until you work out how many you can run at once. I am limiting mine to two using an app_config.xml file placed in the project folder. Create it with Wordpad, and save as an ".xml" file, then restart BOINC to activate: <app_config> <app> <name>rosetta_python_projects</name> <max_concurrent>2</max_concurrent> </app> </app_config> |
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
Create it with Wordpad, and save as an ".xml" file, then restart BOINC to activate: Or you can use any text editor in Linux. Notepad would probably be simpler in Windows, just use the "save as" function to save it as an ".xml" file. |
Message boards :
Number crunching :
New kind of app on Ralph
©2024 University of Washington
https://www.bakerlab.org