Message boards : Number crunching : Rosetta Just swamp my computer
Author | Message |
---|---|
hangint3n Send message Joined: 23 Mar 20 Posts: 8 Credit: 1,958,078 RAC: 0 |
Rosetta just swamped the memory and swap of my computer, thus causing it to freeze up? I'm running a AMD64 Ryzen 5 1800X with 32Gb of ram. Anyone else run into this? === hangint3n |
Keith Myers Send message Joined: 29 Mar 20 Posts: 97 Credit: 332,619 RAC: 363 |
Rosetta just swamped the memory and swap of my computer, thus causing it to freeze up? I'm running a AMD64 Ryzen 5 1800X with 32Gb of ram. Anyone else run into this? Rosetta has dodgy tasks quite often. I just ran into one that grabbed all available memory and swap every ten minutes and thus freezing the computer for a minute until the task released the memory. Well it was this Rosetta task kp8RjDVk_fold_and_dock_SAVE_ALL_OUT_1009390_201. It is grabbing all the memory and the swap file every five minutes or so. |
hangint3n Send message Joined: 23 Mar 20 Posts: 8 Credit: 1,958,078 RAC: 0 |
Rosetta just swamped the memory and swap of my computer, thus causing it to freeze up? I'm running a AMD64 Ryzen 5 1800X with 32Gb of ram. Anyone else run into this? So if I do nothing it will release the memory? How long does this take? I'm using a Linux OS not Windows. |
Keith Myers Send message Joined: 29 Mar 20 Posts: 97 Credit: 332,619 RAC: 363 |
Rosetta just swamped the memory and swap of my computer, thus causing it to freeze up? I'm running a AMD64 Ryzen 5 1800X with 32Gb of ram. Anyone else run into this? It released the memory back to my static level after about a minute. Then ten minutes later it would repeat. Someone replied a similar post had seen the same issue. So I decided the task was bad and aborted it. Using Ubuntu 20.04.1 OS. https://boinc.bakerlab.org/rosetta/forum_thread.php?id=12554&postid=98814 |
Keith Myers Send message Joined: 29 Mar 20 Posts: 97 Credit: 332,619 RAC: 363 |
Well I just decided to stop Rosetta. During these wild memory excursions that stole all my memory and froze my system for a minute, I discovered that the GPUGrid tasks that were running at the same time errored out. And the error message matched what I had been seeing on the very rare occasion when a GPUGrid task failed. So cause and effect indicates that the Rosetta tasks running were the culprit. So have set NNT on Rosetta and will run without them for a while and see if I stop getting those random errors. |
MarkJ Send message Joined: 28 Mar 20 Posts: 72 Credit: 25,238,680 RAC: 0 |
Rosetta just swamped the memory and swap of my computer, thus causing it to freeze up? I'm running a AMD64 Ryzen 5 1800X with 32Gb of ram. Anyone else run into this? I spotted a bunch that said waiting for memory. When I checked the other tasks running's properties one said it was using 43GB. I have a few that have crashed as well. Machine hasn't yet. This is on a Ryzen 3900X with 64GB. Swap is up to about 1/3rd so its using that as well. In your BOINC settings check what you have in your memory settings for "in use" and "when not in use". Default values are 60% and 90%. I wouldn't suggest going over 90%. The tasks were named fold_and_dock. I've aborted all of them and allowed the other tasks to run. BOINC blog |
Keith Myers Send message Joined: 29 Mar 20 Posts: 97 Credit: 332,619 RAC: 363 |
In your BOINC settings check what you have in your memory settings for "in use" and "when not in use". Default values are 60% and 90%. I wouldn't suggest going over 90%. I have use 94% of the cpus and 90% of the memory when not in use. 85% when in use. 32 cores and 32GB of memory. Since everyone is getting all these buggy tasks, I simply will not run Rosetta until it all gets sorted out. Then might come back or not. Plenty of work available for my other projects. TN-Grid and GPUGrid are doing Covid-19 or precursor work equivalent to what Rosetta does. |
MichaelD Send message Joined: 16 Dec 18 Posts: 1 Credit: 5,411,289 RAC: 0 |
Yes, I'm seeing this issue too in the last couple of days. Some Rosetta WUs are very large in size? I have a number of tasks where the task properties say the 'working set size' is upto 39.76GB of memory (not disk) to run. So smaller PC systems would probably still download the WU and never run. Not that I'm having any issues crunching this (with my 64GB system) but not as many WUs can run in parallel, and I did find that I had to re-tune my preferences since it consumed most of the working memory and the OS became unstable. Regs, Michael |
hangint3n Send message Joined: 23 Mar 20 Posts: 8 Credit: 1,958,078 RAC: 0 |
What I find annoying is that even though I've got limits set in my options settings. Rosetta still uses all my memory. If this continues to be the case I'll have to stop participating in the project. I can't have my desktop compromised and then having to hard reboot my system. |
dduggan47 Send message Joined: 18 Sep 05 Posts: 12 Credit: 4,129,224 RAC: 8,680 |
I can't cope with the memory problem either. Before I was sure what the culprit was my machine twice totally locked up for several minutes and I had to cold boot. I'll check back at some point but NNT for now. Sigh. |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1679 Credit: 17,818,615 RAC: 22,741 |
I can't cope with the memory problem either. Before I was sure what the culprit was my machine twice totally locked up for several minutes and I had to cold boot. I'll check back at some point but NNT for now. Sigh.Most of those Tasks are long gone & very few (if any) are being re-issued. It's just your large cache that has resulted in it occurring now. Grant Darwin NT |
Dave Send message Joined: 15 Mar 20 Posts: 3 Credit: 2,610,174 RAC: 0 |
yes |
James C. Owens Send message Joined: 7 Apr 18 Posts: 3 Credit: 25,018,390 RAC: 15,955 |
Seeing the same thing happen again now on three different Windows hosts. I set up a memory cgroup (systemd slice essentially) a while back on my main Linux box to enforce memory limits. This is not good. The rosetta applications should enforce the memory limits and not present memory leaks that go over the set limits in BOINC. |
Message boards :
Number crunching :
Rosetta Just swamp my computer
©2024 University of Washington
https://www.bakerlab.org