Rosetta has busted Disk Quota by nearly 400%

Message boards : Number crunching : Rosetta has busted Disk Quota by nearly 400%

To post messages, you must log in.

AuthorMessage
Keith T.
Avatar

Send message
Joined: 1 Mar 07
Posts: 58
Credit: 34,135
RAC: 0
Message 94159 - Posted: 11 Apr 2020, 14:44:16 UTC

I am a returning user to Rosetta

I'm aware that some of the tasks can be both memory and storage intensive

On my Windows machine, I instructed BOINC to leave at least 1GB free, Use no more than 2.7GB

My current usage by BOINC projects is now 3.57GB, of which 3.54GB is Rosetta

Free, Not available to BOINC 306MB

Used by other programs 24.65GB

At one point free disk space was down to 200MB, this has recovered slightly since I suspended 1 of 3 Rosetta tasks.

So Rosetta has broken the 2.7GB limit by about 0.9GB, and the 1GB limit by about 700MB

Is this a Rosetta or BOINC problem ?
ID: 94159 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1681
Credit: 17,854,150
RAC: 20,118
Message 94180 - Posted: 11 Apr 2020, 22:02:21 UTC - in response to Message 94159.  
Last modified: 11 Apr 2020, 22:04:58 UTC

So Rosetta has broken the 2.7GB limit by about 0.9GB, and the 1GB limit by about 700MB
Is this a Rosetta or BOINC problem ?
BOINC sets the limits.
 Disk
                              Use no more than 20 GB
                                Leave at least 2 GB free
                              Use no more than 60 % of total
Could be some issue with the logic of the settings as the minimum of the 3 values should be the limiting one.

Rosetta Tasks can require up to 1GB of HDD space per Task. And several times i've had to increase the disk limits as Rosetta Tasks wouldn't run due to the disk limits i had then blocking them.
Grant
Darwin NT
ID: 94180 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 94207 - Posted: 12 Apr 2020, 5:37:33 UTC - in response to Message 94159.  

BOINC Manager is the gatekeeper. However, the settings can be a bit confusing on the wording, and there are local settings, project settings, settings by venue of the machine, etc. I've not seen BOINC exceed disk space limits before. So I'd suggest careful review of the settings in effect.

I also just saw a 484MB zipped database and 86MB application downloading, so Hopefully you can allow BOINC to use more disk space.
Rosetta Moderator: Mod.Sense
ID: 94207 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1681
Credit: 17,854,150
RAC: 20,118
Message 94215 - Posted: 12 Apr 2020, 6:13:44 UTC - in response to Message 94207.  
Last modified: 12 Apr 2020, 6:14:14 UTC

BOINC Manager is the gatekeeper. However, the settings can be a bit confusing on the wording, and there are local settings, project settings, settings by venue of the machine, etc. I've not seen BOINC exceed disk space limits before. So I'd suggest careful review of the settings in effect.
I forgot about local settings- Kieth, make sure you haven't set anything on the system itself as Local settings override the web based ones.
Grant
Darwin NT
ID: 94215 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Keith T.
Avatar

Send message
Joined: 1 Mar 07
Posts: 58
Credit: 34,135
RAC: 0
Message 94256 - Posted: 12 Apr 2020, 17:18:02 UTC
Last modified: 12 Apr 2020, 17:19:05 UTC

Thanks for the replies.

I am using local preferences on the computer.
Both web preferences and local preferences have a Minimum free Disk space setting of 1GB
The computer is a small Windows 10 netbook/ convertible with only 28.5 GB HDD storage

I managed to complete the 3 Rosetta tasks onboard alongside some Einstein tasks.

I set the maximum run time to 2 hours in order to get rid of them as quickly as possible.

I think part of the problem may have been the Swap or Page file size with 3 tasks running

Free HDD space has now recovered to almost 2.5 GB
ID: 94256 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Millenium

Send message
Joined: 20 Sep 05
Posts: 68
Credit: 184,283
RAC: 0
Message 94257 - Posted: 12 Apr 2020, 18:00:27 UTC

Here I have around 20 WUs currently (16 of them crunching) and Rosetta uses about 12GB. Yeah this project is a bit big on disk, so if you have a small disk it's not the proper project. Other projects are much smaller usually.
ID: 94257 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Message boards : Number crunching : Rosetta has busted Disk Quota by nearly 400%



©2024 University of Washington
https://www.bakerlab.org