Disk space

Questions and Answers : Preferences : Disk space

To post messages, you must log in.

AuthorMessage
Tim

Send message
Joined: 30 Dec 07
Posts: 1
Credit: 291,262
RAC: 587
Message 88068 - Posted: 15 Jan 2018, 16:09:21 UTC

I am receiving a notification that there is insufficient disk space for a project to run even though I have plenty of disk space on my hard drive. How do I allocate more disk space to a project?
ID: 88068 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator
Project administrator

Send message
Joined: 22 Aug 06
Posts: 3521
Credit: 0
RAC: 0
Message 88078 - Posted: 16 Jan 2018, 16:23:54 UTC

The BOINC Manager allows you to establish preferences for various disk-related values. When several BOINC projects are installed, the total space BOINC is allowed to use is divided among the projects by their resource shares.
Rosetta Moderator: Mod.Sense
ID: 88078 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
ByRant_OrRuin

Send message
Joined: 29 Mar 12
Posts: 2
Credit: 1,048,310
RAC: 282
Message 88219 - Posted: 2 Feb 2018, 14:34:21 UTC
Last modified: 2 Feb 2018, 14:45:40 UTC

I have adjusted every type of disk usage available to me. I have increased the storage for BOINC and the available memory use. However this project is taking up 5.91Gb of the now 6Gb I have allowed within BOINC. I have increased the allotment several times and forced BOINC to read local preferences. I used the online project settings and BOINC settings as well, but so far Rosetta is balking. I realize that the allotted space is split between the projects I may have running, but no matter the increase of memory or disk space config I use, the result is Rosetta infiltrating most of it and still complaining it needs 986 more Megabytes... Any help with settings would be appreciated. I have been away for quite a while, but all software is the latest iteration and correct for my platform. All of my hardware is new AMD TR4 system with about 1 month of use. I can supply a dxdiag from windows 10-pro, or whatever you may need.
Rosetta is operating. This issue does not appear to be interrupting the function, except the pauses to let me know the server wants me to have more space allocation.
Below are my system generics:
32Gb of operating DDR4 ram
NVMe Samsung 960 EVA drive 500Gb for OS and programs with more than half of the space available
GIGABYTE X399 DESIGNARE MB
AMD 1920X 12 core processor
GIGABYTE AORUS Radeon RX580
2 backup and storage drives
Seagate ST4000
Seagate ST3200
I forgot to mention that I have reset Rosetta once, and that solved some running issues but the space balk returned.
I appreciate your time,
Thanks.
ID: 88219 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator
Project administrator

Send message
Joined: 22 Aug 06
Posts: 3521
Credit: 0
RAC: 0
Message 88221 - Posted: 2 Feb 2018, 20:54:43 UTC

If you have all 12 cores active with BOINC projects, 6GB for all working storage doesn't sound like much. Each task needs space for checkpoints, working files, and the output. With that many active tasks there will also be a variety of base reference files actively in-use at the same time. By that I'm trying to refer to files that are shared between tasks of the same family within R@h.
Rosetta Moderator: Mod.Sense
ID: 88221 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Sid Celery

Send message
Joined: 11 Feb 08
Posts: 971
Credit: 19,956,195
RAC: 14,910
Message 88313 - Posted: 19 Feb 2018, 3:30:48 UTC - in response to Message 88219.  

I have adjusted every type of disk usage available to me. I have increased the storage for BOINC and the available memory use. However this project is taking up 5.91Gb of the now 6Gb I have allowed within BOINC. I have increased the allotment several times and forced BOINC to read local preferences. I used the online project settings and BOINC settings as well, but so far Rosetta is balking. I realize that the allotted space is split between the projects I may have running, but no matter the increase of memory or disk space config I use, the result is Rosetta infiltrating most of it and still complaining it needs 986 more Megabytes... Any help with settings would be appreciated. I have been away for quite a while, but all software is the latest iteration and correct for my platform. All of my hardware is new AMD TR4 system with about 1 month of use. I can supply a dxdiag from windows 10-pro, or whatever you may need.
Rosetta is operating. This issue does not appear to be interrupting the function, except the pauses to let me know the server wants me to have more space allocation.
Below are my system generics:
32Gb of operating DDR4 ram
NVMe Samsung 960 EVA drive 500Gb for OS and programs with more than half of the space available
GIGABYTE X399 DESIGNARE MB
AMD 1920X 12 core processor
GIGABYTE AORUS Radeon RX580
2 backup and storage drives
Seagate ST4000
Seagate ST3200
I forgot to mention that I have reset Rosetta once, and that solved some running issues but the space balk returned.
I appreciate your time,
Thanks.

First, nice system! I like it!
Second, you have loads of disk space. If you wanted, you could allocate 20Gb to Boinc, because when I look at what your settings imply, that's about the amount it'll end up demanding. But obviously you don't want to and I can perfectly well see why.

The cause of your problems is that you appear to have set just a 1hr runtime for your tasks, and you're returning them and grabbing more too frequently to feed your 12 cores - especially when you consider you'll usually have 8 day deadlines (3 days at the shortest with Rosetta). The result is you're currently storing 120 Rosetta tasks, which is a whole heap of space - I'd estimate around 15Gb.

The recommended Rosetta runtime is 8hrs. But if you change to that all at once, you'll have 120 8hr tasks instead of 120 1hr tasks, so don't change that straight away else you may start missing deadlines.

Increase your runtime to 5 or 6 hours and over the next 2 or 3 days Boinc itself will adjust it's expectations of how many tasks you need and reduce the number it downloads. In fact, it'll stop for a day or so and then settle down to a buffer nearer 25 tasks, which will take up much less space and hopefully stop your disk space warnings.

It's not apparent to me what store of work tasks you're asking for, but it seems like it's actually quite low. Is it "store at least 0.1 days of work" and an "additional 0.25 days of work"? If so, you may want to increase that a little at the same time as you make the further adjustment toward the default 8hr runtimes.

You should be able to work that out yourself after the initial change works its way through, depending on your personal preferences, but come back if you need further advice.
ID: 88313 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Questions and Answers : Preferences : Disk space



©2019 University of Washington
http://www.bakerlab.org