Message boards : Number crunching : Problems and Technical Issues with Rosetta@home
Previous · 1 . . . 141 · 142 · 143 · 144 · 145 · 146 · 147 . . . 295 · Next
Author | Message |
---|---|
.clair. Send message Joined: 2 Jan 07 Posts: 274 Credit: 26,399,595 RAC: 0 |
Now I`me getting some nuty messages from the server about disk space and python`s greed for everything ok, its `only` a 250GB disk but boinc mangler is now set to use all disk space possible {untick all disk space limits boxes, not had to do that before} rosetta is already using 95GB and boinc mangler reports there is still 64GB free for boinc to use. so the `currently have` bits are wrong `it needs19073MB` does it realy , well , its already using 95GB of space , so what is it going on about now o well more silliness to ignor Just how munch of everything do the pythons want to eat . . . . . [and I assure you I have not got my MB and GB mixed up] 01/12/2021 11:41:12 Rosetta@home Message from server: rosetta python projects needs 10252.03MB more disk space.You currently have 8821.45 MB available and it needs 19073.49 MB. 01/12/2021 22:06:01 Rosetta@home Message from server: rosetta python projects needs 16191.05MB more disk space.You currently have 2882.43 MB available and it needs 19073.49 MB. 02/12/2021 10:58:53 Rosetta@home Message from server: rosetta python projects needs 8276.39MB more disk space.You currently have 10797.10 MB available and it needs 19073.49 MB. 02/12/2021 11:09:53 Rosetta@home Message from server: rosetta python projects needs 15155.41MB more disk space.You currently have 3918.08 MB available and it needs 19073.49 MB. 02/12/2021 11:32:34 Rosetta@home Message from server: rosetta python projects needs 15828.33MB more disk space.You currently have 3245.16 MB available and it needs 19073.49 MB. |
Greg_BE Send message Joined: 30 May 06 Posts: 5690 Credit: 5,859,226 RAC: 14 |
Now I`me getting some nuty messages from the server about disk space and python`s greed for everything Old thread with Grant leading the answers: [url]https://boinc.bakerlab.org/rosetta/forum_thread.php?id=14537[/url} Short version, which is what I was thinking MIGHT (no guarantees) help, is to reset the project via BOINC manager. Wipe out all the old information and load a fresh copy in. One other thing to do as well is use your favorite disk cleaner and clean your drive. I use Wise and it does a good job. In addition to that I use ccleaner. Wise will let you do a deep clean and cleans stuff that ccleaner wont. Then for sure after you have done this all the garbage will be gone and you can do a reset and try to download again. Those are the simple steps. If after all that it fails, post the errors here again. |
.clair. Send message Joined: 2 Jan 07 Posts: 274 Credit: 26,399,595 RAC: 0 |
I will have a look at a cleanup and see what happens |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1631 Credit: 16,716,367 RAC: 10,437 |
Now I`me getting some nuty messages from the server about disk space and python`s greed for everythingKeep in mind the "Leave at least xx GB free" and "Use no more than xx% of total" settings as well. You might let it use no more than 500GB, thinking that will allow it to use up tp 500GB, but depending on those other settings it may not have that much available to actually use. And these values are for BOINC- they are for all of your projects, not just Rosetta. Apparently Einstein@Home has a tendency to eat up huge amounts of disk space in order to do it's work, and that is one of your other projects. Grant Darwin NT |
Greg_BE Send message Joined: 30 May 06 Posts: 5690 Credit: 5,859,226 RAC: 14 |
Now I`me getting some nuty messages from the server about disk space and python`s greed for everythingKeep in mind the "Leave at least xx GB free" and "Use no more than xx% of total" settings as well. You might let it use no more than 500GB, thinking that will allow it to use up tp 500GB, but depending on those other settings it may not have that much available to actually use. I also run Einstein plus ATLAS and I have a way smaller drive than this person does and I don't have this problem. |
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
I also run Einstein plus ATLAS and I have a way smaller drive than this person does and I don't have this problem. I have suggested that he delete all his projects and start over. He obviously has something wrong. It doesn't work. |
Jonathan Send message Joined: 4 Oct 17 Posts: 43 Credit: 1,337,472 RAC: 0 |
Python tasks failing Error posted inside VM is "Intel MKL FATAL ERROR: Error on loading function mkl_lapack_ps_mc3_dsytrf_l_small." Stops right after it gives workunit name. Computer is an old Intel I7-920. I get no cpu usage after hang. I have removed and reattached project from a December 1 when this first started. I thought maybe it was bad files. https://boinc.bakerlab.org/rosetta/results.php?hostid=6157362 |
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
Python tasks failing I don't see that you have VirtualBox installed. https://boinc.bakerlab.org/rosetta/show_host_detail.php?hostid=6157362 But you are better off with VBox 5.2.44 anyway. Version 6.1 gives "Vm job unmanageable" suspensions. https://www.virtualbox.org/wiki/Download_Old_Builds_5_2 |
Jonathan Send message Joined: 4 Oct 17 Posts: 43 Credit: 1,337,472 RAC: 0 |
Are you thinking of a different project that shows Virtual Box on the computer details page? I don't see it on either of the computer details for mine, nor on the two I check listed under you. Virtual Box is working on both my computers but I have been sticking to 6.1 since it is supported by Virtualbox. Support was dropped for the earlier versions. I just don't load up my computers to 100 percent processor usage nor juggle too many concurrent VM tasks. These Python / Rosettas are brutal with creating almost 8 Gb images. I just can't figure out why the one computer is having problems now as it was working with the previous python related tasks. |
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
Probably so. I usually see VirtualBox listed on most projects. The memory requirement for downloading the new pythons is now down to 3 GB, and the amount required to run is less than that. But the .vdi images in the slots are still large. Maybe they will be reduced eventually. Have you checked BOINC Manager for memory and disk usage allowed? It may not be enough. |
Jonathan Send message Joined: 4 Oct 17 Posts: 43 Credit: 1,337,472 RAC: 0 |
It's using Rosetta preferences RAM set to %75 in use and not in use. So can use 9 out of 12Gb. That seems correct as It has 3 tasks. It doesn't keep non running tasks in memory. that box is unchecked. I think it is something inside the VM. I kind of got spoiled with the LCH Atlas tasks and being able to see the second and third terminals. One for tasks and one showing TOP |
Jim1348 Send message Joined: 19 Jan 06 Posts: 881 Credit: 52,257,545 RAC: 0 |
I kind of got spoiled with the LCH Atlas tasks and being able to see the second and third terminals. One for tasks and one showing TOP While the VBox version won't affect your ability to download, LHC is the only project that uses VBox 6.1 without the suspensions, from what I have seen at any rate. That is apparently because they use a different wrapper, which I think they compile themselves. At least it is different. But that is why I went to Win10. It allows the use of VBox 5.2.44, whereas Ubuntu 20.04.3 allows only 6.1. I haven't had a suspension yet in Win10, though it has been running only a day. But I would normally get several in that time with VBox 6.1. Unfortunately, it does not solve the "0 CPU" error, where a work unit uses very little (less than 1%) CPU power, and goes on forever, or else times out. |
mmonnin Send message Joined: 2 Jun 16 Posts: 54 Credit: 21,772,275 RAC: 29,299 |
Python tasks failing I have 6.x and never have this issue with LHC but about half have these issues at Rosetta.. Plenty of place and memory. Rosetta has never had an efficient app. |
Greg_BE Send message Joined: 30 May 06 Posts: 5690 Credit: 5,859,226 RAC: 14 |
Python tasks failing I run LHC ATLAS and I had to downgrade to run RAH Python. Python is new to RAH style of computing on PC's. I've been with this project since almost the beginning and they have never deviated from their base program. They always have bugs, that's a given. We saw that here, quite a few things went wrong before they got a stable working project. It's been the same with some of the projects they put out on normal Rosetta. It's just one of those things that we have to deal with. As far as the two versions of Vbox, I don't see any difference in the way ATLAS runs on 6 or on 5. So I will just stick with 5 until a newer version of 6 comes out that may make the errors go away or maybe not. But it really doesn't seem to make any difference on any of the other 2 Vbox projects I run. So just down grade to 5 if you want to run Python. |
Greg_BE Send message Joined: 30 May 06 Posts: 5690 Credit: 5,859,226 RAC: 14 |
Python tasks failing You might want to research that error. I found quite a few things about it, but it way over my head to understand. It's quite technical stuff that comes back in the search results. https://www.google.com/search?client=firefox-b-d&q=%22Intel+MKL+FATAL+ERROR%3A+Error+on+loading+function+mkl_lapack_ps_mc3_dsytrf_l_small |
.clair. Send message Joined: 2 Jan 07 Posts: 274 Credit: 26,399,595 RAC: 0 |
At the moment the only projects I am running on that computer are Moo on the gpu and rosetta on cpu I have not had many disk space messages today though some rosetta 42 work has found its way here, wich eased the problem I decided not to install any more programs to deleat the disk junk coz they would take up more space on the disk :) though I know I can uninstall them later So after the usual microwsoft `disk cleanup` and system files I had a good uninstall of everything I don't need, had a play with the digital chainsaw and deleted everything that don't have to be on the disk including everything from documents and download folders. that got me 12GB back even that did`nt get rid of the "disk space" message , though the demands where less. the thing that finaly shut it up was reducing the virtual memory size on the disk coz it was holding 39GB to ransom and not using it , my account page still shows it as - Swap space 32784.33 MB its got 32GB ram in it and windows automatically creates a page file 1 1/2 times the size of fitted RAM, give or take a bit {having remembered the fun I had with win98se all those years ago with running out of memory when it only had 756MB in it to start with} But you dident need gigabites of memory just to boot the thing back then. so having read up on how its done these days and chopped it down to a tenth of what it was using and now have 106GB free disk space even with several greedy python tasks running I will just have to keep an eye on it and see what happens ................. Just been to check on it it last had a disk space moan ten hours ago so that seems to be it for now Einstein does use the most disk space at 330MB [suspended] Rosetta [we will all have much the same] is using 49GB So , yes , rosetta is the disk hog |
Greg_BE Send message Joined: 30 May 06 Posts: 5690 Credit: 5,859,226 RAC: 14 |
At the moment the only projects I am running on that computer are Moo on the gpu and rosetta on cpu That's interesting...I had a look at my RAH folder and its 30.7 GB in size and in compressed form it is 13.7 (size on disk) 5,316 files and 424 folders. I have a smaller drive than you and yet I don't get errors and I am running 7 BOINC projects and FAH plus Facebook and Firefox with many tabs and I don't get a disk space error. I am beginning to think RAH is having issues with Win7. I use Win 10. Just a thought. Which one of your systems is having issues? |
Jonathan Send message Joined: 4 Oct 17 Posts: 43 Credit: 1,337,472 RAC: 0 |
I aborted all the newer python jobs that started with 'aa'. I got a single 'boinc_cages_IL' job so I kept that one. That one runs fine. I set the computer to not receive VM jobs from Rosetta. |
.clair. Send message Joined: 2 Jan 07 Posts: 274 Credit: 26,399,595 RAC: 0 |
Its windblows 7, opteron16 that has gone funky I thort I had it fixed, but today its back on python only work , 11 at once and it is getting the disk space moan again, except even after all that clear out, its got worse !!!?? 04/12/2021 10:50:17 | Rosetta@home | Message from server: rosetta python projects needs 16200.20MB more disk space. You currently have 2873.28 MB available and it needs 19073.49 MB. 04/12/2021 12:19:11 | Rosetta@home | Message from server: rosetta python projects needs 16255.39MB more disk space. You currently have 2818.09 MB available and it needs 19073.49 MB. right now, as far as the OS on drive C, its got 91GB of disk space free even with the 11 pythons running so just for interest I have set it off on a full 5 pass disk check to see if it finds anything funny old world . . . . |
[VENETO] boboviz Send message Joined: 1 Dec 05 Posts: 1978 Credit: 9,194,012 RAC: 3,787 |
Now my pcs have "got 0 new tasks" of python wus, but in the queue there are over 5000 wus... |
Message boards :
Number crunching :
Problems and Technical Issues with Rosetta@home
©2024 University of Washington
https://www.bakerlab.org