Problems and Technical Issues with Rosetta@home

Message boards : Number crunching : Problems and Technical Issues with Rosetta@home

To post messages, you must log in.

Previous · 1 . . . 140 · 141 · 142 · 143 · 144 · 145 · 146 . . . 311 · Next

AuthorMessage
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5691
Credit: 5,859,226
RAC: 0
Message 103647 - Posted: 1 Dec 2021, 23:26:41 UTC

Some needs to open the download hose some more.
2GB files and in 5 minutes it has downloaded on 38.75% of the vdi file.
That's slower than a handicap snail!
3200 KBs? for 2 gigs! gees!
ID: 103647 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Falconet

Send message
Joined: 9 Mar 09
Posts: 354
Credit: 1,276,393
RAC: 828
Message 103648 - Posted: 1 Dec 2021, 23:31:32 UTC - in response to Message 103647.  
Last modified: 1 Dec 2021, 23:32:12 UTC

Mine downloaded at around 2500 kbps last night. Which is fine, I'm patient lol.

I've noticed the amount of ready to send Pythons has been decreasing for a while now.
Currently at 1815, 2 hours or so ago it was at 3730. Wonder if there's an issue.
ID: 103648 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5691
Credit: 5,859,226
RAC: 0
Message 103649 - Posted: 1 Dec 2021, 23:36:20 UTC

Now to add insult. First 5 files, then the next 4 files and the next 4 files after that all have failed to download errors!!!

What now?
ID: 103649 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
nairb

Send message
Joined: 8 Dec 05
Posts: 17
Credit: 990,147
RAC: 0
Message 103650 - Posted: 2 Dec 2021, 0:12:56 UTC
Last modified: 2 Dec 2021, 0:13:38 UTC

Just added rosetta to a new machine and all w/u have failed with download errors.
it says:-
Giving up on download AIMNet_minimization_python_project.py:permanent HTTP error.

It downloaded (v.slowly) the 2 gig file ok.......
ID: 103650 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile robertmiles

Send message
Joined: 16 Jun 08
Posts: 1234
Credit: 14,338,560
RAC: 826
Message 103651 - Posted: 2 Dec 2021, 0:14:37 UTC - in response to Message 103649.  

Now to add insult. First 5 files, then the next 4 files and the next 4 files after that all have failed to download errors!!!

What now?

One thing to do is to wait for another try at downloading those files.
ID: 103651 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
mmonnin

Send message
Joined: 2 Jun 16
Posts: 61
Credit: 25,390,629
RAC: 13,030
Message 103652 - Posted: 2 Dec 2021, 0:26:59 UTC

Nothing but download errors now with the new vdi file

<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
WU download error: couldn't get input files:
<file_xfer_error>
<file_name>AIMNet_minimization_python_project.py</file_name>
<error_code>-224 (permanent HTTP error)</error_code>
<error_message>permanent HTTP error</error_message>
</file_xfer_error>
</message>
]]>

No size on the file when it actually exists.
-rw-r--r-- 1 boinc boinc 0 Dec 1 18:56 AIMNet_minimization_python_project.py
ID: 103652 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
.clair.

Send message
Joined: 2 Jan 07
Posts: 274
Credit: 26,399,595
RAC: 0
Message 103654 - Posted: 2 Dec 2021, 1:25:35 UTC

Something`s broken the server [waznt me . . . ]
As of 2 Dec 2021, 0:00:15 UTC [ Scheduler running ]
Total queued jobs: 2,163,843
ready to send 0
so its nufink 2 do 4 a wile
ID: 103654 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5691
Credit: 5,859,226
RAC: 0
Message 103656 - Posted: 2 Dec 2021, 7:31:17 UTC

Don't they even check their stuff before dropping it on the server?
Really doesn't seem that way.
ID: 103656 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jim1348

Send message
Joined: 19 Jan 06
Posts: 881
Credit: 52,257,545
RAC: 0
Message 103659 - Posted: 2 Dec 2021, 14:50:06 UTC - in response to Message 103656.  

They are sending me stuff (pythons), but it is somewhat futile.
A significant number either fail with "0 CPU", or else "Vm job unmanageable".

That should have been taken care of before they even started with the pythons.
But then they might have had to listen to feedback from the crunchers.
ID: 103659 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
SirMikan

Send message
Joined: 14 May 20
Posts: 1
Credit: 709,623
RAC: 0
Message 103660 - Posted: 2 Dec 2021, 18:14:11 UTC

I haven't received any new tasks since November 28. Are there any issues right now with the task server?
ID: 103660 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Falconet

Send message
Joined: 9 Mar 09
Posts: 354
Credit: 1,276,393
RAC: 828
Message 103661 - Posted: 2 Dec 2021, 18:40:05 UTC - in response to Message 103660.  

There are few of the standard Rosetta app tasks available.
There are plenty of the Python Rosetta tasks, though. But you need to install Virtualbox in order to run those.
ID: 103661 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5691
Credit: 5,859,226
RAC: 0
Message 103665 - Posted: 2 Dec 2021, 19:29:54 UTC - in response to Message 103660.  

I haven't received any new tasks since November 28. Are there any issues right now with the task server?



No...just very small limited batches of 4.2 stuff.
The focus seems to be on Python projects now.
ID: 103665 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5691
Credit: 5,859,226
RAC: 0
Message 103666 - Posted: 2 Dec 2021, 19:38:08 UTC - in response to Message 103654.  

Something`s broken the server [waznt me . . . ]
As of 2 Dec 2021, 0:00:15 UTC [ Scheduler running ]
Total queued jobs: 2,163,843
ready to send 0
so its nufink 2 do 4 a wile


There may be 2 million queued, but they are not ready to be released yet.
You can look to the right top and you will see: Tasks ready to send 5007
And then below left is the breakdown:
Rosetta 9 69053 6.93 (0.24 - 41.66) 2284
Rosetta Mini 0 0 --- 0
rosetta python projects 5001 21761 4.76 (0.01 - 36.33) 1457

Which does not match as the total here is 5010.
But what is 3 jobs in the big picture anyway.

And at 2300 UTC I was getting lots of download errors, so maybe they pulled the tasks to repair the problem.
I have not looked at my event log to see when I got my first new 4.2 and Python. But I have those now.
ID: 103666 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
.clair.

Send message
Joined: 2 Jan 07
Posts: 274
Credit: 26,399,595
RAC: 0
Message 103670 - Posted: 2 Dec 2021, 21:51:18 UTC

Now I`me getting some nuty messages from the server about disk space and python`s greed for everything
ok, its `only` a 250GB disk but boinc mangler is now set to use all disk space possible {untick all disk space limits boxes, not had to do that before}
rosetta is already using 95GB and boinc mangler reports there is still 64GB free for boinc to use.
so the `currently have` bits are wrong
`it needs19073MB` does it realy , well , its already using 95GB of space , so what is it going on about now
o well more silliness to ignor
Just how munch of everything do the pythons want to eat . . . . .
[and I assure you I have not got my MB and GB mixed up]

01/12/2021 11:41:12 Rosetta@home Message from server: rosetta python projects needs 10252.03MB more disk space.You currently have 8821.45 MB available and it needs 19073.49 MB.
01/12/2021 22:06:01 Rosetta@home Message from server: rosetta python projects needs 16191.05MB more disk space.You currently have 2882.43 MB available and it needs 19073.49 MB.
02/12/2021 10:58:53 Rosetta@home Message from server: rosetta python projects needs 8276.39MB more disk space.You currently have 10797.10 MB available and it needs 19073.49 MB.
02/12/2021 11:09:53 Rosetta@home Message from server: rosetta python projects needs 15155.41MB more disk space.You currently have 3918.08 MB available and it needs 19073.49 MB.
02/12/2021 11:32:34 Rosetta@home Message from server: rosetta python projects needs 15828.33MB more disk space.You currently have 3245.16 MB available and it needs 19073.49 MB.
ID: 103670 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5691
Credit: 5,859,226
RAC: 0
Message 103673 - Posted: 2 Dec 2021, 23:01:56 UTC - in response to Message 103670.  
Last modified: 2 Dec 2021, 23:05:36 UTC

Now I`me getting some nuty messages from the server about disk space and python`s greed for everything
ok, its `only` a 250GB disk but boinc mangler is now set to use all disk space possible {untick all disk space limits boxes, not had to do that before}
rosetta is already using 95GB and boinc mangler reports there is still 64GB free for boinc to use.
so the `currently have` bits are wrong
`it needs19073MB` does it realy , well , its already using 95GB of space , so what is it going on about now
o well more silliness to ignor
Just how munch of everything do the pythons want to eat . . . . .
[and I assure you I have not got my MB and GB mixed up]

01/12/2021 11:41:12 Rosetta@home Message from server: rosetta python projects needs 10252.03MB more disk space.You currently have 8821.45 MB available and it needs 19073.49 MB.
01/12/2021 22:06:01 Rosetta@home Message from server: rosetta python projects needs 16191.05MB more disk space.You currently have 2882.43 MB available and it needs 19073.49 MB.
02/12/2021 10:58:53 Rosetta@home Message from server: rosetta python projects needs 8276.39MB more disk space.You currently have 10797.10 MB available and it needs 19073.49 MB.
02/12/2021 11:09:53 Rosetta@home Message from server: rosetta python projects needs 15155.41MB more disk space.You currently have 3918.08 MB available and it needs 19073.49 MB.
02/12/2021 11:32:34 Rosetta@home Message from server: rosetta python projects needs 15828.33MB more disk space.You currently have 3245.16 MB available and it needs 19073.49 MB.


Old thread with Grant leading the answers: [url]https://boinc.bakerlab.org/rosetta/forum_thread.php?id=14537[/url}

Short version, which is what I was thinking MIGHT (no guarantees) help, is to reset the project via BOINC manager. Wipe out all the old information and load a fresh copy in.

One other thing to do as well is use your favorite disk cleaner and clean your drive.
I use Wise and it does a good job. In addition to that I use ccleaner. Wise will let you do a deep clean and cleans stuff that ccleaner wont. Then for sure after you have done this all the garbage will be gone and you can do a reset and try to download again.

Those are the simple steps. If after all that it fails, post the errors here again.
ID: 103673 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
.clair.

Send message
Joined: 2 Jan 07
Posts: 274
Credit: 26,399,595
RAC: 0
Message 103674 - Posted: 3 Dec 2021, 0:38:43 UTC

I will have a look at a cleanup and see what happens
ID: 103674 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1734
Credit: 18,532,940
RAC: 17,945
Message 103675 - Posted: 3 Dec 2021, 4:59:18 UTC - in response to Message 103670.  

Now I`me getting some nuty messages from the server about disk space and python`s greed for everything
ok, its `only` a 250GB disk but boinc mangler is now set to use all disk space possible {untick all disk space limits boxes, not had to do that before}
rosetta is already using 95GB and boinc mangler reports there is still 64GB free for boinc to use.
so the `currently have` bits are wrong
`it needs19073MB` does it realy , well , its already using 95GB of space , so what is it going on about now
o well more silliness to ignor
Just how munch of everything do the pythons want to eat . . . . .
[and I assure you I have not got my MB and GB mixed up]

01/12/2021 11:41:12 Rosetta@home Message from server: rosetta python projects needs 10252.03MB more disk space.You currently have 8821.45 MB available and it needs 19073.49 MB.
01/12/2021 22:06:01 Rosetta@home Message from server: rosetta python projects needs 16191.05MB more disk space.You currently have 2882.43 MB available and it needs 19073.49 MB.
02/12/2021 10:58:53 Rosetta@home Message from server: rosetta python projects needs 8276.39MB more disk space.You currently have 10797.10 MB available and it needs 19073.49 MB.
02/12/2021 11:09:53 Rosetta@home Message from server: rosetta python projects needs 15155.41MB more disk space.You currently have 3918.08 MB available and it needs 19073.49 MB.
02/12/2021 11:32:34 Rosetta@home Message from server: rosetta python projects needs 15828.33MB more disk space.You currently have 3245.16 MB available and it needs 19073.49 MB.
Keep in mind the "Leave at least xx GB free" and "Use no more than xx% of total" settings as well. You might let it use no more than 500GB, thinking that will allow it to use up tp 500GB, but depending on those other settings it may not have that much available to actually use.

And these values are for BOINC- they are for all of your projects, not just Rosetta.
Apparently Einstein@Home has a tendency to eat up huge amounts of disk space in order to do it's work, and that is one of your other projects.
Grant
Darwin NT
ID: 103675 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5691
Credit: 5,859,226
RAC: 0
Message 103679 - Posted: 3 Dec 2021, 17:41:08 UTC - in response to Message 103675.  

Now I`me getting some nuty messages from the server about disk space and python`s greed for everything
ok, its `only` a 250GB disk but boinc mangler is now set to use all disk space possible {untick all disk space limits boxes, not had to do that before}
rosetta is already using 95GB and boinc mangler reports there is still 64GB free for boinc to use.
so the `currently have` bits are wrong
`it needs19073MB` does it realy , well , its already using 95GB of space , so what is it going on about now
o well more silliness to ignor
Just how munch of everything do the pythons want to eat . . . . .
[and I assure you I have not got my MB and GB mixed up]

01/12/2021 11:41:12 Rosetta@home Message from server: rosetta python projects needs 10252.03MB more disk space.You currently have 8821.45 MB available and it needs 19073.49 MB.
01/12/2021 22:06:01 Rosetta@home Message from server: rosetta python projects needs 16191.05MB more disk space.You currently have 2882.43 MB available and it needs 19073.49 MB.
02/12/2021 10:58:53 Rosetta@home Message from server: rosetta python projects needs 8276.39MB more disk space.You currently have 10797.10 MB available and it needs 19073.49 MB.
02/12/2021 11:09:53 Rosetta@home Message from server: rosetta python projects needs 15155.41MB more disk space.You currently have 3918.08 MB available and it needs 19073.49 MB.
02/12/2021 11:32:34 Rosetta@home Message from server: rosetta python projects needs 15828.33MB more disk space.You currently have 3245.16 MB available and it needs 19073.49 MB.
Keep in mind the "Leave at least xx GB free" and "Use no more than xx% of total" settings as well. You might let it use no more than 500GB, thinking that will allow it to use up tp 500GB, but depending on those other settings it may not have that much available to actually use.

And these values are for BOINC- they are for all of your projects, not just Rosetta.
Apparently Einstein@Home has a tendency to eat up huge amounts of disk space in order to do it's work, and that is one of your other projects.


I also run Einstein plus ATLAS and I have a way smaller drive than this person does and I don't have this problem.
ID: 103679 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jim1348

Send message
Joined: 19 Jan 06
Posts: 881
Credit: 52,257,545
RAC: 0
Message 103682 - Posted: 3 Dec 2021, 18:06:45 UTC - in response to Message 103679.  

I also run Einstein plus ATLAS and I have a way smaller drive than this person does and I don't have this problem.

I have suggested that he delete all his projects and start over. He obviously has something wrong. It doesn't work.
ID: 103682 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jonathan

Send message
Joined: 4 Oct 17
Posts: 43
Credit: 1,337,472
RAC: 0
Message 103683 - Posted: 3 Dec 2021, 19:04:09 UTC

Python tasks failing
Error posted inside VM is "Intel MKL FATAL ERROR: Error on loading function mkl_lapack_ps_mc3_dsytrf_l_small."
Stops right after it gives workunit name.

Computer is an old Intel I7-920. I get no cpu usage after hang.
I have removed and reattached project from a December 1 when this first started. I thought maybe it was bad files.

https://boinc.bakerlab.org/rosetta/results.php?hostid=6157362
ID: 103683 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Previous · 1 . . . 140 · 141 · 142 · 143 · 144 · 145 · 146 . . . 311 · Next

Message boards : Number crunching : Problems and Technical Issues with Rosetta@home



©2024 University of Washington
https://www.bakerlab.org