Problen downloading work tasks.

Message boards : Number crunching : Problen downloading work tasks.

To post messages, you must log in.

1 · 2 · 3 · 4 . . . 6 · Next

AuthorMessage
Jean-David Beyer

Send message
Joined: 2 Nov 05
Posts: 178
Credit: 5,764,598
RAC: 3,996
Message 107793 - Posted: 15 Dec 2022, 21:47:54 UTC
Last modified: 15 Dec 2022, 21:52:05 UTC

I received what looked like a download of 22 new Rosetta tasks (in more than one bunch), but they do not download.

If I look at the server and it has been saying this for what seems a long time:
Download server boinc-files.bakerlab.org Not Running

Well, if the download server is not running, why did it bother to tell me to download the tasks? :Like this:

Thu 15 Dec 2022 01:54:03 PM EST | Rosetta@home | Sending scheduler request: To fetch work.
Thu 15 Dec 2022 01:54:03 PM EST | Rosetta@home | Requesting new tasks for CPU
Thu 15 Dec 2022 01:54:05 PM EST | Rosetta@home | Scheduler request completed: got 14 new tasks
Thu 15 Dec 2022 01:54:05 PM EST | Rosetta@home | Project requested delay of 31 seconds
Thu 15 Dec 2022 01:54:07 PM EST | Rosetta@home | Started download of rb_12_15_464343_459634_ab_t000__h001_robetta_FLAGS
Thu 15 Dec 2022 01:54:07 PM EST | Rosetta@home | Started download of rb_12_15_464343_459634_ab_t000__h001_robetta.zip
Thu 15 Dec 2022 01:54:09 PM EST |  | Project communication failed: attempting access to reference site

ID: 107793 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Sid Celery

Send message
Joined: 11 Feb 08
Posts: 2003
Credit: 39,142,427
RAC: 23,917
Message 107794 - Posted: 16 Dec 2022, 0:09:59 UTC - in response to Message 107793.  

It's still saying the same about the download server, but in the last 20 minutes tasks have started coming down and 2.1million tasks seem to be i the queue on the front page.

I don't know what happened, but it seems to have been sorted out now.
Is that what other people are seeing too now?
ID: 107794 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
pututu

Send message
Joined: 12 Jun 16
Posts: 5
Credit: 10,025,855
RAC: 21
Message 107795 - Posted: 16 Dec 2022, 1:17:46 UTC - in response to Message 107794.  
Last modified: 16 Dec 2022, 1:19:17 UTC

According to the server status https://boinc.bakerlab.org/rosetta/server_status.php the "Download server" is "Not Running"

Someone needs to jump-start the Download server.... ;)
ID: 107795 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
hadron

Send message
Joined: 4 Sep 22
Posts: 47
Credit: 1,038,661
RAC: 10,748
Message 107796 - Posted: 16 Dec 2022, 1:17:59 UTC - in response to Message 107794.  

As of right now on the project status page, the download server is still down, and there are only 44248 tasks in progress, with 29,911 unsent.
The front page seems to be a little out of touch with reality.
ID: 107796 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jean-David Beyer

Send message
Joined: 2 Nov 05
Posts: 178
Credit: 5,764,598
RAC: 3,996
Message 107797 - Posted: 16 Dec 2022, 1:20:06 UTC - in response to Message 107794.  

It's still saying the same about the download server, but in the last 20 minutes tasks have started coming down and 2.1million tasks seem to be i the queue on the front page.

I don't know what happened, but it seems to have been sorted out now.
Is that what other people are seeing too now?

I see this on the front page:

Application 	Unsent 	In progress 	Runtime of last 100 tasks in hours: average, min, max 	Users in last 24 hours
Rosetta 	29911 	44248 	        6.68 (0.55 - 63.25)                	                1260


OTOH, I am still unable to download anything.
ID: 107797 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jean-David Beyer

Send message
Joined: 2 Nov 05
Posts: 178
Credit: 5,764,598
RAC: 3,996
Message 107798 - Posted: 16 Dec 2022, 5:14:17 UTC

Download server boinc-files.bakerlab.org Not Running
ID: 107798 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
hadron

Send message
Joined: 4 Sep 22
Posts: 47
Credit: 1,038,661
RAC: 10,748
Message 107801 - Posted: 16 Dec 2022, 8:16:49 UTC - in response to Message 107798.  

Download server boinc-files.bakerlab.org Not Running


Patience, Grasshopper, it's not the end of the world as we know it. In the fullness of time, The download server will be back up and running.
ID: 107801 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jean-David Beyer

Send message
Joined: 2 Nov 05
Posts: 178
Credit: 5,764,598
RAC: 3,996
Message 107802 - Posted: 16 Dec 2022, 9:58:17 UTC - in response to Message 107801.  

True, but why must it occur at the same time that ClimatePrediction is also withholding work units. My computer has nearly run out of work. Running mainly projects of little importance to me. Sigh!
ID: 107802 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Bryn Mawr

Send message
Joined: 26 Dec 18
Posts: 378
Credit: 11,032,419
RAC: 13,370
Message 107803 - Posted: 16 Dec 2022, 11:07:39 UTC - in response to Message 107793.  

I received what looked like a download of 22 new Rosetta tasks (in more than one bunch), but they do not download.

If I look at the server and it has been saying this for what seems a long time:
Download server boinc-files.bakerlab.org Not Running

Well, if the download server is not running, why did it bother to tell me to download the tasks? :Like this:

Thu 15 Dec 2022 01:54:03 PM EST | Rosetta@home | Sending scheduler request: To fetch work.
Thu 15 Dec 2022 01:54:03 PM EST | Rosetta@home | Requesting new tasks for CPU
Thu 15 Dec 2022 01:54:05 PM EST | Rosetta@home | Scheduler request completed: got 14 new tasks
Thu 15 Dec 2022 01:54:05 PM EST | Rosetta@home | Project requested delay of 31 seconds
Thu 15 Dec 2022 01:54:07 PM EST | Rosetta@home | Started download of rb_12_15_464343_459634_ab_t000__h001_robetta_FLAGS
Thu 15 Dec 2022 01:54:07 PM EST | Rosetta@home | Started download of rb_12_15_464343_459634_ab_t000__h001_robetta.zip
Thu 15 Dec 2022 01:54:09 PM EST |  | Project communication failed: attempting access to reference site


Allocating the 14 tasks to you is done by the Scheduler which then passes them to the Download Server to action. The Scheduler has told you they’re coming but the DS is not there to send them.
ID: 107803 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
.clair.

Send message
Joined: 2 Jan 07
Posts: 274
Credit: 26,399,595
RAC: 0
Message 107804 - Posted: 16 Dec 2022, 11:30:38 UTC

Download server - Not Running .
thirty thousand on the server status page
6.5 million tasks on the front page and non will download .
I think the que is so big the download server has fainted :-(
ID: 107804 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
pututu

Send message
Joined: 12 Jun 16
Posts: 5
Credit: 10,025,855
RAC: 21
Message 107806 - Posted: 16 Dec 2022, 16:46:24 UTC

If and when the download server is up, it will just trickle and will take additional time to clear up. That's the second hurdle, lol.
ID: 107806 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jean-David Beyer

Send message
Joined: 2 Nov 05
Posts: 178
Credit: 5,764,598
RAC: 3,996
Message 107808 - Posted: 16 Dec 2022, 20:45:27 UTC - in response to Message 107803.  
Last modified: 16 Dec 2022, 20:49:30 UTC

Allocating the 14 tasks to you is done by the Scheduler which then passes them to the Download Server to action. The Scheduler has told you they’re coming but the DS is not there to send them.


What happens if the deadline is passed before the tasks actually download? Is that all wasted? Deadline is early Sunday afternoon.
ID: 107808 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
hadron

Send message
Joined: 4 Sep 22
Posts: 47
Credit: 1,038,661
RAC: 10,748
Message 107809 - Posted: 16 Dec 2022, 21:19:30 UTC - in response to Message 107808.  

Allocating the 14 tasks to you is done by the Scheduler which then passes them to the Download Server to action. The Scheduler has told you they’re coming but the DS is not there to send them.


What happens if the deadline is passed before the tasks actually download? Is that all wasted? Deadline is early Sunday afternoon.

I don't know about Rosetta, but I've had a couple of of tasks on LHC run past the due date, and have still got credit for them. My advice is to just let them run to completion.
ID: 107809 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Bryn Mawr

Send message
Joined: 26 Dec 18
Posts: 378
Credit: 11,032,419
RAC: 13,370
Message 107810 - Posted: 16 Dec 2022, 21:25:34 UTC - in response to Message 107808.  

Allocating the 14 tasks to you is done by the Scheduler which then passes them to the Download Server to action. The Scheduler has told you they’re coming but the DS is not there to send them.


What happens if the deadline is passed before the tasks actually download? Is that all wasted? Deadline is early Sunday afternoon.


If the task has not downloaded then you’ve done no work and used very little bandwidth - Rosetta has lost out but that’s their incentive to get the server running again.
ID: 107810 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Daniel Graf

Send message
Joined: 2 Nov 05
Posts: 10
Credit: 61,007,610
RAC: 68,056
Message 107811 - Posted: 16 Dec 2022, 22:56:32 UTC

I would say it's a pure Linux problem. I have no problems on my Windows computers. Only on my Linux computer does it not want to download the rest.

Greetings from Daniel
ID: 107811 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1509
Credit: 15,258,342
RAC: 23,360
Message 107813 - Posted: 16 Dec 2022, 23:25:28 UTC

Regardless of the Server Staus page, work is being sent out.
The Top Computers list shows systems with recently allocated work, and the graphs also show work going out over the last few days. However it does appear to be at a lower rate than usual, so a reset of the download server would probably not go astray.


Grant
Darwin NT
ID: 107813 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jean-David Beyer

Send message
Joined: 2 Nov 05
Posts: 178
Credit: 5,764,598
RAC: 3,996
Message 107815 - Posted: 16 Dec 2022, 23:48:20 UTC - in response to Message 107813.  

Regardless of the Server Staus page, work is being sent out.
The Top Computers list shows systems with recently allocated work, and the graphs also show work going out over the last few days. However it does appear to be at a lower rate than usual, so a reset of the download server would probably not go astray.


Work is not being sent out to me. My machine does run Linux, but it seems to me this is not a Linux problem.

Fri 16 Dec 2022 06:39:51 PM EST | Rosetta@home | Started download of rb_12_15_464343_459634_ab_t000__h002_robetta.200.4mers.index.gz
Fri 16 Dec 2022 06:39:52 PM EST |  | Internet access OK - project servers may be temporarily down.
Fri 16 Dec 2022 06:39:52 PM EST | Rosetta@home | Temporarily failed download of rb_12_15_464343_459634_ab_t000__h002_robetta.200.5mers.index.gz: transient HTTP error
Fri 16 Dec 2022 06:39:52 PM EST | Rosetta@home | Backing off 05:52:24 on download of rb_12_15_464343_459634_ab_t000__h002_robetta.200.5mers.index.gz


If work is going out, why does this remain unchanged?

Tasks ready to send 29928
ID: 107815 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Sid Celery

Send message
Joined: 11 Feb 08
Posts: 2003
Credit: 39,142,427
RAC: 23,917
Message 107816 - Posted: 16 Dec 2022, 23:55:49 UTC - in response to Message 107804.  

Download server - Not Running
Thirty thousand on the server status page
6.5 million tasks on the front page and none will download
I think the queue is so big the download server has fainted :-(

When I posted 24hrs ago, tasks were already downloading.

The error appears <to me> to be the message that the download server isn't running, when it's been running all along.
This is the opposite of when all servers are shown to be running, but they aren't.

The "In Progress" task quantity is rising, so everyone should be seeing work.
The only thing stopping me from grabbing more tasks is the bunch of WCG tasks I've yet to work through filling a large part of my small buffer
ID: 107816 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Sid Celery

Send message
Joined: 11 Feb 08
Posts: 2003
Credit: 39,142,427
RAC: 23,917
Message 107817 - Posted: 17 Dec 2022, 0:00:56 UTC - in response to Message 107815.  
Last modified: 17 Dec 2022, 0:08:46 UTC

Regardless of the Server Staus page, work is being sent out.
The Top Computers list shows systems with recently allocated work, and the graphs also show work going out over the last few days. However it does appear to be at a lower rate than usual, so a reset of the download server would probably not go astray.

Work is not being sent out to me. My machine does run Linux, but it seems to me this is not a Linux problem.

Fri 16 Dec 2022 06:39:51 PM EST | Rosetta@home | Started download of rb_12_15_464343_459634_ab_t000__h002_robetta.200.4mers.index.gz
Fri 16 Dec 2022 06:39:52 PM EST |  | Internet access OK - project servers may be temporarily down.
Fri 16 Dec 2022 06:39:52 PM EST | Rosetta@home | Temporarily failed download of rb_12_15_464343_459634_ab_t000__h002_robetta.200.5mers.index.gz: transient HTTP error
Fri 16 Dec 2022 06:39:52 PM EST | Rosetta@home | Backing off 05:52:24 on download of rb_12_15_464343_459634_ab_t000__h002_robetta.200.5mers.index.gz


If work is going out, why does this remain unchanged?

Tasks ready to send 29928

I don't know. Can you manually retry the download a few times and see if it clears. That's what I intermittently get with WCG and retries eventually clear it.
Otherwise, could it be your VPN? I've been seeing lots of problems with that recently with Norton installed. We've been having to turn the VPN off.
Failing that, try a reboot because I'm out of ideas tbh

Edit: Reading this thread again from the top, I'm suspicious of whether you're running Norton and have Secure VPN turned on. I have it on 3 or 4 of my PCs and it's fine on all but one, which is constantly restarting Secure VPN and it's knocking out our email and access to web pages in a really weird way. Turning it off and turning off Auto VPN is an immediate solution. No idea why it's happening on that one but not all the others.
ID: 107817 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jean-David Beyer

Send message
Joined: 2 Nov 05
Posts: 178
Credit: 5,764,598
RAC: 3,996
Message 107818 - Posted: 17 Dec 2022, 0:44:57 UTC - in response to Message 107817.  

I don't know. Can you manually retry the download a few times and see if it clears. That's what I intermittently get with WCG and retries eventually clear it.
Otherwise, could it be your VPN? I've been seeing lots of problems with that recently with Norton installed. We've been having to turn the VPN off.
Failing that, try a reboot because I'm out of ideas tbh

Edit: Reading this thread again from the top, I'm suspicious of whether you're running Norton and have Secure VPN turned on. I have it on 3 or 4 of my PCs and it's fine on all but one, which is constantly restarting Secure VPN and it's knocking out our email and access to web pages in a really weird way. Turning it off and turning off Auto VPN is an immediate solution. No idea why it's happening on that one but not all the others.


i retry them several times each, each time I get bored, and have for more than a day now. Not only does it not clear all of them, it does not clear any of them. I have a problem sometimes with WCG when it has ARP1 tasks to download. But not like this current problem with Rosetta.

I rebooted this morning since I needed to accept some updates. It made no difference at all.

I do not have a VPN and I have nothing by Norton on my machine at all.
ID: 107818 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
1 · 2 · 3 · 4 . . . 6 · Next

Message boards : Number crunching : Problen downloading work tasks.



©2024 University of Washington
https://www.bakerlab.org