Problems and Technical Issues with Rosetta@home

Message boards : Number crunching : Problems and Technical Issues with Rosetta@home

To post messages, you must log in.

Previous · 1 . . . 127 · 128 · 129 · 130 · 131 · 132 · 133 . . . 309 · Next

AuthorMessage
Sid Celery

Send message
Joined: 11 Feb 08
Posts: 2141
Credit: 41,534,988
RAC: 10,560
Message 103123 - Posted: 7 Nov 2021, 13:45:32 UTC - in response to Message 103120.  

At that specific point in time, yes, though in the last 10 days I've only had 30hrs at home on SunMon (15hrs asleep) and 10hrs on Weds night (6 asleep). I'm away now until Sunday as well... <sigh>
But I now think it's solved following a long chat with tech support.

Confirmed now I'm finally home.
Back in the land of the living
ID: 103123 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1725
Credit: 18,408,362
RAC: 20,061
Message 103178 - Posted: 12 Nov 2021, 6:07:16 UTC
Last modified: 12 Nov 2021, 6:19:21 UTC

Something's broken again.
Not picking up any work at all, even though the Server Status pages shows there's still plenty waiting to be done, looks like it's been an issue for about 3 hours now.

Usually it wouldn't be such an urgent issue when it takes 8 hours to do a Task, but with all these short running Tasks, i'm almost out of work already.


Edit- looks like they've been mucking around with the server again- i'm getting Virtual Box is not installed messages in my Event log again. I don't want to do Python, so i don't need Virtual Box. Just because i don't have virtual Box doesn't mean they should stop sending out Rosetta 4.20 Tasks to my systems. The very same issue we had towards the end of September.

Work in progress has dropped by just over 20% already.
Grant
Darwin NT
ID: 103178 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Bryn Mawr

Send message
Joined: 26 Dec 18
Posts: 400
Credit: 12,294,748
RAC: 6,222
Message 103179 - Posted: 12 Nov 2021, 6:32:18 UTC - in response to Message 103178.  

Something's broken again.
Not picking up any work at all, even though the Server Status pages shows there's still plenty waiting to be done, looks like it's been an issue for about 3 hours now.

Usually it wouldn't be such an urgent issue when it takes 8 hours to do a Task, but with all these short running Tasks, i'm almost out of work already.


Edit- looks like they've been mucking around with the server again- i'm getting Virtual Box is not installed messages in my Event log again. I don't want to do Python, so i don't need Virtual Box. Just because i don't have virtual Box doesn't mean they should stop sending out Rosetta 4.20 Tasks to my systems. The very same issue we had towards the end of September.

Work in progress has dropped by just over 20% already.
ID: 103179 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Bryn Mawr

Send message
Joined: 26 Dec 18
Posts: 400
Credit: 12,294,748
RAC: 6,222
Message 103180 - Posted: 12 Nov 2021, 6:33:25 UTC - in response to Message 103179.  

Something's broken again.
Not picking up any work at all, even though the Server Status pages shows there's still plenty waiting to be done, looks like it's been an issue for about 3 hours now.

Usually it wouldn't be such an urgent issue when it takes 8 hours to do a Task, but with all these short running Tasks, i'm almost out of work already.


Edit- looks like they've been mucking around with the server again- i'm getting Virtual Box is not installed messages in my Event log again. I don't want to do Python, so i don't need Virtual Box. Just because i don't have virtual Box doesn't mean they should stop sending out Rosetta 4.20 Tasks to my systems. The very same issue we had towards the end of September.

Work in progress has dropped by just over 20% already.


It’s not sending out Python either. 4,999 waiting 2 hours ago, 4,999 waiting now.
ID: 103180 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1725
Credit: 18,408,362
RAC: 20,061
Message 103185 - Posted: 12 Nov 2021, 10:24:41 UTC - in response to Message 103180.  

Something's broken again.
Not picking up any work at all, even though the Server Status pages shows there's still plenty waiting to be done, looks like it's been an issue for about 3 hours now.

Usually it wouldn't be such an urgent issue when it takes 8 hours to do a Task, but with all these short running Tasks, i'm almost out of work already.


Edit- looks like they've been mucking around with the server again- i'm getting Virtual Box is not installed messages in my Event log again. I don't want to do Python, so i don't need Virtual Box. Just because i don't have virtual Box doesn't mean they should stop sending out Rosetta 4.20 Tasks to my systems. The very same issue we had towards the end of September.

Work in progress has dropped by just over 20% already.


It’s not sending out Python either. 4,999 waiting 2 hours ago, 4,999 waiting now.
Okaaay.
Just checked the Server Status again, and now it appears were are not getting any Rosetta 4.20 Tasks, because the 2.5 million that were there to be sent out, aren't there any more. Although they were there when Rosetta 4.20 work initially stopped being sent out (or at least the Server Status page thought so).
WTF?

And if we are out of Rosetta 4.20 Tasks, why aren't Python Tasks still being sent out to those that can process them?
Has anyone with VirtualBox installed picked up any in the last 6 hours or so?
Grant
Darwin NT
ID: 103185 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Bryn Mawr

Send message
Joined: 26 Dec 18
Posts: 400
Credit: 12,294,748
RAC: 6,222
Message 103186 - Posted: 12 Nov 2021, 10:25:03 UTC - in response to Message 103180.  

Something's broken again.
Not picking up any work at all, even though the Server Status pages shows there's still plenty waiting to be done, looks like it's been an issue for about 3 hours now.

Usually it wouldn't be such an urgent issue when it takes 8 hours to do a Task, but with all these short running Tasks, i'm almost out of work already.


Edit- looks like they've been mucking around with the server again- i'm getting Virtual Box is not installed messages in my Event log again. I don't want to do Python, so i don't need Virtual Box. Just because i don't have virtual Box doesn't mean they should stop sending out Rosetta 4.20 Tasks to my systems. The very same issue we had towards the end of September.

Work in progress has dropped by just over 20% already.


It’s not sending out Python either. 4,999 waiting 2 hours ago, 4,999 waiting now.


OK, maybe that’s not quite accurate. Since 04:00 UTC I’ve picked up 3 degrader retries and the queued figure has dropped by just over 2,000 (to 2,315,344). The waiting to send figures are 0 and 4,990 so some are making their way across but few and far between.
ID: 103186 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Falconet

Send message
Joined: 9 Mar 09
Posts: 354
Credit: 1,276,393
RAC: 2,018
Message 103187 - Posted: 12 Nov 2021, 10:57:54 UTC

I booted up my desktop and got 3 Python tasks.
No Rosetta 4.20 tasks.

Seems like we ran out of Rosetta 4.20 and all that's left are Python tasks?
ID: 103187 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jim1348

Send message
Joined: 19 Jan 06
Posts: 881
Credit: 52,257,545
RAC: 0
Message 103188 - Posted: 12 Nov 2021, 11:15:25 UTC - in response to Message 103187.  

Seems like we ran out of Rosetta 4.20 and all that's left are Python tasks?

Yes, same for me on all three of my Rosetta machines set up to run the Pythons.
That is OK with me, and it simplifies things a bit.
ID: 103188 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Bryn Mawr

Send message
Joined: 26 Dec 18
Posts: 400
Credit: 12,294,748
RAC: 6,222
Message 103189 - Posted: 12 Nov 2021, 11:19:28 UTC - in response to Message 103187.  

I booted up my desktop and got 3 Python tasks.
No Rosetta 4.20 tasks.

Seems like we ran out of Rosetta 4.20 and all that's left are Python tasks?


Not run out of - they’re sat sitting there but not getting across to the download queue for delivery.
ID: 103189 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Falconet

Send message
Joined: 9 Mar 09
Posts: 354
Credit: 1,276,393
RAC: 2,018
Message 103190 - Posted: 12 Nov 2021, 11:37:58 UTC - in response to Message 103189.  

I booted up my desktop and got 3 Python tasks.
No Rosetta 4.20 tasks.

Seems like we ran out of Rosetta 4.20 and all that's left are Python tasks?


Not run out of - they’re sat sitting there but not getting across to the download queue for delivery.



What I meant was that maybe the 2.3 million queued tasks are Python tasks?
ID: 103190 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Bryn Mawr

Send message
Joined: 26 Dec 18
Posts: 400
Credit: 12,294,748
RAC: 6,222
Message 103192 - Posted: 12 Nov 2021, 12:53:36 UTC - in response to Message 103190.  

I booted up my desktop and got 3 Python tasks.
No Rosetta 4.20 tasks.

Seems like we ran out of Rosetta 4.20 and all that's left are Python tasks?


Not run out of - they’re sat sitting there but not getting across to the download queue for delivery.



What I meant was that maybe the 2.3 million queued tasks are Python tasks?


Always possible - I’d be surprised but it is possible :-)
ID: 103192 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Falconet

Send message
Joined: 9 Mar 09
Posts: 354
Credit: 1,276,393
RAC: 2,018
Message 103193 - Posted: 12 Nov 2021, 14:34:23 UTC - in response to Message 103192.  

I booted up my desktop and got 3 Python tasks.
No Rosetta 4.20 tasks.

Seems like we ran out of Rosetta 4.20 and all that's left are Python tasks?


Not run out of - they’re sat sitting there but not getting across to the download queue for delivery.



What I meant was that maybe the 2.3 million queued tasks are Python tasks?


Always possible - I’d be surprised but it is possible :-)



I'll admit that if they are Python tasks, then it's a very large number.
ID: 103193 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jim1348

Send message
Joined: 19 Jan 06
Posts: 881
Credit: 52,257,545
RAC: 0
Message 103195 - Posted: 12 Nov 2021, 17:03:36 UTC - in response to Message 103193.  

I'll admit that if they are Python tasks, then it's a very large number.

It is a bit of a surprise, but I think possible. The total numbers have been going down for a week or two, but the percentage of pythons running on my machines has increased steadily for the last two or three days. That indicates to me that they are running out of the regular Rosettas, and are leaving us the pythons.

If it keeps up, I will buy more memory. It is cheap now. I expect they are gearing up to produce the DDR5, and are selling off the DDR4.
ID: 103195 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5691
Credit: 5,859,226
RAC: 0
Message 103197 - Posted: 12 Nov 2021, 17:38:50 UTC

Tasks by application
Application Unsent In progress Runtime of last 100 tasks in hours: average, min, max Users in last 24 hours
Rosetta 0 181572 3.49 (0.09 - 121.97) 13398
Rosetta Mini 0 0 --- 0
rosetta python projects 5000 16398 4.53 (0.02 - 106.2) 1068

Total queued jobs: 2,310,336 ?!?!?!?!
1737 GMT
ID: 103197 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile mmstick

Send message
Joined: 4 Dec 12
Posts: 8
Credit: 606,792
RAC: 0
Message 103200 - Posted: 12 Nov 2021, 19:14:01 UTC

Anyone else not getting assigned tasks suddenly?

Requesting new tasks for CPU
Scheduler request completed: got 0 new tasks
No tasks sent


8-core Linux PC w/ 32 GB RAM
ID: 103200 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
MStenholm

Send message
Joined: 18 Apr 20
Posts: 18
Credit: 26,603,221
RAC: 19,190
Message 103202 - Posted: 12 Nov 2021, 19:34:01 UTC - in response to Message 103200.  
Last modified: 12 Nov 2021, 19:38:50 UTC

Nobody is getting work atm is my guess based on the 12 messages above.
ID: 103202 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5691
Credit: 5,859,226
RAC: 0
Message 103203 - Posted: 12 Nov 2021, 19:47:13 UTC

Once again...RAH is dead and no information from the project. So typical.
ID: 103203 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Tomcat雄猫

Send message
Joined: 20 Dec 14
Posts: 180
Credit: 5,386,173
RAC: 0
Message 103204 - Posted: 12 Nov 2021, 20:19:24 UTC - in response to Message 103203.  
Last modified: 12 Nov 2021, 20:26:44 UTC

I've got fresh work, all python WUs, though. There probably won't be any for the weekend.

I hate python WUs, I can only run one at a time with my setup. Worse, since I have really low cache settings, they clog up my cache and prevent other WUs from being downloaded.
ID: 103204 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jim1348

Send message
Joined: 19 Jan 06
Posts: 881
Credit: 52,257,545
RAC: 0
Message 103207 - Posted: 12 Nov 2021, 20:52:18 UTC - in response to Message 103204.  

I hate python WUs, I can only run one at a time with my setup. Worse, since I have really low cache settings, they clog up my cache and prevent other WUs from being downloaded.

True enough, you have to be prepared for them. But I think that is why they are sending them to us. The can do the other stuff in-house using the new AI techniques.
They send the hard experimental stuff to us.
ID: 103207 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1725
Credit: 18,408,362
RAC: 20,061
Message 103208 - Posted: 12 Nov 2021, 21:49:29 UTC - in response to Message 103197.  

Tasks by application
Application Unsent In progress Runtime of last 100 tasks in hours: average, min, max Users in last 24 hours
Rosetta 0 181572 3.49 (0.09 - 121.97) 13398
Rosetta Mini 0 0 --- 0
rosetta python projects 5000 16398 4.53 (0.02 - 106.2) 1068

Total queued jobs: 2,310,336 ?!?!?!?!1737 GMT
Yeah, there is something seriously screwed up with the servers.
It could be there are 2,308,226 queued jobs, but the feeder/splitters or whatever are borked & so they aren't being moved through to be allocated for processing, hence 0 Unsent Rosetta 4.20 Tasks.
Grant
Darwin NT
ID: 103208 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Previous · 1 . . . 127 · 128 · 129 · 130 · 131 · 132 · 133 . . . 309 · Next

Message boards : Number crunching : Problems and Technical Issues with Rosetta@home



©2024 University of Washington
https://www.bakerlab.org