Problems and Technical Issues with Rosetta@home

Message boards : Number crunching : Problems and Technical Issues with Rosetta@home

To post messages, you must log in.

Previous · 1 . . . 128 · 129 · 130 · 131 · 132 · 133 · 134 . . . 280 · Next

AuthorMessage
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5664
Credit: 5,711,666
RAC: 626
Message 103197 - Posted: 12 Nov 2021, 17:38:50 UTC

Tasks by application
Application Unsent In progress Runtime of last 100 tasks in hours: average, min, max Users in last 24 hours
Rosetta 0 181572 3.49 (0.09 - 121.97) 13398
Rosetta Mini 0 0 --- 0
rosetta python projects 5000 16398 4.53 (0.02 - 106.2) 1068

Total queued jobs: 2,310,336 ?!?!?!?!
1737 GMT
ID: 103197 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile mmstick

Send message
Joined: 4 Dec 12
Posts: 8
Credit: 606,792
RAC: 0
Message 103200 - Posted: 12 Nov 2021, 19:14:01 UTC

Anyone else not getting assigned tasks suddenly?

Requesting new tasks for CPU
Scheduler request completed: got 0 new tasks
No tasks sent


8-core Linux PC w/ 32 GB RAM
ID: 103200 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
MStenholm

Send message
Joined: 18 Apr 20
Posts: 17
Credit: 23,074,153
RAC: 26,281
Message 103202 - Posted: 12 Nov 2021, 19:34:01 UTC - in response to Message 103200.  
Last modified: 12 Nov 2021, 19:38:50 UTC

Nobody is getting work atm is my guess based on the 12 messages above.
ID: 103202 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5664
Credit: 5,711,666
RAC: 626
Message 103203 - Posted: 12 Nov 2021, 19:47:13 UTC

Once again...RAH is dead and no information from the project. So typical.
ID: 103203 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Tomcat雄猫

Send message
Joined: 20 Dec 14
Posts: 180
Credit: 5,386,173
RAC: 598
Message 103204 - Posted: 12 Nov 2021, 20:19:24 UTC - in response to Message 103203.  
Last modified: 12 Nov 2021, 20:26:44 UTC

I've got fresh work, all python WUs, though. There probably won't be any for the weekend.

I hate python WUs, I can only run one at a time with my setup. Worse, since I have really low cache settings, they clog up my cache and prevent other WUs from being downloaded.
ID: 103204 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jim1348

Send message
Joined: 19 Jan 06
Posts: 881
Credit: 52,257,545
RAC: 0
Message 103207 - Posted: 12 Nov 2021, 20:52:18 UTC - in response to Message 103204.  

I hate python WUs, I can only run one at a time with my setup. Worse, since I have really low cache settings, they clog up my cache and prevent other WUs from being downloaded.

True enough, you have to be prepared for them. But I think that is why they are sending them to us. The can do the other stuff in-house using the new AI techniques.
They send the hard experimental stuff to us.
ID: 103207 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1507
Credit: 14,973,531
RAC: 21,811
Message 103208 - Posted: 12 Nov 2021, 21:49:29 UTC - in response to Message 103197.  

Tasks by application
Application Unsent In progress Runtime of last 100 tasks in hours: average, min, max Users in last 24 hours
Rosetta 0 181572 3.49 (0.09 - 121.97) 13398
Rosetta Mini 0 0 --- 0
rosetta python projects 5000 16398 4.53 (0.02 - 106.2) 1068

Total queued jobs: 2,310,336 ?!?!?!?!1737 GMT
Yeah, there is something seriously screwed up with the servers.
It could be there are 2,308,226 queued jobs, but the feeder/splitters or whatever are borked & so they aren't being moved through to be allocated for processing, hence 0 Unsent Rosetta 4.20 Tasks.
Grant
Darwin NT
ID: 103208 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
John McCallum
Avatar

Send message
Joined: 8 Jan 06
Posts: 12
Credit: 6,979,229
RAC: 7,273
Message 103209 - Posted: 12 Nov 2021, 22:01:47 UTC
Last modified: 12 Nov 2021, 22:02:39 UTC

Rosetta@home: Notice from server
VirtualBox is not installed
12/11/2021 12:38:57 ??
What does this mean?
If you can't take a joke you should never have joined.
ID: 103209 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Falconet

Send message
Joined: 9 Mar 09
Posts: 350
Credit: 1,052,467
RAC: 2,515
Message 103210 - Posted: 12 Nov 2021, 22:08:12 UTC - in response to Message 103209.  

It means you don't have VirtualBox installed on your PC and therefore you cannot run the Rosetta Python tasks which require Virtualbox.
ID: 103210 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1507
Credit: 14,973,531
RAC: 21,811
Message 103211 - Posted: 12 Nov 2021, 22:09:31 UTC - in response to Message 103209.  

Rosetta@home: Notice from server
VirtualBox is not installed
12/11/2021 12:38:57 ??
What does this mean?
Exactly what it says- it means you don't have VirtualBox installed, which is required to process Python Tasks. Rosetta 4.20 Tasks don't need VirtualBox in order to be processed.
Grant
Darwin NT
ID: 103211 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
stratos412

Send message
Joined: 18 Mar 20
Posts: 12
Credit: 133,642
RAC: 442
Message 103212 - Posted: 12 Nov 2021, 22:35:11 UTC

I am exerience the same problem as some of the other members.

"Rosetta@home | Message from server: VirtualBox jobs require hardware acceleration support. Your processor does not support the required instruction set."

VirtualBox is installed (version 6.1.12). Virtualization is enabled on BIOS and I can conifrm that is enabled on Win10 Task Manager too.
PC specs: https://boinc.bakerlab.org/rosetta/show_host_detail.php?hostid=5945561

Any ideas what is going wrong ?
ID: 103212 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile robertmiles

Send message
Joined: 16 Jun 08
Posts: 1225
Credit: 13,908,692
RAC: 3,097
Message 103213 - Posted: 12 Nov 2021, 22:49:02 UTC - in response to Message 103209.  

Rosetta@home: Notice from server
VirtualBox is not installed
12/11/2021 12:38:57 ??
What does this mean?

You can download and install BOINC either with or without VirtualBox. It looks like you installed it without VirtualBox and therefore need to download and install it again if you want any tasks that require VirtualBox.

Download BOINC client software

https://boinc.berkeley.edu/download_all.php
ID: 103213 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile robertmiles

Send message
Joined: 16 Jun 08
Posts: 1225
Credit: 13,908,692
RAC: 3,097
Message 103214 - Posted: 12 Nov 2021, 22:54:31 UTC - in response to Message 103212.  

I am exerience the same problem as some of the other members.

"Rosetta@home | Message from server: VirtualBox jobs require hardware acceleration support. Your processor does not support the required instruction set."

VirtualBox is installed (version 6.1.12). Virtualization is enabled on BIOS and I can conifrm that is enabled on Win10 Task Manager too.
PC specs: https://boinc.bakerlab.org/rosetta/show_host_detail.php?hostid=5945561

Any ideas what is going wrong ?

It could mean that the CPU of your computer doesn't support virtualization, or you have it turned off in the BIOS settings.

You could mention what model of computer you are running, so someone can tell you how to reach the BIOS settings,
ID: 103214 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile robertmiles

Send message
Joined: 16 Jun 08
Posts: 1225
Credit: 13,908,692
RAC: 3,097
Message 103215 - Posted: 12 Nov 2021, 23:04:24 UTC

I use an HP ENVY Desktop 795-0xxx.

It is now running only half as many tasks as usual, after a BIOS update, so virtualization is probably turned off.

How do I get into the BIOS settings so I can turn it back on?
ID: 103215 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1507
Credit: 14,973,531
RAC: 21,811
Message 103216 - Posted: 12 Nov 2021, 23:24:22 UTC - in response to Message 103215.  
Last modified: 12 Nov 2021, 23:25:26 UTC

I use an HP ENVY Desktop 795-0xxx.

It is now running only half as many tasks as usual, after a BIOS update, so virtualization is probably turned off.
Not Virtualisation, Hyperthreading.
Hyperthreading allows a single CPU core to appear as two.

However the most likely reason there are only half as many Tasks (at least for Rosetta), is because no new Rosetta 4.20 work is going out.



How do I get into the BIOS settings so I can turn it back on?
For most you tap the DEL key or F2 as it boots up. For HP it appears they use ESC or F10.
Reboot the system & start tapping the appropriate key (don't hold it down).
Once you're in the BOIS, check through the system settings till you find Hyperthreading, enable it, save & exit.



However, before you do that, bring up Task Manager, Performance Tab, CPU (Click on More details if these options aren't there). Down the bottom it should give you the number of Sockets, Cores & Logical processors. The number of Logical processors should be twice the number of Cores (Alder Lake is really going to complicate this).
And below that it will also show if Virtualisation is enabled or not.
Right click on the Graphs, change graph to Logical processors, will give you a CPU usage graph for each Logical processor.

If is shows 12 processors & Virtualisation is enabled, then there is no need to go in to the BIOS.
Grant
Darwin NT
ID: 103216 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile robertmiles

Send message
Joined: 16 Jun 08
Posts: 1225
Credit: 13,908,692
RAC: 3,097
Message 103217 - Posted: 13 Nov 2021, 2:42:15 UTC - in response to Message 103216.  
Last modified: 13 Nov 2021, 2:44:21 UTC

I use an HP ENVY Desktop 795-0xxx.

It is now running only half as many tasks as usual, after a BIOS update, so virtualization is probably turned off.
Not Virtualisation, Hyperthreading.
Hyperthreading allows a single CPU core to appear as two.

However the most likely reason there are only half as many Tasks (at least for Rosetta), is because no new Rosetta 4.20 work is going out.



How do I get into the BIOS settings so I can turn it back on?
For most you tap the DEL key or F2 as it boots up. For HP it appears they use ESC or F10.
Reboot the system & start tapping the appropriate key (don't hold it down).
Once you're in the BOIS, check through the system settings till you find Hyperthreading, enable it, save & exit.



However, before you do that, bring up Task Manager, Performance Tab, CPU (Click on More details if these options aren't there). Down the bottom it should give you the number of Sockets, Cores & Logical processors. The number of Logical processors should be twice the number of Cores (Alder Lake is really going to complicate this).
And below that it will also show if Virtualisation is enabled or not.
Right click on the Graphs, change graph to Logical processors, will give you a CPU usage graph for each Logical processor.

If is shows 12 processors & Virtualisation is enabled, then there is no need to go in to the BIOS.

You're right. It shows 12 virtual processors and virtualization and hyperthreading are both enabled. I've already downloaded a few more tasks from another BOINC project, but only 3 tasks are running. It appears that the python tasks reserve much more of something than I'd expect, and therefore not much else will run at the same time, Probably memory - each of the two python tasks I have running at once appears to reserve 7,45 GB of memory.
ID: 103217 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1507
Credit: 14,973,531
RAC: 21,811
Message 103218 - Posted: 13 Nov 2021, 3:33:55 UTC - in response to Message 103217.  
Last modified: 13 Nov 2021, 3:44:35 UTC

I've already downloaded a few more tasks from another BOINC project, but only 3 tasks are running. It appears that the python tasks reserve much more of something than I'd expect, and therefore not much else will run at the same time, Probably memory - each of the two python tasks I have running at once appears to reserve 7,45 GB of memory.
A familiar complaint from those that do Python work- the extreme memory requirements just to run a single Task.
There is no way on earth it needs 7.5GB of RAM to process each individual Python Task, and it still needs to leave enough for the host OS & it's running programmes to continue to function.
End result- most systems will only be able to run 1 or 2 Python Tasks at a time (if that), and not much else, and even those with oodles of RAM still won't be able to do much more due to the 7.5GB requirement.


The Project needs to fix up their implementation of VirtualBox. I'm quite sure it should be possible to set up a VM of only a few hundred MB in size, plus the needs of the Task being done (200MB to 1.4GB, at least for Rosetta 4.20 Tasks).
A quick search shows that VirtualBox itself only needs 512MB to run- so you'd be looking at 512MB for Vbox, plus whatever the Virtual Machine needs (what VM are they using- how much RAM does it need?). plus the needs for the Python application & Task (however much the Python Tasks may need).
So my WAG guess is you'd need 0.5GB+2GB minimum for each Python Task being processed plus 2GB Min for the host OS.

So lets say 3GB RAM per Python Task, which is a whole lot less than 7.5GB.
Or the project just develops native applications to process the Python Task data. They'd get a lot more work done.


Edit- Having said all that, taking a look around it's generally considered that if you are going to run more than a couple of VMs, you're going to have upwards of 32GB of RAM on the host system.
Grant
Darwin NT
ID: 103218 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile robertmiles

Send message
Joined: 16 Jun 08
Posts: 1225
Credit: 13,908,692
RAC: 3,097
Message 103219 - Posted: 13 Nov 2021, 4:03:49 UTC - in response to Message 103218.  

[snip]
So lets say 3GB RAM per Python Task, which is a whole lot less than 7.5GB.
Or the project just develops native applications to process the Python Task data. They'd get a lot more work done.

Edit- Having said all that, taking a look around it's generally considered that if you are going to run more than a couple of VMs, you're going to have upwards of 32GB of RAM on the host system.

If 3 GB was adequate, they could use 32-bit versions of Python, which CAN'T use more than 4 GB of memory.

After I get further in recovering from two computer failures, I'll consider ordering more memory.

Can they adjust the virtual machines so that they don't allow changing certain regions of memory, so that those regions can be shared between all of the virtual machines that can use them?
ID: 103219 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1507
Credit: 14,973,531
RAC: 21,811
Message 103220 - Posted: 13 Nov 2021, 4:51:29 UTC - in response to Message 103219.  

If 3 GB was adequate, they could use 32-bit versions of Python, which CAN'T use more than 4 GB of memory.
From the very few Python Tasks i've seen, they use much, much less.
The main reason for having 64bit applications, is because all current Operating Systems are 64bit.



Can they adjust the virtual machines so that they don't allow changing certain regions of memory, so that those regions can be shared between all of the virtual machines that can use them?
That is pretty much what the VM Manager (in this case VirtualBox) does. It allows VMs to be created, allocates them their resources, then lets them do whatever it is the programme(s) they are running do.
VMs can ask for more RAM, and the VM Manager can allocate it (if it's available). But as to what level VirtualBox supports the re-allocation of RAM after a VM is created, i don't know. I suspect the value being used at present when a VM is created is a hard lower limit, so even if it never gets close to being used, it's still not available for other VMs to use.
Hence the issues people are having with memory requirements.
Grant
Darwin NT
ID: 103220 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
doug

Send message
Joined: 28 Mar 20
Posts: 8
Credit: 1,362,366
RAC: 2,038
Message 103221 - Posted: 13 Nov 2021, 7:08:22 UTC

Hi,

I am also now getting this message in the Event Log for Rosetta: "Message from server: VirtualBox jobs require hardware acceleration support. Your processor does not support the required instruction set." This apparently started in the last couple of days, maybe even today.

I have been running R@H for over 1.5 years, usually 24 hrs a day, with no problems, VirtualBox or otherwise. Could something have changed very recently with R@H to cause this? Does anyone have any idea (besides not have VB) what could suddenly cause this?

Thanks.

Doug
ID: 103221 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Previous · 1 . . . 128 · 129 · 130 · 131 · 132 · 133 · 134 . . . 280 · Next

Message boards : Number crunching : Problems and Technical Issues with Rosetta@home



©2024 University of Washington
https://www.bakerlab.org