Problems and Technical Issues with Rosetta@home

Message boards : Number crunching : Problems and Technical Issues with Rosetta@home

To post messages, you must log in.

Previous · 1 . . . 223 · 224 · 225 · 226 · 227 · 228 · 229 . . . 309 · Next

AuthorMessage
Profile robertmiles

Send message
Joined: 16 Jun 08
Posts: 1234
Credit: 14,338,560
RAC: 2,014
Message 106720 - Posted: 7 Aug 2022, 0:15:34 UTC - in response to Message 106718.  
Last modified: 7 Aug 2022, 0:17:06 UTC

[snip]

Thanks I run several projects at once. I haven't noticed any missed deadlines, unless I go on vacation or something. As fa as I know the project sends the number of WUs it thinks I can handle. Anyway, why are there no WUs? All I get are Einstein and Milkyway WUs.


A few possibilities:

1. All the remaining workunits are set up to run only under operating systems other than the one you're using.

2. You didn't get many from the Einstein and Milkyway projects for a while, and now BOINC is requesting more from them to make up.

3, The Rosetta server has decided that tasks sent to your computer are too likely to fail, and therefore it should avoid sending any more.
ID: 106720 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 12,116,986
RAC: 9,863
Message 106721 - Posted: 7 Aug 2022, 0:17:44 UTC - in response to Message 106720.  

3, The Rosetta server has decided that tasks sent to your computer are too likely to fail, and therefore it should avoid sending any more.
This is most likely. And "too likely" can mean you failed one single task.
ID: 106721 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1725
Credit: 18,382,444
RAC: 19,446
Message 106722 - Posted: 7 Aug 2022, 0:20:29 UTC - in response to Message 106711.  
Last modified: 7 Aug 2022, 0:21:17 UTC

Thanks for helping but I opened my account, opened my computer and details but I don't see anything about allowing Python WUs. I take it these files must be very large. What would be a good cache size to manage these files?

As kotenok2000 posted with their screen shot, down the bottom of the page are Virtual Box VM jobs. If the box say Allow (or Enable or whatever) then you need to click it to get those Tasks again.
Grant
Darwin NT
ID: 106722 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile robertmiles

Send message
Joined: 16 Jun 08
Posts: 1234
Credit: 14,338,560
RAC: 2,014
Message 106723 - Posted: 7 Aug 2022, 0:25:46 UTC - in response to Message 106719.  
Last modified: 7 Aug 2022, 0:31:04 UTC

[snip]

Some projects give stupid estimates for time. For example Einstein CPU tasks take me 8 hours on a fast computer and a day and a half on a slow computer. Yet on the slow computer they start off by saying estimated 2 hours, so they download way more than they can do on time.

GPUGRID is worse - all task start out with an expected runtime of about 400 days, and a deadline more like a week.

This usually gives them the highest priority for GPU use at first. Once they get progress enough to have an expected remaining time of about half a day, they'll let other GPU tasks run instead. Actual run time is seldom more than five and a half days.

Another peculiarity of GPUGRID tasks - if they resume from a checkpoint, they will initially show a progress no more than 2%. This will be corrected when the next checkpoint is written.
ID: 106723 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 12,116,986
RAC: 9,863
Message 106724 - Posted: 7 Aug 2022, 0:33:32 UTC - in response to Message 106723.  

GPUGRID is worse - all task start out with an expected runtime of about 400 days, and a deadline more like a week.

This usually gives them the highest priority for GPU use at first. Once they get progress enough to have an expected remaining time of about half a day, they'll let other GPU tasks run instead. Actual run time is seldom more than five and a half days.

Another peculiarity of GPUGRID tasks - if they resume from a checkpoint, they will initially show a progress no more than 2%. This will be corrected when the next checkpoint is written.
And CPDN give a deadline of 1 year, even though they want them in 1 month. I told them how stupid this was but they didn't want to get in the way of other projects. I explained my computers just leave them and do other stuff depending on what other projects they're attached to, but they didn't understand. I give up talking to imbeciles.
ID: 106724 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Tomcat雄猫

Send message
Joined: 20 Dec 14
Posts: 180
Credit: 5,386,173
RAC: 0
Message 106726 - Posted: 7 Aug 2022, 5:51:59 UTC

I have 7 Rosetta Python tasks, but Rosetta is taking up a whopping 61.77 GB of disk space.

Is this normal?
ID: 106726 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jim1348

Send message
Joined: 19 Jan 06
Posts: 881
Credit: 52,257,545
RAC: 0
Message 106727 - Posted: 7 Aug 2022, 6:16:55 UTC - in response to Message 106726.  
Last modified: 7 Aug 2022, 6:17:32 UTC

I have 7 Rosetta Python tasks, but Rosetta is taking up a whopping 61.77 GB of disk space.

Is this normal?

Yes. On my Ryzen 3900X for example, when I wanted to run 18 or more Pythons, I had to increase the SSD from 250 GB to 500 GB.
So that is what I buy as standard now.
ID: 106727 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5691
Credit: 5,859,226
RAC: 0
Message 106729 - Posted: 7 Aug 2022, 13:59:26 UTC - in response to Message 106727.  

I have 7 Rosetta Python tasks, but Rosetta is taking up a whopping 61.77 GB of disk space.

Is this normal?

Yes. On my Ryzen 3900X for example, when I wanted to run 18 or more Pythons, I had to increase the SSD from 250 GB to 500 GB.
So that is what I buy as standard now.


I have a dedicated 500GB drive due to Rosies increased appetite for disk space, plus I had to increase my RAM due to Python being so big. But now it seems they have shrunk the memory requirements or maybe since I don't run RAH on all the cores, my memory requirements have gone down. Even with running LHC ATLAS.
ID: 106729 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 12,116,986
RAC: 9,863
Message 106730 - Posted: 7 Aug 2022, 15:15:11 UTC - in response to Message 106729.  
Last modified: 7 Aug 2022, 15:16:06 UTC

Yes. On my Ryzen 3900X for example, when I wanted to run 18 or more Pythons, I had to increase the SSD from 250 GB to 500 GB.
So that is what I buy as standard now.
I have a dedicated 500GB drive due to Rosies increased appetite for disk space, plus I had to increase my RAM due to Python being so big. But now it seems they have shrunk the memory requirements or maybe since I don't run RAH on all the cores, my memory requirements have gone down. Even with running LHC ATLAS.
I have a 1TB SSD on here, but that's for games and many applications too. On my Boinc only machines, I just have 128GB or 256GB. Admittedly the 24 core machines are at least 256. As for RAM I have 64GB on 24 core machines, they will take 128.
ID: 106730 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Squirrelly

Send message
Joined: 13 Dec 05
Posts: 9
Credit: 2,499,306
RAC: 1,786
Message 106732 - Posted: 7 Aug 2022, 21:03:47 UTC - in response to Message 106721.  

Oh well. I do have VB installed. If Rosetta is ruling out Windows 10 as an operating system to run on it would seem to be giving up on a lot of potential clients to run data on. I've been doing Rosetta for over 17 years and I've never run into anything like this so it seems rather improbable. So it's going to cut me off because I "failed" 1 WU after the almost 2,000,000 WUs I've processed over the years? I'm sure you realize what a prick and an asshole you sound like and are doing it on purpose. At any rate they aren't sending any more WUs my way so I am pulling the plug and disconnecting. I hope the WUs I processed did some good.
ID: 106732 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
kotenok2000
Avatar

Send message
Joined: 22 Feb 11
Posts: 272
Credit: 507,897
RAC: 334
Message 106733 - Posted: 7 Aug 2022, 21:04:35 UTC - in response to Message 106729.  

What if you compress slots directory with ntfs compression?
ID: 106733 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
kotenok2000
Avatar

Send message
Joined: 22 Feb 11
Posts: 272
Credit: 507,897
RAC: 334
Message 106735 - Posted: 7 Aug 2022, 22:02:27 UTC - in response to Message 106734.  
Last modified: 7 Aug 2022, 22:02:58 UTC

I run gtx 1650 and it completes python tasks in approximately 19 hours.
ID: 106735 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5691
Credit: 5,859,226
RAC: 0
Message 106736 - Posted: 7 Aug 2022, 22:04:14 UTC - in response to Message 106732.  

Oh well. I do have VB installed. If Rosetta is ruling out Windows 10 as an operating system to run on it would seem to be giving up on a lot of potential clients to run data on. I've been doing Rosetta for over 17 years and I've never run into anything like this so it seems rather improbable. So it's going to cut me off because I "failed" 1 WU after the almost 2,000,000 WUs I've processed over the years? I'm sure you realize what a prick and an asshole you sound like and are doing it on purpose. At any rate they aren't sending any more WUs my way so I am pulling the plug and disconnecting. I hope the WUs I processed did some good.



Look you can't just give up based on one failure and the system kicking you out.
That's just the way the damn thing is programmed until it gets to know what errors your system kicks out and also how many errors that particular protein is getting over all the tasks associated with it.
I had run of those kick you out after 1 or 2 despite it not being my fault or the task locks up and I have to abort it.
Now their system has learned my patterns it does not bother with kicking me out.

I looked at your account and there are no tasks to look at either good or bad.
So why not just reset your account like the guys have talked about and try running a few more.
If they error out then copy and paste the error message text from stderr file in the directory that the bad task was running in.

Python tasks here are finicky as is the server. You just have to keep beating it back into submission and you will finally win.
ID: 106736 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5691
Credit: 5,859,226
RAC: 0
Message 106737 - Posted: 7 Aug 2022, 22:07:11 UTC - in response to Message 106735.  

I run gtx 1650 and it completes python tasks in approximately 19 hours.

I run GPU and it takes 2 days at 14-16 hours per day to complete their python models. I run at 1050 and a 1080.
ID: 106737 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 12,116,986
RAC: 9,863
Message 106738 - Posted: 7 Aug 2022, 22:42:31 UTC - in response to Message 106732.  
Last modified: 7 Aug 2022, 22:43:10 UTC

Oh well. I do have VB installed. If Rosetta is ruling out Windows 10 as an operating system to run on it would seem to be giving up on a lot of potential clients to run data on. I've been doing Rosetta for over 17 years and I've never run into anything like this so it seems rather improbable. So it's going to cut me off because I "failed" 1 WU after the almost 2,000,000 WUs I've processed over the years? I'm sure you realize what a prick and an asshole you sound like and are doing it on purpose. At any rate they aren't sending any more WUs my way so I am pulling the plug and disconnecting. I hope the WUs I processed did some good.
I am both a prick and an arsehole especially when driving (not an asshole, that is a type of donkey, go back to school), but in this case I was helping you out. The only people being pricks are the ones running the server, and that isn't me.
ID: 106738 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
FritzTCoyote

Send message
Joined: 12 Jul 22
Posts: 1
Credit: 0
RAC: 0
Message 106743 - Posted: 10 Aug 2022, 0:26:35 UTC

Excessive Disk Space Usage.

I'm Getting tired of this message.
Rosetta@home: Notice from server
rosetta python projects needs 745.50MB more disk space. You currently have 18327.98 MB available and it needs 19073.49 MB.
8/9/2022 4:50:58 AM
That was with 90gb of SSD space allocated to BOINC.
No matter how much disk space I give to BOINC, Rosetta keeps asking for more.
This indicates a flaw in Rosetta's use of resources. So it is Banished from my rigs.
ID: 106743 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
.clair.

Send message
Joined: 2 Jan 07
Posts: 274
Credit: 26,399,595
RAC: 0
Message 106744 - Posted: 10 Aug 2022, 0:37:42 UTC - in response to Message 106743.  

Excessive Disk Space Usage.

I'm Getting tired of this message.
Rosetta@home: Notice from server
rosetta python projects needs 745.50MB more disk space. You currently have 18327.98 MB available and it needs 19073.49 MB.
8/9/2022 4:50:58 AM
That was with 90gb of SSD space allocated to BOINC.
No matter how much disk space I give to BOINC, Rosetta keeps asking for more.
This indicates a flaw in Rosetta's use of resources. So it is Banished from my rigs.

90GB , is that all read this fix
it was using 357GB of my ssd last time I ran python
and then I added a second so to make a raid 0 set to speed up those vdi file copy`s
ID: 106744 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
kotenok2000
Avatar

Send message
Joined: 22 Feb 11
Posts: 272
Credit: 507,897
RAC: 334
Message 106745 - Posted: 10 Aug 2022, 0:39:26 UTC - in response to Message 106744.  
Last modified: 10 Aug 2022, 0:39:45 UTC

What if you enable ntfs compression on slots directory?
ID: 106745 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 12,116,986
RAC: 9,863
Message 106746 - Posted: 10 Aug 2022, 0:46:16 UTC - in response to Message 106743.  
Last modified: 10 Aug 2022, 0:49:38 UTC

Excessive Disk Space Usage.

I'm Getting tired of this message.
Rosetta@home: Notice from server
rosetta python projects needs 745.50MB more disk space. You currently have 18327.98 MB available and it needs 19073.49 MB.
8/9/2022 4:50:58 AM
That was with 90gb of SSD space allocated to BOINC.
No matter how much disk space I give to BOINC, Rosetta keeps asking for more.
This indicates a flaw in Rosetta's use of resources. So it is Banished from my rigs.
Are you from the 90s? We use larger files now. This computer has 1000GB NVME and 4000GB hard disk.

On that note I was tidying out some drawers in the garage and found some 64kbit RAM chips, 16 pin DIL, along with an Intel CPU from 1978 and an Amstrad from 1983. I threw all those out and kept the 555 timers, flipflops, and 7-segment LED drivers, they're still handy.

Christ, this guy is still trying to sell them! https://www.ebay.co.uk/itm/Amstrad-40078-28-pin-DIP-vintage-integrated-circuit-/391903210582
ID: 106746 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
SubwayDawg
Avatar

Send message
Joined: 24 Aug 06
Posts: 1
Credit: 6,634,558
RAC: 0
Message 106751 - Posted: 10 Aug 2022, 14:01:49 UTC - in response to Message 106746.  
Last modified: 10 Aug 2022, 14:06:16 UTC

I feel your pain. The space issue is starving other projects.

I'm currently running five Rosetta tasks. These will probably my last ones as I'm not planning to fetch any more after these are done. Maybe we should move to Folding@home - they do something similar.

So long, and thanks for all the fish.

ID: 106751 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Previous · 1 . . . 223 · 224 · 225 · 226 · 227 · 228 · 229 . . . 309 · Next

Message boards : Number crunching : Problems and Technical Issues with Rosetta@home



©2024 University of Washington
https://www.bakerlab.org