Tasks using 4.07 - time remaning clock counting up

Message boards : Number crunching : Tasks using 4.07 - time remaning clock counting up

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5658
Credit: 5,670,291
RAC: 2,328
Message 91167 - Posted: 27 Sep 2019, 23:40:51 UTC

I can't run tasks using 4.07.
They get stuck and the status level does not move and the time remaining clock keeps counting up instead of down. So for now, anything 4.07 is being aborted.

Why do they contain the name "intel" in the the application?
What is the difference between these and the 3.78 that uses "windows"?

Another question, why doesn't my account view page allow us to select which version we want to run? So that I could opt out of 4.07 and get other tasks from other applications?
ID: 91167 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
nealburns5

Send message
Joined: 11 May 19
Posts: 37
Credit: 10,184,436
RAC: 0
Message 91170 - Posted: 28 Sep 2019, 15:00:14 UTC - in response to Message 91167.  

Why do they contain the name "intel" in the the application?
What is the difference between these and the 3.78 that uses "windows"?


"x86" and "intelx86" mean the same thing. "x86" refers to a line of CPUs that was invented by Intel.
ID: 91170 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5658
Credit: 5,670,291
RAC: 2,328
Message 91177 - Posted: 29 Sep 2019, 16:32:39 UTC - in response to Message 91167.  

I can't run tasks using 4.07.
They get stuck and the status level does not move and the time remaining clock keeps counting up instead of down. So for now, anything 4.07 is being aborted.

Why do they contain the name "intel" in the the application?
What is the difference between these and the 3.78 that uses "windows"?

Another question, why doesn't my account view page allow us to select which version we want to run? So that I could opt out of 4.07 and get other tasks from other applications?



OK...the Intel is answered.
But does anyone have an idea why some of the 4.07 remaining time count up and not down after reaching 50%? Also what is the typical run time of a 4.07 task? I have BOINC set on 6hr run times before switching tasks and I see most 4.07 tasks running 12-16 hrs. Well that's elapsed time. So the task has run 2 of my cycles so far and not completed, which I find odd. Any ideas?
ID: 91177 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 91181 - Posted: 30 Sep 2019, 19:17:54 UTC

Target runtime is configured by the user, default is 6 hours if you have not modified it.
Rosetta Moderator: Mod.Sense
ID: 91181 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 91182 - Posted: 30 Sep 2019, 19:21:07 UTC

Tasks like this one:
https://boinc.bakerlab.org/rosetta/result.php?resultid=1096093226

Show a lot of time passing by, but not a lot of actual CPU time. BOINC runs at low priority, is your machine busy running some higher priority work?


Computer ID 3433065
Run time 18 hours 53 min 37 sec
CPU time 5 hours 59 min 25 sec
Rosetta Moderator: Mod.Sense
ID: 91182 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5658
Credit: 5,670,291
RAC: 2,328
Message 91190 - Posted: 1 Oct 2019, 19:08:31 UTC - in response to Message 91182.  
Last modified: 1 Oct 2019, 19:55:36 UTC

Hey Mod!

No..the only other thing running is FAH to keep a graphics card busy.
Looking at Task Manager I see its using 44% CPU time.
Rosie is using a combined total of about 6%
Universe is taking about 10%

those are my big users.

That's the only outside the BOINC program running, otherwise everything is default.
All BOINC projects are 100% equal.
There are no modifying scripts for Rosie.
ID: 91190 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5658
Credit: 5,670,291
RAC: 2,328
Message 91193 - Posted: 1 Oct 2019, 20:12:25 UTC - in response to Message 91190.  

Note: Vbox is taking 41% when its running
ID: 91193 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 91194 - Posted: 1 Oct 2019, 22:35:26 UTC - in response to Message 91190.  

...otherwise everything is default.


Does that mean that you do not keep tasks in memory when suspended? When running a mix of projects, tasks often get suspended, but it doesn't have to mean that you lose the work that was in progress. I always suggest that you keep tasks in memory, and point out that it is not physically in memory, memory is virtual.

I'm not positive if any lost CPU seconds would be recorded. The BOINC Manager tries to avoid suspending tasks until after they take a checkpoint, so that helps a lot. But I think a task that is removed from memory and loses the last portion of work since any checkpoint, will also forget about the CPU time of the work it had in progress as well. So, this doesn't really explain what I quoted in the task.
Rosetta Moderator: Mod.Sense
ID: 91194 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5658
Credit: 5,670,291
RAC: 2,328
Message 91195 - Posted: 1 Oct 2019, 22:41:14 UTC - in response to Message 91194.  
Last modified: 1 Oct 2019, 22:43:51 UTC

leave non gpu tasks in memory is selected...any other ideas?

Just fyi, the clock is running normal lately, but the run time are super long as you see.

I'm 18 hrs into the most current task and it shows 17 hrs to completion.
Very odd. Unless I should bump the resources % up a few notches?
ID: 91195 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5658
Credit: 5,670,291
RAC: 2,328
Message 91197 - Posted: 2 Oct 2019, 19:39:22 UTC
Last modified: 2 Oct 2019, 19:40:42 UTC

So check this out: https://boinc.bakerlab.org/rosetta/result.php?resultid=1096093226
Run time 18 hours 53 min 37 sec
CPU time 5 hours 59 min 25 sec

But project is set for 100% as are all the others.

So....do I increase resource share to get Rosie back up to about the same level as the other projects that are 100% or what?

See all the details about how BOINC is set up below.

Resource share now 120%
ID: 91197 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 91198 - Posted: 2 Oct 2019, 20:59:47 UTC

You have now taken my original point. The question of "why is it taking 18 hours to get 6 hours of CPU time?"

The resource shares is really just deciding when to run each project and how much work to request. It is TRYING to run R@h for those 18hrs (or whatever exact number), but during that period of time only actually was able to get 6 hours of CPU time. It basically means that the BOINC Manager is showing the task in a "running" state for 18 hours, but if you were watching the Window tasks manager during that period of time, it would show the task only getting 33% of one core of one CPU.

Do you see BOINC Manager showing tasks "waiting for memory"?

You mentioned vbox, is BOINC running in a vbox? If so, how many cores and how much memory is available in the vbox?

You also mentioned "Rosie is using a combined total of about 6%", I was unclear exactly what you meant by this. When the R@h task is running, Windows task manager should show it using close to 100% of one CPU core (at least once passed the first minute or so of initial start-up time for a task, during which time it will not be using 100% of CPU yet).
Rosetta Moderator: Mod.Sense
ID: 91198 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
nealburns5

Send message
Joined: 11 May 19
Posts: 37
Credit: 10,184,436
RAC: 0
Message 91199 - Posted: 2 Oct 2019, 23:30:07 UTC

Greg_BE:

Try un-checking "Suspend when computer is in use" in "Computing preferences..." and see if that has any effect. I got better results after disabling that.

ID: 91199 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
nealburns5

Send message
Joined: 11 May 19
Posts: 37
Credit: 10,184,436
RAC: 0
Message 91200 - Posted: 2 Oct 2019, 23:37:04 UTC

Greg_BE:

I also installed BoincTasks and have found it useful for troubleshooting. BoincTasks allows you to monitor the cpu utilization in real time over a network.

Neal
ID: 91200 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5658
Credit: 5,670,291
RAC: 2,328
Message 91205 - Posted: 3 Oct 2019, 22:33:32 UTC - in response to Message 91199.  

Greg_BE:

Try un-checking "Suspend when computer is in use" in "Computing preferences..." and see if that has any effect. I got better results after disabling that.



That has never been checked.
ID: 91205 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5658
Credit: 5,670,291
RAC: 2,328
Message 91206 - Posted: 3 Oct 2019, 22:36:11 UTC - in response to Message 91198.  

You have now taken my original point. The question of "why is it taking 18 hours to get 6 hours of CPU time?"

The resource shares is really just deciding when to run each project and how much work to request. It is TRYING to run R@h for those 18hrs (or whatever exact number), but during that period of time only actually was able to get 6 hours of CPU time. It basically means that the BOINC Manager is showing the task in a "running" state for 18 hours, but if you were watching the Window tasks manager during that period of time, it would show the task only getting 33% of one core of one CPU.

Do you see BOINC Manager showing tasks "waiting for memory"?

You mentioned vbox, is BOINC running in a vbox? If so, how many cores and how much memory is available in the vbox?

You also mentioned "Rosie is using a combined total of about 6%", I was unclear exactly what you meant by this. When the R@h task is running, Windows task manager should show it using close to 100% of one CPU core (at least once passed the first minute or so of initial start-up time for a task, during which time it will not be using 100% of CPU yet).


Never known Rosie to use VBOX.
Boinc never says waiting for memory, I just put in another stick to deal with ATLAS tasks from LHC
The 6% was the total CPU time I was seeing in windows task manager.
I checked the graphics of one of the 4.07 units. 18 hrs run time, 2+ hrs CPU time.
Lots of pauses in the searching. It's like it is stalling.
I'll read more about what you said my tomorrow. its past midnight here now.
ID: 91206 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5658
Credit: 5,670,291
RAC: 2,328
Message 91207 - Posted: 4 Oct 2019, 11:28:43 UTC - in response to Message 91200.  

hey Neal,

Very cool! Much easier way to see whats going on.
Thanks for the recommendation.
ID: 91207 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5658
Credit: 5,670,291
RAC: 2,328
Message 91208 - Posted: 4 Oct 2019, 11:43:20 UTC
Last modified: 4 Oct 2019, 11:43:54 UTC

This is an extract from BOINC Tasks, so tell me what I am looking at in terms of Rosie vs the rest. Rosie is set for 120%, but I don't know if that gives it extra processing priority or what?
The system is a 8 core 16 thread AMD Ryzen 7 2700 chip. I am OC with automatic control to 39.25 GHZ with 24 GB of memory. I rarely go past 80% usage if even that when running ATLAS simultaneously with Rosie or other programs.

Image problems..will correct in a few hours.
ID: 91208 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5658
Credit: 5,670,291
RAC: 2,328
Message 91210 - Posted: 4 Oct 2019, 12:55:36 UTC
Last modified: 4 Oct 2019, 12:57:28 UTC

https://1drv.ms/u/s!AsKhVK_EPRXJgpNHq6GczXavstTj_w?e=YSHQGs

Goto this location to see the image. I can't get it to load.
ID: 91210 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5658
Credit: 5,670,291
RAC: 2,328
Message 91211 - Posted: 4 Oct 2019, 15:23:24 UTC

so...a 4.07 task has been running 11hrs and 24 minutes and has only 2 hrs 22 minutes cpu time.
BUT...it is only using 20.9% CPU usage, but what is weird is the cpu usage climbs each time BOINC tasks updates. So by the time you read this, it is using 30-31%.
Now a different 4.07 tasks is 9hrs elapsed time with 3:31 cpu time and 36% cpu usage.

The only consistant cpu to elapsed time task is a non Rosie task from both LHC and Einstein. Both are within 1hr of their cpu time.

So how do I get Rosie to act like those tasks?
Why are they using 94,98 and 107% and Rosie is only 20-40%?
All this is based on what BOINC tasks is reporting.
ID: 91211 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
nealburns5

Send message
Joined: 11 May 19
Posts: 37
Credit: 10,184,436
RAC: 0
Message 91212 - Posted: 4 Oct 2019, 16:47:56 UTC

Greg_BE:

The CPU utilization by default is a long moving average, so it changes slowly. I recommend going into the settings and disabling that so that you can see changes in CPU utilization faster.

ID: 91212 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
1 · 2 · Next

Message boards : Number crunching : Tasks using 4.07 - time remaning clock counting up



©2024 University of Washington
https://www.bakerlab.org