Message boards : Number crunching : Lots of computer time, little credit
Author | Message |
---|---|
Werinbert Send message Joined: 22 Jul 13 Posts: 4 Credit: 1,001,196 RAC: 0 |
Task in question: https://boinc.bakerlab.org/rosetta/result.php?resultid=1431763806 So what was Rosetta doing with all that computer time allocated to it if not for crunching? I know that if given a task and it takes longer than the prescribed time, it will just run longer. But if for whatever reason I am given a task that takes a lot less than the asked for 8 hours, will the app merely spin its wheels to take up the allotted time? If the app was actually crunching during that time why are the credits so low? |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1681 Credit: 17,854,150 RAC: 22,647 |
Task in question: https://boinc.bakerlab.org/rosetta/result.php?resultid=1431763806It wasn't doing anything- some other programme on your computer was using that extra time. That's why it took over 9 hours (Run time) to do 8 hours worth of work (CPU Time)- which is the case for all of your Rosetta Tasks- it takes much more Run time than CPU to complete a Task. Check the Run time v CPU time for my systems for a comparison. It is the same for Prime Grid- it takes that system 19 hours to do 10 hours worth of work on a Task there. Have a look in Task Manager & see what it is that's eating up all of your CPU time. If the app was actually crunching during that time why are the credits so low?No idea why that is. It is a new host, and it can take a while for Credit to settle down (usually 10 or so Valid Tasks), but even so that's an exceptionally low amount of Credit. Grant Darwin NT |
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
Task in question: https://boinc.bakerlab.org/rosetta/result.php?resultid=1431763806It wasn't doing anything- some other programme on your computer was using that extra time. That's why it took over 9 hours (Run time) to do 8 hours worth of work (CPU Time)- which is the case for all of your Rosetta Tasks- it takes much more Run time than CPU to complete a Task. Check the Run time v CPU time for my systems for a comparison. I have the same CPU as you and my runtimes are similar as are my credits. I had a TAU task that took 9 hrs for 8 hours of work. I have all 16 cores allocated to BOINC, nothing running in the background other than the basics for the system and a browser for FB and a browser for Email which sit idle. To run 9 hrs for 8hrs work or 7hrs for 6hrs work is just normal with our systems. I have never seen anything different in my time on here. Your one task that gave you 3 credits only generated 16 models. That's pretty odd. I ran one task for 7hrs, generated 1 model and got only 107 credits. Your 5.5 credits task bombed with an internal error. You were lucky to be granted credit for that. Another task from the group 5nvx_graft_buwei bombed with the same error, but you got 58 credits for that. You ran a 4hr (3 cpu) VM task and got 177 credits for that. If you had run double as long you would have got your usal average of around 350 credits. I don't see anything abnormal in your work compared to my work. |
Werinbert Send message Joined: 22 Jul 13 Posts: 4 Credit: 1,001,196 RAC: 0 |
It is a new host, and it can take a while for Credit to settle down (usually 10 or so Valid Tasks), but even so that's an exceptionally low amount of Credit. Yes, it is a new host but all the rest of the task have been ball park consistent in the credits granted. And the typical task's cr/hr is what I have come to expect from this host. But this one task was granted only 1/100th of the credit expected. (I am not worried about the runtime vs CPU time....I am pushing that computer pretty hard with other projects, so just look at the CPU time used.) Your one task that gave you 3 credits only generated 16 models. That's pretty odd. I ran one task for 7hrs, generated 1 model and got only 107 credits. I don't think the number of models makes that much of a difference, I have tasks running from 20 to 2000 structures all returning a typical 350+/- credits. As to the two errors tasks, even they are producing the same cr/hr as my other tasks. It is just this one task that is so grossly off the expected cr/hr. |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1681 Credit: 17,854,150 RAC: 22,647 |
To run 9 hrs for 8hrs work or 7hrs for 6hrs work is just normal with our systems.No it isn't. It just means that something else is making significant use of the CUPU while Rosetta is running. eg This Ryzen 7 3700X system has good CPU time v Run time numbers. Run time 8 hours 0 min 41 sec CPU time 7 hours 59 min 5 sectau_site11_7nrq_graft_bcov_v1_xad_SAVE_ALL_OUT_IGNORE_THE_REST_2jt0hl2g_1824323_1_0 Grant Darwin NT |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1681 Credit: 17,854,150 RAC: 22,647 |
And as i mentioned, it is an exceptionally low amount.It is a new host, and it can take a while for Credit to settle down (usually 10 or so Valid Tasks), but even so that's an exceptionally low amount of Credit.Yes, it is a new host but all the rest of the task have been ball park consistent in the credits granted. And the typical task's cr/hr is what I have come to expect from this host. But this one task was granted only 1/100th of the credit expected. If it occurs again then it would be worth bringing it back up & seeing if the project will take a look at it, otherwise just write it off as a once off anomaly that occurred for whatever reason. (I am not worried about the runtime vs CPU time....I am pushing that computer pretty hard with other projects, so just look at the CPU time used.)Your choice, however it just means your system is overcommitted, and you won't get as much from it as it is capable of. Fair enough if you are running something such as transcoding video or Folding@home or similar non-BOINC work which does make heavy use of the CPU , but otherwise it just means that your CPU is busy doing something other than processing BOINC work- running multiple other BOINC CPU projects at the same time won't cause a big difference in Run time v CPU time unless one of the projects requires more than 1 CPU core per running Task and none have been reserved for that requirement, or a BOINC GPU project that requires heavy CPU support & no CPU cores have been reserved to support the GPU Tasks. Grant Darwin NT |
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
To run 9 hrs for 8hrs work or 7hrs for 6hrs work is just normal with our systems.No it isn't. |
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
To run 9 hrs for 8hrs work or 7hrs for 6hrs work is just normal with our systems.No it isn't. And how can CPU's be "slowed" if each core is doing its own thing? All RAH tasks have their own cores as do the other projects. The GPU stuff has it own core to monitor its work and one core is free for system and web. So what exactly is "slowing" things down? |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1681 Credit: 17,854,150 RAC: 22,647 |
And how can CPU's be "slowed" if each core is doing its own thing?The fact there is such a large discrepancy between CPU time & Runtime shows that there is something that is using CPU time on the same core/thread that the Rosetta Task is being processed on. Whether it's something that's running heavily for 5 min here or 15 min there, or something that is only making light use of the core/thread the entire time that Rosetta is using it, only investigation will reveal. You would have to have a close look at the Task Manager to see what else it is that is using the same core/thread at the same time as the Rosetta Task is running to determine what programme it is. Grant Darwin NT |
Bryn Mawr Send message Joined: 26 Dec 18 Posts: 393 Credit: 12,110,248 RAC: 6,015 |
A task does not have exclusive access to a core, the work is threaded and a task can be interrupted at any time depending on its priority and Boinc runs at minimal priority thus the cpu time will be shorter than the elapsed time to the extent of the interruptions it experiences. |
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
Interesting, did not know that. Thought it was core for core. The task manager thing, that's for tomorrow. I have no idea what could be interfering. I don't know how to get the core view...the best I can guess is details. There is a column called CPU. |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1681 Credit: 17,854,150 RAC: 22,647 |
I don't know how to get the core view...the best I can guess is details. There is a column called CPU.Each thread is considered a CPU by Task Manager. Click on the top of the CPU tab, and it will sort things from highest to lowest CPU usage. Clicking on the top of the Name tab will take it back to the default sorting by name view. Grant Darwin NT |
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
I don't know how to get the core view...the best I can guess is details. There is a column called CPU.Each thread is considered a CPU by Task Manager. If I look at "Details" and the column CPU. I have numbers 06,04,,0503 and 00 I have 15 x 06 running Boinc and FAH (2x) 05 pops up randomly which appears to be a RAH task 04 and 03 are WCG 00 seems to be all system items. In Processes 86% is BOINC 15 cores using 6.2 to 3.6% each + 2 GPU for Einstein Boinc Manager is .01% Then FAH is using 2 x GPU at 6.2 and 6.3% in CPU System is .06-.09 MSI Afterburner (to boost GPU) .03% max Firefox .01 and active system items make around .05% Of course totals vary every second...but this is about what I see for consistent usage |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1681 Credit: 17,854,150 RAC: 22,647 |
So it's not something running continuously using a bit of CPU time, but just for short periods using quite a bit of CPU time.I don't know how to get the core view...the best I can guess is details. There is a column called CPU.Each thread is considered a CPU by Task Manager. The numbers you posted above show just under 100% usage. From an earlier post- Browsers high fluctuations. Between .1 and 5% every second, but mostly .1%The browser hitting 5% usage will be taking processing time from one of the other in use threads to drive that. If Rosetta are the lowest priority Tasks, then they will be the ones that loose that processing time. Depending on how much of the time those browser tabs are open, and how often they need that 5% CPU time then that could be why. 5% every few seconds over 8 hours could easily account for an extra hour's time to actually finish 8 hours worth of Rosetta processing. The other option is a 3rd party AV programme or similar doing regular daily scans- if Rosetta is the lowest priority Task, then it's processing will be stalled while the AV scan makes heavy use of the CPU. Or the AV programme set to scan all network traffic would result in heavy CPU usage each time a web page is loaded or refreshed. I'm not saying that these are the cause of your longer Run times, but showing how they could be. Intermittent issues are often the toughest to resolve. Grant Darwin NT |
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
So it's not something running continuously using a bit of CPU time, but just for short periods using quite a bit of CPU time.I don't know how to get the core view...the best I can guess is details. There is a column called CPU.Each thread is considered a CPU by Task Manager. Interesting. Well no AV, just windows. External AV just makes a mess of things. I have a once a day drive/registry cleaning program (Wise365) that runs, usually around midnight for a few minutes, but that is it. Tabs...yeah well that's entirely possible. I have a bunch open from articles out of my email to read, but other than that there is no demand on my system. How much do you think FAH GPU control with CPU's causes delays? I'll just accept the delays in order to share my system with all the projects I like to run if that is the case. With skyrocketing electricity costs due to rapid economic recovery and the such, I can not afford to make a separate system for that project and I don't have the money for that either. I am not really bothered by an extra hour run time. As long as the work gets done. |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1681 Credit: 17,854,150 RAC: 22,647 |
I have a once a day drive/registry cleaning program (Wise365) that runs, usually around midnight for a few minutes, but that is it.Without actually seeing what else is using the CPU time when it's happening it's near impossible to say one way or the other. Having said that- It's unlikely to be FAH, as it's running most of the time as well, and without a CPU core set aside for it's use the difference between Rosetta CPU time & Run time would be much, much greater. Most likely it's some other process just using up CPU time now & then that results in the overall extended Runtime. The quickest way to see if it's Wise365 would be to suspend it for a few days while Rosetta work is being done & see if the discrepancy between CPU time & Runtime is reduced significantly or not. From the looks of it's blurb, it's an AV programme & system optimisation utility. The fact is that even back in the days of WIn3.x memory, disk & registry optimisers made little if any difference to a system's performance (the only one that did make a difference was a disk defragmenter, and even then it's effect was generally only noticeable on a system that had a lot of heavy disk write/read/delete activity. And even windows own defrag was good enough to give a similar improvement). Yes, a 3rd party AV programme is a good idea if you frequent extremely risky sites (ie free software, movies/TVV show downloads etc), but the benefits of it's memory/disk/registry optimisation functions are probably minimal, if any. Grant Darwin NT |
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
I have a once a day drive/registry cleaning program (Wise365) that runs, usually around midnight for a few minutes, but that is it.Without actually seeing what else is using the CPU time when it's happening it's near impossible to say one way or the other. Just checked Wise365. It's not set up for any scheduled time. That was something I had long ago I guess. As for risky websites, I don't have time for such stuff such as movies. I have a few things on my tv recordings to watch still and a handful of DVD's I have bought and never watched. I have so many house projects right now I barely read the news and the newsletters I get in email. So..no 3rd party AV. I don't use a memory booster either. So it must be some other stuff grabbing time. Like I said, if it takes a bit longer fine. Took at look with Wise at CPU usage...it says 127 user processes and 114 system processes. Now out of all that this is all that is active: BOINC uses 17.7% max. Vbox is running now..so 24-25% cmdock 6.2% max and around 5.7 averag hsgama (Einstein GPU with CPU control) 6.2-6.3 x2 FAH as usual uses 6.3 x 2 RAH 6.2 (peak) to 4.8 (minimum) x6 WCG 6.2 to 4.7% x 2 Wise care tray is .1 and WMI is .1 and a bunch of windows processes use .5% to .6% (This is from Task manager) oh...and MSI afterburner (GPU booster) uses .2% Firefox is .2% |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1681 Credit: 17,854,150 RAC: 22,647 |
BOINC uses 17.7% max.By my reckoning that's around 113%- well overcommitted. By BOINC uses 17%- what exactly is using that? On my system the BOINC client & BOINC System tray for Windows and BOINC Manager use nothing. Edit- OK. Make sure that the BOINC Manager is closed (not just minimised) when checking out what is using the CPU. If it is open, then it shows it as using heaps of CPU (when in actual fact it's the Applications running under it. And for some reason not all of them show as being under BOINC, some still show up as Background processes (at least on my system they do)). So taking that 17% off of the 113% gives less than 100% which is what we want. So what ever else it is that's using the CPU time, wasn't doing it the time you were checking Task manager. Grant Darwin NT |
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
BOINC uses 17.7% max.By my reckoning that's around 113%- well overcommitted. No BOINC 16-17% of which 14-15% is FAH CPU control of the 2 GPU's FAH just kicked in hard and took the CPU up to 72% for a few seconds. Note: FAH is set at Medium. If I set at low then nothing gets done. If I set it on high it takes up to much of the system. System is .4 Edge (Facebook) .3 Firefox (browsing and this) .3 MSI Afterburner .2 Desktop Window Manager .1 2 other system processes 1. 7 max (System and System Interrupts) but mostly around .5 combined. There are other Windows processes that pop up randomly but they are .1 to .2 combined. CPU overclock is left to the system to control. I ran a previous CPU hard (manual OC) for 18 months mostly 24hrs a day and burned it up. So CPU max is around 4.27 with no BOINC. But when BOINC kicks in it slows down to 3.96-3.97 Memory consumption with everything, but no LHC running at this time is only 37%. GPU's with FAH and Einstein are only being used to 30% on the 1080 and 23% on the 1050Ti Ok this is interesting...looking at Resource Monitor and it claims that I am using 110% of the CPU. The highest values jump between WCG (CPU only) and Einstein (GPU only) That is all there is to know about this system and whats going on in it. |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1681 Credit: 17,854,150 RAC: 22,647 |
No BOINC 16-17% of which 14-15% is FAH CPU control of the 2 GPU's? Sorry, but you are confusing me with the terminology you are using. BOINC itself uses next to nothing. BOINC"s Projects, they make use of the CPU/GPU. FAH is a completely separate application, not related to BOINC in any way. But it makes use the CPU/GPU as well, hence the need to reduce the number of cores/threads BOINC can make use of so it doesn't have to try to compete with FAH. FAH just kicked in hard and took the CPU up to 72% for a few seconds.And that could be the issue, if it occurs frequently enough, for long enough. BOINC applications (usually) are set to low Priority. Any other application with a higher Priority level will take processing time away from them if there aren't any free cores/threads for it to use (same priority- share the core/thread processing time). So even though you have excluded a core from BOINC"s use, there are times where FAH home actually needs several cores and due to t's higher priority level it gets them. Ok this is interesting...looking at Resource Monitor and it claims that I am using 110% of the CPU.Don't use Resource Monitor for this, better just to use Task Manager or Process Explorer. On my system Resource Monitor shows 116% CPU usage, it also shows 116% Maximum Frequency. Task Manager shows 100% CPU on the Processes tab. Grant Darwin NT |
Message boards :
Number crunching :
Lots of computer time, little credit
©2024 University of Washington
https://www.bakerlab.org