RAC dropping

Message boards : Number crunching : RAC dropping

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · Next

AuthorMessage
Mod.DE
Volunteer moderator

Send message
Joined: 23 Aug 06
Posts: 78
Credit: 0
RAC: 0
Message 26374 - Posted: 8 Sep 2006, 15:13:28 UTC

WHL, this is a moderation warning. Acting deaf against any argument and constantly posting with the sole intent to discredit the project will not be tolerated. Specifically I ask you to refrain from:

1. Calling for optimisation without addressing some of the issues as described eg. here and in other posts from Mats.
2. Saying that high end machines will be dragged down by the credit system without explaining why and how.
I am a forum moderator! Am I?
ID: 26374 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Feet1st
Avatar

Send message
Joined: 30 Dec 05
Posts: 1755
Credit: 4,690,520
RAC: 0
Message 26379 - Posted: 8 Sep 2006, 16:40:27 UTC

Perhaps Whl is referring to the fact that the credit system is still based upon the BOINC credit claims... and the average thereof. So, I think dcdc is not entirely correct in saying the new system is "without a benchmark". The BOINC benchmark still enters in to it because that is the basis for the credit claims we're averaging together to establish credit per model.

I'm the first to admit I know nothing about OCing a PC. So, if my scenerio wasn't entirely realistic, I apologize. My intent was to spell out clearly what I'm saying, in hopes that you would do the same. I think your original point about people becoming discouraged to run the project is now being clouded over. So perhaps you have more then one point to make?

So yes, Whl, please inform us about how high-end systems have a credit disparity. Can you provide an example host ID? Is the high-end system a Mac PPC?
Add this signature to your EMail:
Running Microsoft's "System Idle Process" will never help cure cancer, AIDS nor Alzheimer's. But running Rosetta@home just might!
https://boinc.bakerlab.org/rosetta/
ID: 26379 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
BennyRop

Send message
Joined: 17 Dec 05
Posts: 555
Credit: 140,800
RAC: 0
Message 26387 - Posted: 8 Sep 2006, 19:36:50 UTC

When you say "averaging" - it implies that a top scoring credit/model machine will have its score reduced, while the lowest scoring credit/model machines will have their score increased.

Ingleside touched on the topic here. Ingleside pointed out the effect that 10% overclaiming on credit would have, and the effect the 12.7% Mac and Linux crowd would have on an average. The effect of all the underclaiming P4s wasn't dealt with.

I did a limited comparison of P4 vs Athlon 64, P4 on Windows vs P4 on Linux, and some Macs in this thread.

I'm having trouble finding the post by David Kim where he mentioned using a correction factor on the credits/model, which I assume was to take care of the effect of all the underclaiming P4s. (Was that discussion on the Ralph board?)

Given that Athlons in general or Athlon 64s in particular were getting the best benchmarks with the standard client in the past, and my Athlon 64 was getting 1.15 times the credit that I used to under the old credit system using the standard client, then it seems as if the correction factor being applied is more than adequate to deal with the underclaiming P4s. I'm using 24 hour WUs, so by the time I turn one in, my score/model should be close to the average for the WU.


ID: 26387 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Astro
Avatar

Send message
Joined: 2 Oct 05
Posts: 987
Credit: 500,253
RAC: 0
Message 26394 - Posted: 8 Sep 2006, 20:08:15 UTC - in response to Message 26387.  
Last modified: 8 Sep 2006, 20:09:25 UTC

(Was that discussion on the Ralph board?)

yes

sorry can't chat, putting new machine together. errr...ahhh, installing "repair parts". LOL
ID: 26394 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Whl.

Send message
Joined: 29 Dec 05
Posts: 203
Credit: 275,802
RAC: 0
Message 26398 - Posted: 8 Sep 2006, 20:42:42 UTC - in response to Message 26374.  

WHL, this is a moderation warning. Acting deaf against any argument and constantly posting with the sole intent to discredit the project will not be tolerated. Specifically I ask you to refrain from:

1. Calling for optimisation without addressing some of the issues as described eg. here and in other posts from Mats.
2. Saying that high end machines will be dragged down by the credit system without explaining why and how.

Great, is'nt it. Because you dont understand what I've said, I get a warning ?

ID: 26398 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
tralala

Send message
Joined: 8 Apr 06
Posts: 376
Credit: 581,806
RAC: 0
Message 26399 - Posted: 8 Sep 2006, 20:53:16 UTC - in response to Message 26387.  

When you say "averaging" - it implies that a top scoring credit/model machine will have its score reduced, while the lowest scoring credit/model machines will have their score increased.

Ingleside touched on the topic here. Ingleside pointed out the effect that 10% overclaiming on credit would have, and the effect the 12.7% Mac and Linux crowd would have on an average. The effect of all the underclaiming P4s wasn't dealt with.

I did a limited comparison of P4 vs Athlon 64, P4 on Windows vs P4 on Linux, and some Macs in this thread.

I'm having trouble finding the post by David Kim where he mentioned using a correction factor on the credits/model, which I assume was to take care of the effect of all the underclaiming P4s. (Was that discussion on the Ralph board?)

Given that Athlons in general or Athlon 64s in particular were getting the best benchmarks with the standard client in the past, and my Athlon 64 was getting 1.15 times the credit that I used to under the old credit system using the standard client, then it seems as if the correction factor being applied is more than adequate to deal with the underclaiming P4s. I'm using 24 hour WUs, so by the time I turn one in, my score/model should be close to the average for the WU.


There is no such kind of "averaging". What kind of "averaging" are you referring to? There is a value established for credit/decoy for each WU. Let's for a moment put aside how this value is established. Once this value is established it will determine how much credit you receive compared to other hosts, which are slower or faster. So there won't be any decrease or increase for slower or higher machines. Let's say the value is 1credit/decoy. If your computer is very, very slow and can just do one decoy per day it receives 1 credit. If your computer is super, super fast and can doe 10.000 decoys per day it receives 10.000 credits. Let's say the value is 10credits/decoy, then you have 10 to 100.000. In any case the faster comp gets 10.000 the credit of the slower host, since he computes 10.000 the work of the slower host. So there is a linear scale which will accurately reflect the difference between the hosts.

Now back to how this value is established. Here the reported benchmarks, the under- und overclaimer come in play. There are a lot of inaccuracies in the process of establishing the value but due to the massive sampling all averages out more or less (+-20%). Here you can apply a correction factor to keep cross project parity or not. The important point is, it does not influence the intra-project-parity how the credit/decoy ratio is establised. The difference between the hosts will always reflect the true capabilites according to real work done, even if the absolute number will differ.

Their is one caveat in the actual process used and that is, that a rolling average is used which will at least in the beginning vary to some extent. In practice it does not seem to have much distorting influence since it will average out over time but theoretically this is a weak point. Therefore I stronlgy back the idea of pending credits until a reliable credit/decoy ratio can be established based on perhaps 20.000 decoys reported.

Okay this is long and complicated, the findings are:

1. The system of awarding fixed credit/decoy does truly reflect the difference in actual work done between different hosts with no penalties for any hosts.
2. Due to the process how this ratio (credits/decoy) is established there are variations for early results and the total amount of credit is also affected according to the average of claimed credits of all hosts.
3. To assure intra-project-fairness and keep variations below 1% one would need to implement a pending period to get a reliable credit/decoy value.
4. To keep cross project parity one would need to revise the average granted credit from time to time and apply if neccesary a correction factor (this is not needed for intra project parity).

Any objections? ;-)
ID: 26399 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.DE
Volunteer moderator

Send message
Joined: 23 Aug 06
Posts: 78
Credit: 0
RAC: 0
Message 26400 - Posted: 8 Sep 2006, 20:56:43 UTC - in response to Message 26398.  

WHL, this is a moderation warning. Acting deaf against any argument and constantly posting with the sole intent to discredit the project will not be tolerated. Specifically I ask you to refrain from:

1. Calling for optimisation without addressing some of the issues as described eg. here and in other posts from Mats.
2. Saying that high end machines will be dragged down by the credit system without explaining why and how.

Great, is'nt it. Because you dont understand what I've said, I get a warning ?


You got a warning for posting with a negative attitude. Although a negative attitude is no violation of whatsoever it becomes a pain if you do it over many weeks on many occasions with dozens of posts, which all have the same message: "this project sucks". We don't need that.

I am a forum moderator! Am I?
ID: 26400 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Whl.

Send message
Joined: 29 Dec 05
Posts: 203
Credit: 275,802
RAC: 0
Message 26402 - Posted: 8 Sep 2006, 21:33:07 UTC
Last modified: 8 Sep 2006, 22:01:16 UTC

I have 127 posts since December 2005. 128 now ?

P.S. Your intervention was unnecessary in the first place. All you have done is broken up a discussion that was going along fine and taken it off at a tangent for no apparent reason other than your opinions about my attitude. (Which was'nt the reason you gave in the first place BTW).
ID: 26402 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Feet1st
Avatar

Send message
Joined: 30 Dec 05
Posts: 1755
Credit: 4,690,520
RAC: 0
Message 26404 - Posted: 8 Sep 2006, 22:19:20 UTC
Last modified: 8 Sep 2006, 22:20:27 UTC

Looks like key info. resides in a deleted thread. Rolling back through David Kim's posts You see he posted:
It's a running average, so the first result gets the standard claimed credit, the second gets the average of the two and so forth.


[edit] all the more reason to post such info. in specific read-only threads where one can look for formal announcement info. of such details.
Add this signature to your EMail:
Running Microsoft's "System Idle Process" will never help cure cancer, AIDS nor Alzheimer's. But running Rosetta@home just might!
https://boinc.bakerlab.org/rosetta/
ID: 26404 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
BennyRop

Send message
Joined: 17 Dec 05
Posts: 555
Credit: 140,800
RAC: 0
Message 26406 - Posted: 8 Sep 2006, 22:49:31 UTC - in response to Message 26399.  

[quote] When you say "averaging" - it implies that a top scoring credit/model machine will have its score reduced, while the lowest scoring credit/model machines will have their score increased.


There is no such kind of "averaging". What kind of "averaging" are you referring to? There is a value established for credit/decoy for each WU.

[...]
2. Due to the process how this ratio (credits/decoy) is established there are variations for early results and the total amount of credit is also affected according to the average of claimed credits of all hosts.

3. To assure intra-project-fairness and keep variations below 1% one would need to implement a pending period to get a reliable credit/decoy value.

The comments about the high credit lottery which have been going on for the last couple of weeks (getting a credit/decoy higher than average by being one of the first few hosts to submit a particular WU while using an optimized client) is based on the idea that some form of averaging is happening.
When an optimized client turns in 10 models and asks for 60 credits, or a Duron turns in 1 model and asks for 6 credits and they're followed by a fast system that turns in 20 models and asks for 20 credits, it was my understanding that the first few hundred models turned in would get a fluctuating amount of credit/model until there was enough models turned in that we'd get near an average credit/model.

Those that turn in high credit/model values would get less than requested, while those that turn in low credit/model values would get more than requested because they're being averaged.

How is this not a form of averaging?

And if there's a noticeable fluctuation in credit/model for the first 100 or 1000 models turned in, rather than just theoretical, then perhaps we can get David Kim to average out the whole 10k, 100k, or more decoys that are turned in.
ID: 26406 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Whl.

Send message
Joined: 29 Dec 05
Posts: 203
Credit: 275,802
RAC: 0
Message 26428 - Posted: 9 Sep 2006, 8:10:03 UTC - in response to Message 26373.  
Last modified: 9 Sep 2006, 8:27:57 UTC

By reading your posts, WHL, it seems to me you are calling for a credit system, which does not award credit according to the actual work done, but according to the potential work that a specific processor could achieve.............

Missed your post in the confusion.

If I am allowed to say this without getting banned by MOD.DE ? This new credit system does'nt reflect the actual work done either. We have a situation now where lower end machines are getting higher credits than they would otherwise have got and higher end machines are getting lower credits than they would otherwise have got. In other words, the higher end machines are dragging the lower end machines up and the lower end machines are dragging the higher end ones down.

Almost like communism in a way. And it looks like we may be getting our own version of Pravda her now too. ;-)
ID: 26428 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
tralala

Send message
Joined: 8 Apr 06
Posts: 376
Credit: 581,806
RAC: 0
Message 26429 - Posted: 9 Sep 2006, 8:33:14 UTC - in response to Message 26428.  
Last modified: 9 Sep 2006, 8:34:23 UTC

By reading your posts, WHL, it seems to me you are calling for a credit system, which does not award credit according to the actual work done, but according to the potential work that a specific processor could achieve.............

Missed your post in the confusion.

If I am allowed to say this without getting banned by MOD.DE ? This new credit system does'nt reflect the actual work done either. We have a situation now where lower end machines are getting higher credits than they would otherwise have got and higher end machines are getting lower credits than they would otherwise have got. In other words, the higher end machines are dragging the lower end machines up and the lower end machines are dragging the higher end ones down.

Almost like communism in a way. ;-)

This is not true WHL! Please reread this post. The "averaging" takes place not between higher end machines and lower end machines but between overclaimers and underclaimers. A slow host using the 5.5.0 client will drag the average granted credit up, while a high end machine using Linux and a stock client will drag the average granted credit down. Your phrase "than they would otherwise have got" refers to a scenario in which the higher end machines use the "overclaiming" 5.5.0 credit and slower host use the "underclaiming" stock client. It might well be the reverse in some cases.
ID: 26429 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
tralala

Send message
Joined: 8 Apr 06
Posts: 376
Credit: 581,806
RAC: 0
Message 26430 - Posted: 9 Sep 2006, 8:38:16 UTC - in response to Message 26406.  

[quote] When you say "averaging" - it implies that a top scoring credit/model machine will have its score reduced, while the lowest scoring credit/model machines will have their score increased.


There is no such kind of "averaging". What kind of "averaging" are you referring to? There is a value established for credit/decoy for each WU.

[...]
2. Due to the process how this ratio (credits/decoy) is established there are variations for early results and the total amount of credit is also affected according to the average of claimed credits of all hosts.

3. To assure intra-project-fairness and keep variations below 1% one would need to implement a pending period to get a reliable credit/decoy value.

The comments about the high credit lottery which have been going on for the last couple of weeks (getting a credit/decoy higher than average by being one of the first few hosts to submit a particular WU while using an optimized client) is based on the idea that some form of averaging is happening.
When an optimized client turns in 10 models and asks for 60 credits, or a Duron turns in 1 model and asks for 6 credits and they're followed by a fast system that turns in 20 models and asks for 20 credits, it was my understanding that the first few hundred models turned in would get a fluctuating amount of credit/model until there was enough models turned in that we'd get near an average credit/model.

Those that turn in high credit/model values would get less than requested, while those that turn in low credit/model values would get more than requested because they're being averaged.

How is this not a form of averaging?

And if there's a noticeable fluctuation in credit/model for the first 100 or 1000 models turned in, rather than just theoretical, then perhaps we can get David Kim to average out the whole 10k, 100k, or more decoys that are turned in.


I agree with you, that there should be used an average after 10k or 100k returned decoys. I would even stop than and fix the credit/decoy ratio. This would ensure that everybody gets exactly the same credit/decoy regardless when he returns in a result.

So far nobody could show that he can get significantly higher credits (>5%) with some techniques but it would be helpful to convince David Kim of activating the pending feature if somebody could.

However this averaging between all hosts for the ratio credit/decoy has nothing to do with higher end machines are dragged down and lower end machines are dragged up. Overclaimers are dragged down and underclaimers are dragged up. The term overclaim and underclaim refers in this case not to a just or fair measure but just to the relationship of claimed credits and actual work done.
ID: 26430 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
NJMHoffmann

Send message
Joined: 17 Dec 05
Posts: 45
Credit: 45,891
RAC: 0
Message 26431 - Posted: 9 Sep 2006, 8:54:41 UTC - in response to Message 26428.  
Last modified: 9 Sep 2006, 8:55:07 UTC

This new credit system does'nt reflect the actual work done either. We have a situation now where lower end machines are getting higher credits than they would otherwise have got and higher end machines are getting lower credits than they would otherwise have got. In other words, the higher end machines are dragging the lower end machines up and the lower end machines are dragging the higher end ones down.

Do you have some facts to back up this? It doesn't get true by repetition alone.
ID: 26431 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Trog Dog
Avatar

Send message
Joined: 25 Nov 05
Posts: 129
Credit: 57,345
RAC: 0
Message 26432 - Posted: 9 Sep 2006, 10:13:35 UTC

I can see where Whl is coming from. It all depends on whether the benchmarks (which are still used for the claimed credit, and therefore affect the average) actually reflect the performance of each machine.

Put simply would a machine that has twice the benchmarks produce exactly twice as much work?
ID: 26432 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Astro
Avatar

Send message
Joined: 2 Oct 05
Posts: 987
Credit: 500,253
RAC: 0
Message 26435 - Posted: 9 Sep 2006, 11:00:42 UTC
Last modified: 9 Sep 2006, 11:02:19 UTC

There is NO perfect benchmark software available, NONE, Nada, Zip. Some are better than others at certain things. some are even specifically written to favor one product so marketing can claim this or that.

However, In Boinc benchmark system the faster machines and slower machines should be claiming "nearly" the same amount of credit per wu.

The formula for Claimed Credit is ((Whetstone + Dhrystone)x Cpu seconds)/1728000. If you double the benchmark by having a fast machine you also cut cpu seconds in 1/2.

A=Whetstone
B=Dhrystone
C=Cpu seconds

so the formula is:

((A+B)xC)/1728000=CC

now let's double the benchmark and cut the time in half and we see they are identical:

((A+B)xC)/1728000=((2A+2B)x1/2C)/1728000=CC

Now you go ahead and insert any value for A,B, and C and you'll see what I mean.

I don't think anything is being dragged down. If you look at a larger sample of WU's you see the new averaging system actually raises credit slightly when compared to the standard boinc benchmark system.

Now if you're using something other than the official boinc benchmark system, which alters A, B, and/or C (above), then I can see where you might view it as being dragged down.
ID: 26435 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Whl.

Send message
Joined: 29 Dec 05
Posts: 203
Credit: 275,802
RAC: 0
Message 26437 - Posted: 9 Sep 2006, 13:17:51 UTC
Last modified: 9 Sep 2006, 13:21:11 UTC

Tony, what you are showing there is the old BOINC credit system without averages applied. If you use this as part of the new system and apply averages, something has to go up and something has to go down.
ID: 26437 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Christoph Jansen
Avatar

Send message
Joined: 6 Jun 06
Posts: 248
Credit: 267,153
RAC: 0
Message 26439 - Posted: 9 Sep 2006, 13:22:21 UTC - in response to Message 26437.  
Last modified: 9 Sep 2006, 13:23:54 UTC


"I know that you believe you understand what you think I said, but I'm not sure you realize that what you heard is not what I meant." R.M. Nixon
ID: 26439 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Whl.

Send message
Joined: 29 Dec 05
Posts: 203
Credit: 275,802
RAC: 0
Message 26440 - Posted: 9 Sep 2006, 13:39:45 UTC
Last modified: 9 Sep 2006, 14:02:39 UTC

That is probably because you were close to first in with that workunit, with an overclaiming client first in (which would have been awarded what it claimed). My team mate was awarded 2 points for a valid 24 hour workunit (on an A64 4000+ if I remember correctly), Which does'nt seem to make any sense at all, even if you take averages into account.
ID: 26440 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Astro
Avatar

Send message
Joined: 2 Oct 05
Posts: 987
Credit: 500,253
RAC: 0
Message 26447 - Posted: 9 Sep 2006, 16:01:27 UTC - in response to Message 26440.  
Last modified: 9 Sep 2006, 16:02:17 UTC

That is probably because you were close to first in with that workunit, with an overclaiming client first in (which would have been awarded what it claimed). My team mate was awarded 2 points for a valid 24 hour workunit (on an A64 4000+ if I remember correctly), Which does'nt seem to make any sense at all, even if you take averages into account.

I agree 2 credits for 24 hours on any system seems LOW. I get approx 1.5-2/hour on a celeron 500. Perhaps you could highlight that WU for management to examine and figure out what happened?
ID: 26447 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Previous · 1 · 2 · 3 · 4 · Next

Message boards : Number crunching : RAC dropping



©2024 University of Washington
https://www.bakerlab.org