Message boards : Number crunching : Discussion of the new credit system
Previous · 1 · 2 · 3 · 4 · 5 . . . 8 · Next
Author | Message |
---|---|
Astro Send message Joined: 2 Oct 05 Posts: 987 Credit: 500,253 RAC: 0 |
Here is the "credit overview" from boincstats as it appeared as of today. It will be interesting to see what happens to it's currently linear ascension. Any subsequent drop will IMO be the result of reduced credit granted to those using optimized Boinc clients and the total loss of users due to the new credit systems implementation. The loss might possibly be offset by the addition of new users coming to rosetta after this change. All of this will be impossible to narrow down, but it will be interesting to see anyhow. |
Trog Dog Send message Joined: 25 Nov 05 Posts: 129 Credit: 57,345 RAC: 0 |
G'day Los Alcohilocos~Sloom If you overclaim you won't get the benefit on your first result, but you will on every subsequent result from the same type of wu. Sounds like a great incentive to me - not only can I doctor my subsequent credits but also those of all my teammates. The fact that everybody else potentially benefits is not really a disincentive, if you and your teammates get your results before everyone else. Potentially this means as a team you all set your runtime to the minimum, and your credit claims to the maximum. |
R.L. Casey Send message Joined: 7 Jun 06 Posts: 91 Credit: 2,728,885 RAC: 0 |
Here is the "credit overview" from boincstats as it appeared as of today. It will be interesting to see what happens to it's currently linear ascension. Any subsequent drop will IMO be the result of reduced credit granted to those using optimized Boinc clients and the total loss of users due to the new credit systems implementation. The loss might possibly be offset by the addition of new users coming to rosetta after this change. All of this will be impossible to narrow down, but it will be interesting to see anyhow. Many new users and hosts have arrived over the past day... a good sign! Users (last day ) : 78,055 (+377) Hosts (last day ) : 172,223 (+709) |
R.L. Casey Send message Joined: 7 Jun 06 Posts: 91 Credit: 2,728,885 RAC: 0 |
...I fully support the suggestion to wait until the first 10.000 results / 100.000 models are returned to start already with a very good average. I would even go further and stop changing the credit/model-ratio after a proper ratio has been establised. This would lead to the same credit/model-ratio applied to all participants. This fact has now been confirmed (edit: REPORTED from this post) in the 'The new credit system explained' thread. |
DigiK-oz Send message Joined: 8 Nov 05 Posts: 13 Credit: 333,730 RAC: 0 |
Maybe, maybe not. I would have to do some longterm calculations on this, but point is that you will probably not gain much yourself. By the time you get the next WU from the same batch in, the effect of your previous claim will have diminished. Especially if the WU has had a lot of results reported already. Chances that some of your teammates gain anything are slim, too. And even if you do gain anything, fact is that other members/teams will have a higher chance of benefitting from you, unless you're in a team that is over half the active participants. So, you might be winning in actual points, but other teams will be winning more. So you're actually helping your opponents more than you help yourself. Having said that, there's a loophole in that when someone reports their work in large batches (like 10 WU's). In that case, 9 out of the 10 would benefit (assuming that no ther WU's are sent by other members inbetween yours). Still, much more than 9 following your contribution would benefit.... Besides, your reasoning goes for the current system as well - and more so, because you gain immediately no matter what the effect on your next or teammate's WU. |
Trog Dog Send message Joined: 25 Nov 05 Posts: 129 Credit: 57,345 RAC: 0 |
Trog Dog, for someone to do anything, there has to be a motivation to do so. If someone hasn't already switched to using an optimized boinc core client, when you actually got whatever you claimed, then I don't think there's much motivation to switch to one now. 90% + of the active attached hosts are using standard boinc clients. Remember only the first few results returned of a new wu could be granted substantially higher claims, even when averaging. I doubt there's much incentive to switch to one now. G'day mmciastro There's plenty of psych/legal studies that have been carried out that correlate the propensity to "infringe" to the liklihood of getting caught. Typically increased penalties for speeding won't cause drivers to slow down, but an increased police/highway patrol presence , speed cameras will(ie chances of being caught will). So let's move from the abstract. Suddenly under this new credit system a user (of an optimised client) can claim "but it wasn't benefiting me" - so less stigma. If everybody is getting more credits, how do you identify the users claiming more - check every wu returned? Only the project can do that. Something else that just came to mind - intraproject it won't necessarily matter - interproject it will. I want to get my team to number one in BOINC combined statistics - solution have the team attach to Rosetta with bogus benchmarks. Wait and see - I hope I'm wrong, but I've seen too many arguments over credits and "what MY boxes are ENTITLED to", to view things any differently. |
Mod.DE Volunteer moderator Send message Joined: 23 Aug 06 Posts: 78 Credit: 0 RAC: 0 |
This fact has now been confirmed in the 'The new credit system explained' thread. Actually I put this in after I read your post. ;-) I am a forum moderator! Am I? |
R.L. Casey Send message Joined: 7 Jun 06 Posts: 91 Credit: 2,728,885 RAC: 0 |
This fact has now been confirmed in the 'The new credit system explained' thread. OK :-) I tweaked the prior post to say it was 'reported'... ;-) |
Trog Dog Send message Joined: 25 Nov 05 Posts: 129 Credit: 57,345 RAC: 0 |
https://boinc.bakerlab.org/rosetta/forum_thread.php?id=2197#24664 I'm making a point of this because I think it should be considered as a possibility. I don't like tilting at windmills, but for the integrity of this project the cynical viewpoint must be considered. |
FluffyChicken Send message Joined: 1 Nov 05 Posts: 1260 Credit: 369,635 RAC: 0 |
Here is the "credit overview" from boincstats as it appeared as of today. It will be interesting to see what happens to it's currently linear ascension. Any subsequent drop will IMO be the result of reduced credit granted to those using optimized Boinc clients and the total loss of users due to the new credit systems implementation. The loss might possibly be offset by the addition of new users coming to rosetta after this change. All of this will be impossible to narrow down, but it will be interesting to see anyhow. Though there's been a drop of active users (and about 10% drop of active hosts) Team mauisun.org |
Trog Dog Send message Joined: 25 Nov 05 Posts: 129 Credit: 57,345 RAC: 0 |
G'day again LosAlcoholicos~Sloom "Maybe, maybe not" - that uncertaintity would be enough for some individuals and/or teams to do what I'm hypothesising. That afterall, has been amongst the reasons given over the last weeks/months as to why optimised clients are used - "everybody else is using them" "team ?? are using them so why shouldn't we" "os ?? users are using them so why shouldn't we" "my cpu is disadvantaged compared to your cpu, so I'm using them". "by the time you get your next wu from the same batch in" - what about mutiple hosts - same user multiple hosts? Never see the same wu type across multiple hosts? For every cynical & devious idea I'm thinking up, I bet that there are ten more out there in the wild. Prove me wrong - and I say that without cynicism, because I hope that I am wrong. Only time will tell. |
R.L. Casey Send message Joined: 7 Jun 06 Posts: 91 Credit: 2,728,885 RAC: 0 |
Here is the "credit overview" from boincstats as it appeared as of today. It will be interesting to see what happens to it's currently linear ascension. Any subsequent drop will IMO be the result of reduced credit granted to those using optimized Boinc clients and the total loss of users due to the new credit systems implementation. The loss might possibly be offset by the addition of new users coming to rosetta after this change. All of this will be impossible to narrow down, but it will be interesting to see anyhow. Yes, that's true, and I don't have the benefit of long-term stats; however, I did check Einstein@home & SETI@home, and they, too, display a similar decrease in user and host activity. All three had apparent minima in mid-August and now activity seems to be on the rise. It may be an effect due to summertime vacations and travel--or maybe too hot for some to run the crunchers?? :-) |
DigiK-oz Send message Joined: 8 Nov 05 Posts: 13 Credit: 333,730 RAC: 0 |
I will not prove you wrong, or try to counter your devious ideas. The suggestion I made just takes one extra reason OUT of overclaiming. It doesn't prevent every single cheat you can come up with. In the current system, overclaiming gives you extra credit, and MIGHT make a difference on your next WU or your teammate's. But YOU are the main beneficiary. In my suggestion, the first reason is gone. What remains is you MIGHT get more credits on your next WU or your teammate's. So, I still think that it could be implemented, and probably very easy : Cuurent system : Calculate a new rolling average, then assign average points My idea : assign averige points, then calculate new rolling average. |
Trog Dog Send message Joined: 25 Nov 05 Posts: 129 Credit: 57,345 RAC: 0 |
Thanks for your ideas Sloom. We'll soon see what happens ;) I hope that I am proved wrong. |
Hoelder1in Send message Joined: 30 Sep 05 Posts: 169 Credit: 3,915,947 RAC: 0 |
Yes, there has been quite a dramatic drop in active users and hosts over the last two months - not just in Rosetta but in all of BOINC. But since yesterday active hosts and users seem to be on the rise again in Rosetta while the numbers for all of BOINC are still low. It seems people are voting with their feet (or rather their mouse and keyboard) for the new credit system.Many new users and hosts have arrived over the past day... a good sign!Though there's been a drop of active users (and about 10% drop of active hosts) Team betterhumans.com - discuss and celebrate the future - hoelder1in.org |
Paydirt Send message Joined: 10 Aug 06 Posts: 127 Credit: 960,607 RAC: 0 |
I'm not sure what math is being used to assign credits... If they are going to wait for ## or ### results before they start granting credit, then I think it makes the most sense to go with a median, or a mean/average with the outlying tails thrown out. So if you had... 20 25 30 30 30 32 34 35 100 The median would be 30, the mean with the lowest and highest observation thrown out would be 31. Straight mean is 37. If you go with a straight mean, then you have to monitor the misreporting results, and you would have to adjust the granted results for all reporting computers. It would be a hassle to administer. If you could run a median or a "mean/average minus outliers", then this problem goes away. -Bradford |
Keith Akins Send message Joined: 22 Oct 05 Posts: 176 Credit: 71,779 RAC: 0 |
Let's see what happens. Will be interesting to see how long credit validation takes. Other projects that take three or more WU's to validate results takes up to three days for some to grant credit. Here we're talking 100's to 1000's. This is shaping up to be a very interesting experiment. |
Saenger Send message Joined: 19 Sep 05 Posts: 271 Credit: 824,883 RAC: 0 |
Let's see what happens. Will be interesting to see how long credit validation takes. Other projects that take three or more WU's to validate results takes up to three days for some to grant credit. Here we're talking 100's to 1000's. But that's 3 per single WU, here it's 1000 (is it btw?) per type of WU. Let's wait and see (Abwarten und Tee trinken);) |
FluffyChicken Send message Joined: 1 Nov 05 Posts: 1260 Credit: 369,635 RAC: 0 |
Yes, there has been quite a dramatic drop in active users and hosts over the last two months - not just in Rosetta but in all of BOINC. But since yesterday active hosts and users seem to be on the rise again in Rosetta while the numbers for all of BOINC are still low. It seems people are voting with their feet (or rather their mouse and keyboard) for the new credit system.Many new users and hosts have arrived over the past day... a good sign!Though there's been a drop of active users (and about 10% drop of active hosts) I had written a longer one before with graphs, but my connection dropped. The problem with the graphs is we will not see the effect until a month or so. Since it is a graph of granted in last 30 days. So what you are really seeing is the people that stopped a month ago. Team mauisun.org |
Hoelder1in Send message Joined: 30 Sep 05 Posts: 169 Credit: 3,915,947 RAC: 0 |
The median would be 30, the mean with the lowest and highest observation thrown out would be 31. Straight mean is 37.I made that same suggestion some time ago and David Kim explained that the only numbers he has available are the cumulative claimed credit and cumulative number of returned models for each batch of WUs, so he can't calculate the median from that. Anything else would require some lengthy messing with the database. And yes, he also mentioned a correction factor to account for outliers that would need to be reviewed occasionally. Team betterhumans.com - discuss and celebrate the future - hoelder1in.org |
Message boards :
Number crunching :
Discussion of the new credit system
©2024 University of Washington
https://www.bakerlab.org