Another solution for the credit issue that hasn't been mentioned.

Message boards : Number crunching : Another solution for the credit issue that hasn't been mentioned.

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 . . . 7 · Next

AuthorMessage
Ethan
Volunteer moderator

Send message
Joined: 22 Aug 05
Posts: 286
Credit: 9,304,700
RAC: 0
Message 23810 - Posted: 20 Aug 2006, 17:58:46 UTC - in response to Message 23808.  

Thierry, what kind of unpleasant truth have you said that demanded modding?


He copied a message from Jose that I deleted.

ID: 23810 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
vavega
Avatar

Send message
Joined: 2 Nov 05
Posts: 82
Credit: 519,981
RAC: 0
Message 23812 - Posted: 20 Aug 2006, 17:59:46 UTC
Last modified: 20 Aug 2006, 18:01:41 UTC

no flaming jose, you'd look awful as toast.

and what of us who don't run an optimized version and don't want the points? why can't the credits awarded be based only on the workunits themselves and not how fast an optimized boinc runs them? the project team controls those values. if you're going to revamp how credits are awarded, then how about using only the size of the unit and time taken to crunch it? they all go out blind so no one can whine that they aren't getting a big one. is something like that doable?

don't hate me beacuse i have no clue!
ID: 23812 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Ethan
Volunteer moderator

Send message
Joined: 22 Aug 05
Posts: 286
Credit: 9,304,700
RAC: 0
Message 23813 - Posted: 20 Aug 2006, 18:01:07 UTC - in response to Message 23811.  
Last modified: 20 Aug 2006, 18:04:11 UTC

From Jose:

From Thierry:


Jose,
We are standard BOINCers. We don't want any flame. We have some requests. We will defend them. There is a lot of user behind us. We have nothing to loose in the credits changes.




(deleted)

That is why Rosetta and the DC community should rethink their dependence on the BOINC platform(..).
Sorry Ethan.

(..)

I am affraid you are going to have a long dayy.


ID: 23813 · Rating: -1 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jose

Send message
Joined: 28 Mar 06
Posts: 820
Credit: 48,297
RAC: 0
Message 23814 - Posted: 20 Aug 2006, 18:05:22 UTC - in response to Message 23812.  
Last modified: 20 Aug 2006, 18:07:23 UTC

no flaming jose, you'd look awful as toast.

and what of us who don't run an optimized version and don't want the points? why can't the credits awarded be based onlyon the workunits themselves and not how fast an optimized boinc runs them? the project team controls those values. if you're going to revamp how credits are awarded, then how about using only the size of the unit and time taken to crunch it? they all go out blind so no one can whine that they aren't getting a big one. is something like that doable?

don't hate me beacuse i have no clue!


I dont hate you but you are trying to refight the optimized clients issue

Hey why dont we give credits by the percentage of time the computer is crunching for Rosetta only? The larger your Rosetta Share the larger the ammount credits.

Or better still: If you only crunch Rosetta you get an additional double credit bonus?

And the better the cpu and the more memory your Rosetta only cruncher has then the bonus could be as high as 10 times .

BTW if you dont want the credits. The solution is simple ask for them to be Zeroed out. :)



ID: 23814 · Rating: -3 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Saenger
Avatar

Send message
Joined: 19 Sep 05
Posts: 271
Credit: 824,883
RAC: 0
Message 23815 - Posted: 20 Aug 2006, 18:08:19 UTC

What is so holy about the sheer value of the credits per work done?

imho it's absolutely irrelevant if it's 2 crdits per decoy, 200, 2000 or 0.2, as long as every decoy gets the same. The value is only interesting if you want to compare it with other projects (i.e. within BOINC)

Up to now the value is a rather random number here, as everybody gets just what he claims, regardless of his or her work done. There is even a kind of standard mechanism to claim more without doing more, called "optimized" client. So the numbers of stats don't reflect the actual work done by either team or user.

Why don't you want to change this to something meaningful? Regardless of the direction, more credits for stock users, or less for opties, it will show the real picture of work done, not some caricature.
ID: 23815 · Rating: 3 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jose

Send message
Joined: 28 Mar 06
Posts: 820
Credit: 48,297
RAC: 0
Message 23816 - Posted: 20 Aug 2006, 18:09:45 UTC - in response to Message 23807.  

The main reason to equalize credits up instead of down, is that a lot of top numbers were achieved using optimized clients, some obviously from before february. If we equalize down, it'll be much harder for people to catch people up at the top. However, if we equalize up, it'll let people catch up on the scoreboard at the higher pace.

Just my .02, and glad to see some people making sense of the idea.


Any change up or down of the old credits is backdating and will be consdered a breach of the NO backdating pledge.
ID: 23816 · Rating: -3 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Saenger
Avatar

Send message
Joined: 19 Sep 05
Posts: 271
Credit: 824,883
RAC: 0
Message 23817 - Posted: 20 Aug 2006, 18:11:42 UTC - in response to Message 23816.  

Any change up or down of the old credits is backdating and will be consdered a breach of the NO backdating pledge.

I don't remember having done a pledge here ;)
ID: 23817 · Rating: 0.99999999999999 · rate: Rate + / Rate - Report as offensive    Reply Quote
Ethan
Volunteer moderator

Send message
Joined: 22 Aug 05
Posts: 286
Credit: 9,304,700
RAC: 0
Message 23818 - Posted: 20 Aug 2006, 18:11:48 UTC - in response to Message 23816.  

Any change up or down of the old credits is backdating and will be consdered a breach of the NO backdating pledge.


This is not the case or I would have stopped the thread. It's a close issue, but not the same. Rather than impacting users of optimized clients, it would only impact those who used the standard client instead of the optimized. . for whatever reason.

ID: 23818 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
kevint

Send message
Joined: 8 Oct 05
Posts: 84
Credit: 2,530,451
RAC: 0
Message 23820 - Posted: 20 Aug 2006, 18:13:11 UTC




I like this idea - I have always said backdating is a bad idea, and going forward is the only way to go.

No backdating for those that did not use the optimized client or backdating for those that did. All we are concerned about is going forward.

However lets add another layer of complexity into the picture, something that I have been thinking about but have no knowledge of how to implement.

Other projects use a quorum to keep credits equal and to check the science done. There is no reason why this could not be done here as well. Rosetta is different and does different science. But just hear me out for a second.

Credits are granted on time spent per WU, and amount of science completed. A cross check system could be implemented to decrease those huge credit claims so that as each WU is reported back, it is compared to the other WU's in the quorum. If credit claimed per CPU cycle is way out of line compared to the other WU;s in the quorum it could be adjusted downwards or upwards as compared to the quorum.
This does not mean the every WU in the quorum is granted the same credit as some crunchers like 2 hours and some like 24 hours. It could not be difficult to calculate the cpu time to crunch a WU and adjust it accordingly to other members of the quorum. And because the way Rosetta WU's are generated, duplicate work WU's would not be necessary to crunch. Quorums could be made up of completely different WU's it would not matter. Each WU is granted credit based on it's own merit but cross checked for proper granting against other WU's. It would not even be necessary to display the quorums unless we wanted to review what those adjustments were.

I don't know if I am making this clear or not, or just adding more complexity into the system but in another life time I used to be a programmer and I know that adjustments like this can be done.

This would also make it unnecessary for the project dev's to step in and remove those that would try to cheat the system because the "anti cheating credit calculations" would take care of that.

Everyone or no one could use the optimized clients, each would be granted credits properly based upon their dedication to the project.

SETI.USA


ID: 23820 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Ethan
Volunteer moderator

Send message
Joined: 22 Aug 05
Posts: 286
Credit: 9,304,700
RAC: 0
Message 23823 - Posted: 20 Aug 2006, 18:15:10 UTC

Kevint, I think you just described the new work credit system. Please search for tralala's post which has a good description of it.
ID: 23823 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
vavega
Avatar

Send message
Joined: 2 Nov 05
Posts: 82
Credit: 519,981
RAC: 0
Message 23824 - Posted: 20 Aug 2006, 18:15:57 UTC

i have no problem with the optimized clients or people who use them, it was my personal choice not to. however i don't want or need to have my credits changed (for the past work i've done, or the future work) to reflect that. some others who don't use them might want them, not me.

what is needed is a fair and equitable plan that takes boinc and the optimizing out of the equation. that would be the only fair way to award credits based on work done, not how fast it's done.

by jose
Hey why dont we give credits by the percentage of time the computer is crunching for Rosetta only> The larger your Rosetta Share the larger the credits.


the only problem i can see with this is it will award more credits to a slow machine that crunches rosetta only, like my old sony P4 1.0. which i don't think if fair.
ID: 23824 · Rating: -1 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jose

Send message
Joined: 28 Mar 06
Posts: 820
Credit: 48,297
RAC: 0
Message 23825 - Posted: 20 Aug 2006, 18:16:16 UTC - in response to Message 23818.  

Any change up or down of the old credits is backdating and will be consdered a breach of the NO backdating pledge.


This is not the case or I would have stopped the thread. It's a close issue, but not the same. Rather than impacting users of optimized clients, it would only impact those who used the standard client instead of the optimized. . for whatever reason.


Ethan it is changing the old credits. ANY CHANGe is back dating.

No backdating is no changes in the old credits. If you are telling me that Bakers said that he is going to change some credits up , then we ware going to have problems. HUGE problems

People will not accept changes up of the old credits and they will consture it as Baker going back on his word.
ID: 23825 · Rating: -2 · rate: Rate + / Rate - Report as offensive    Reply Quote
Tallbill

Send message
Joined: 23 Jul 06
Posts: 12
Credit: 101,854
RAC: 0
Message 23826 - Posted: 20 Aug 2006, 18:16:49 UTC - in response to Message 23816.  

The main reason to equalize credits up instead of down, is that a lot of top numbers were achieved using optimized clients, some obviously from before february. If we equalize down, it'll be much harder for people to catch people up at the top. However, if we equalize up, it'll let people catch up on the scoreboard at the higher pace.

Just my .02, and glad to see some people making sense of the idea.


Any change up or down of the old credits is backdating and will be consdered a breach of the NO backdating pledge.


Well forget about the backdating then. Hence the edit in my first post. I hadn't read the promise to not change. Regardless, the raising of credits to the optimized level for the future would equal the playing field for everyone on rosetta and newer users catch up. As well as any new users that sign up in the future.
ID: 23826 · Rating: -1 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Saenger
Avatar

Send message
Joined: 19 Sep 05
Posts: 271
Credit: 824,883
RAC: 0
Message 23827 - Posted: 20 Aug 2006, 18:17:48 UTC - in response to Message 23823.  

Kevint, I think you just described the new work credit system. Please search for tralala's post which has a good description of it.

it's here
ID: 23827 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jose

Send message
Joined: 28 Mar 06
Posts: 820
Credit: 48,297
RAC: 0
Message 23829 - Posted: 20 Aug 2006, 18:18:19 UTC - in response to Message 23824.  

i have no problem with the optimized clients or people who use them, it was my personal choice not to. however i don't want or need to have my credits changed (for the past work i've done, or the future work) to reflect that. some others who don't use them might want them, not me.

what is needed is a fair and equitable plan that takes boinc and the optimizing out of the equation. that would be the only fair way to award credits based on work done, not how fast it's done.

by jose
Hey why dont we give credits by the percentage of time the computer is crunching for Rosetta only> The larger your Rosetta Share the larger the credits.


the only problem i can see with this is it will award more credits to a slow machine that crunches rosetta only, like my old sony P4 1.0. which i don't think if fair.


It is fair
Any computer running 100% rosetta should have a bonus to the point a Kentfield or a power mack running 100 % rosetta should have a huge credit bonus .
ID: 23829 · Rating: -3 · rate: Rate + / Rate - Report as offensive    Reply Quote
Ethan
Volunteer moderator

Send message
Joined: 22 Aug 05
Posts: 286
Credit: 9,304,700
RAC: 0
Message 23830 - Posted: 20 Aug 2006, 18:20:02 UTC
Last modified: 20 Aug 2006, 18:20:35 UTC

I'm not saying what anyone is going to do, we dont' have a batphone. I'm just saying the issue of 'backdating' was editing all scores based on the new system. The poster of this thread was suggesting another idea, my commenting on the idea doesn't mean it's likely to be implemented.
ID: 23830 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Saenger
Avatar

Send message
Joined: 19 Sep 05
Posts: 271
Credit: 824,883
RAC: 0
Message 23831 - Posted: 20 Aug 2006, 18:20:14 UTC

Why am I not allowed to ask Jose why he opposed to a fair view at the past?
ID: 23831 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Ethan
Volunteer moderator

Send message
Joined: 22 Aug 05
Posts: 286
Credit: 9,304,700
RAC: 0
Message 23832 - Posted: 20 Aug 2006, 18:22:04 UTC - in response to Message 23831.  

Why am I not allowed to ask Jose why he opposed to a fair view at the past?


You are, you didn't word it that way.
ID: 23832 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jose

Send message
Joined: 28 Mar 06
Posts: 820
Credit: 48,297
RAC: 0
Message 23833 - Posted: 20 Aug 2006, 18:23:47 UTC - in response to Message 23820.  




I like this idea - I have always said backdating is a bad idea, and going forward is the only way to go.

No backdating for those that did not use the optimized client or backdating for those that did. All we are concerned about is going forward.

However lets add another layer of complexity into the picture, something that I have been thinking about but have no knowledge of how to implement.

Other projects use a quorum to keep credits equal and to check the science done. There is no reason why this could not be done here as well. Rosetta is different and does different science. But just hear me out for a second.

Credits are granted on time spent per WU, and amount of science completed. A cross check system could be implemented to decrease those huge credit claims so that as each WU is reported back, it is compared to the other WU's in the quorum. If credit claimed per CPU cycle is way out of line compared to the other WU;s in the quorum it could be adjusted downwards or upwards as compared to the quorum.
This does not mean the every WU in the quorum is granted the same credit as some crunchers like 2 hours and some like 24 hours. It could not be difficult to calculate the cpu time to crunch a WU and adjust it accordingly to other members of the quorum. And because the way Rosetta WU's are generated, duplicate work WU's would not be necessary to crunch. Quorums could be made up of completely different WU's it would not matter. Each WU is granted credit based on it's own merit but cross checked for proper granting against other WU's. It would not even be necessary to display the quorums unless we wanted to review what those adjustments were.

I don't know if I am making this clear or not, or just adding more complexity into the system but in another life time I used to be a programmer and I know that adjustments like this can be done.

This would also make it unnecessary for the project dev's to step in and remove those that would try to cheat the system because the "anti cheating credit calculations" would take care of that.

Everyone or no one could use the optimized clients, each would be granted credits properly based upon their dedication to the project.


Kevin: There s a way to make a cluster analysis of all work units returned per type of client that will show the extreme deviations from what the rest of the machines wihing the same client and or as a whole were producing. And those extremelly disparate machines (up or down) could be removed from the credit detereming calculation.

Before this whole mess , I was working (a long with a friend) with an analysis of the data that included the time factors you mentioned. Alas. he and I kind of got tired of the backdating flames and the calling us cheats.
ID: 23833 · Rating: -2 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Saenger
Avatar

Send message
Joined: 19 Sep 05
Posts: 271
Credit: 824,883
RAC: 0
Message 23834 - Posted: 20 Aug 2006, 18:24:24 UTC

So OK:

Jose,
why are you opposed to a fair view of the past?
ID: 23834 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Previous · 1 · 2 · 3 · 4 · 5 · 6 . . . 7 · Next

Message boards : Number crunching : Another solution for the credit issue that hasn't been mentioned.



©2024 University of Washington
https://www.bakerlab.org