Wow...I can cheat on credit!

Message boards : Number crunching : Wow...I can cheat on credit!

To post messages, you must log in.

AuthorMessage
Profile The Gas Giant

Send message
Joined: 20 Sep 05
Posts: 23
Credit: 58,591
RAC: 0
Message 2791 - Posted: 10 Nov 2005, 10:31:35 UTC

Not that I condone this sort of thing of course, but.....

Since Rosetta grants credit purely based on claimed credit (and a successful result I assume) then it leaves itself open to cheating for credit in a BIG way. All someone has to do is artificially inflate their benchmarks, which causes artificially high claimed credit and hence granted credit is also artificially higher than the computer should be granted! In this case the science isn't altered, but the kick in granted credit will be a magnet for the cheaters in this world.

Live long and crunch.

(ps. surely this has been discussed before).

PPaul
(S@H1 8888)

Do as I say, not as I do!
ID: 2791 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile The Gas Giant

Send message
Joined: 20 Sep 05
Posts: 23
Credit: 58,591
RAC: 0
Message 2792 - Posted: 10 Nov 2005, 10:38:48 UTC

Doh...I just read David's post...yes it has been discussed before.
ID: 2792 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile stephan_t
Avatar

Send message
Joined: 20 Oct 05
Posts: 129
Credit: 35,464
RAC: 0
Message 2793 - Posted: 10 Nov 2005, 11:47:27 UTC

As the OP said, it's nothing new... but I reckon that we are now approaching the point where cheating might become widespread (see my previous post on the redundancy thread). It just needs someone to release a client with inflated bench numbers.

I'm going to stick with Rosetta regardless but I think it's time anti-cheat procedure be put in place.
Team CFVault.com
http://www.cfvault.com

ID: 2793 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Paul D. Buck

Send message
Joined: 17 Sep 05
Posts: 815
Credit: 1,812,737
RAC: 0
Message 2799 - Posted: 10 Nov 2005, 12:34:10 UTC

Which is going to be a problem unless and until we do something like my proposal using double-blind benchmark testing. FLOPS counting sounds like a cure, but all I have to do is edit the data counted and I can "cook" the books again ...

Well, we shall see if anything is done. Sad to say, until and unless the projects begin to ask for changes and improvements it is not likely we shall see anything happening (unless a C++ coder comes along and does it for us).
ID: 2799 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile [B^S] Paul@home
Avatar

Send message
Joined: 18 Sep 05
Posts: 34
Credit: 393,096
RAC: 0
Message 2862 - Posted: 11 Nov 2005, 0:47:23 UTC
Last modified: 11 Nov 2005, 0:53:25 UTC

@stephan_t: you dont even need to compile your own core client. The bog standard app will claim off-the-chart credit if you want it to. (takes a couple seconds to set up!!)

@paul D.B: I read your proposal and it sounds very interesting. Would certainly make cheating alot harder and would make the granting process much fairer for everyone

cheers,

Paul.
Wanna visit BOINC Synergy team site? Click below!

Join BOINC Synergy Team
ID: 2862 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile dgnuff
Avatar

Send message
Joined: 1 Nov 05
Posts: 350
Credit: 24,773,605
RAC: 0
Message 3363 - Posted: 16 Nov 2005, 3:20:04 UTC - in response to Message 2799.  


Well, we shall see if anything is done. Sad to say, until and unless the projects begin to ask for changes and improvements it is not likely we shall see anything happening (unless a C++ coder comes along and does it for us).


I'm slowly digging into the Boinc sources, I already have one small change in the works that a number of Windows users have asked for. Couple of questions come to mind:

1. How do I send my modifications back to Boinc "home base" so that they can be audited, and if found to be OK, integrated into the main code base.

2. What exactly is the nature of the changes that would be needed to try to help solve the "cheating on benchmarks" problem?

As it is, I understand the current nature of the beast is that credit is handed out based on (Time taken * Benchmark numbers). So if I cheat and increase the benchmark numbers, I get more credit.

It seems to me that what you have in mind is some way to actually monitor the number of FLOPS done by the CPU, and use that as a metric to determine credit. On the Mips (at least the one in the PS/2), they have registers that will count this sort of stuff for you without slowing down the CPU. As far as I know, there's no corresponding mechanism on the X86 architecture, which is where a good percentage of Boinc lands. OC I could be wrong about that .....

P.S. I'm a C++ coder. :)
ID: 3363 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
John McLeod VII
Avatar

Send message
Joined: 17 Sep 05
Posts: 108
Credit: 195,137
RAC: 0
Message 3365 - Posted: 16 Nov 2005, 3:41:47 UTC - in response to Message 3363.  

1. How do I send my modifications back to Boinc "home base" so that they can be audited, and if found to be OK, integrated into the main code base.

Email davea at ssl dot berkeley dot edu


BOINC WIKI
ID: 3365 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Divide Overflow

Send message
Joined: 17 Sep 05
Posts: 82
Credit: 921,382
RAC: 0
Message 3431 - Posted: 16 Nov 2005, 19:03:11 UTC
Last modified: 16 Nov 2005, 19:05:11 UTC

You should also consider joining the BOINC development email list:
http://www.ssl.berkeley.edu/mailman/listinfo/boinc_dev
ID: 3431 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Message boards : Number crunching : Wow...I can cheat on credit!



©2024 University of Washington
https://www.bakerlab.org