A Challenge

Message boards : Number crunching : A Challenge

To post messages, you must log in.

Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · Next

AuthorMessage
tralala

Send message
Joined: 8 Apr 06
Posts: 376
Credit: 581,806
RAC: 0
Message 24983 - Posted: 26 Aug 2006, 13:54:41 UTC - in response to Message 24981.  


Well you managed to slide right past my point.

It has been said that the clients are not equal.
The Mac client does not use Altivec therefore missing a major part of the processor.
Linux has always been shunned by the small credit for their work. The new credit system shows that they were shortchanged.
Windows gets the most attention by the developers.
None of these clients are using all of the processors power in any platform.
This is what needs to get fixed for my computers to go back online.
If all the clients were written to take advantage of all the features of operating system including hardware (Optimized) there would be a balance between them.
Then the project would get so much more science done than they know what to do with.


You seem to assume that this is a trivial task? It is not. The project staff dedicated a lot of energy in optimizing Rosetta for all platforms. In another post you assume that they focus mainly on Windows, which they do not. Where do you have your information that they do? Rosetta is a very complex app and much harder to optimize as for example Seti or Einstein, which basically search for something which isn't there in noise (pun intended). ;-)

As I said some people already looked at the code and the first they agreed on is, that further optimizations are not trivial and obvious for all platforms. The G4 and G5 processors just are not that efficient for the Rosetta app, as for many other apps. For some apps they are much more efficient. That is basically what makes the difference between different architectures.

Bottom line: The develpers put as much effort in optimizing for Mac as reasonable and possible. The current dissatisfying speed is not due to laziness from them. If you happen to know any person who might be able to suggest on concrete optimizations for Altivec please feel free to contact me: joachim@iwanuschka.de

ID: 24983 · Rating: 5 · rate: Rate + / Rate - Report as offensive    Reply Quote
FluffyChicken
Avatar

Send message
Joined: 1 Nov 05
Posts: 1260
Credit: 369,635
RAC: 0
Message 24998 - Posted: 26 Aug 2006, 15:48:11 UTC - in response to Message 24981.  
Last modified: 26 Aug 2006, 16:01:06 UTC


I don't agree with you GHz relation.

If the 12.3GHz under Linux worked slower than the 12.3GHz under Windows then it does less work. Be it the fault of the Operating System, the Compiler that compiler Rosetta, so what since it's crunches at a slower wait.
Similar thing with the Mac.
It's the through put of actual useful calculations that is the measure. Not just a frequency of cycles on a CPU.

A computer that does a job/task/work unit should get the exact same 'points/credit/work done' as another computer that does that same workunit no matter what type of computer it is.


What I would like to know is if the Rosetta Windows compile is slower or faster than the Rosetta Linux compile.
Has anyone seen (or can anyone run a task manually) to find out ?


Well you managed to slide right past my point.

It has been said that the clients are not equal.
The Mac client does not use Altivec therefore missing a major part of the processor.
Linux has always been shunned by the small credit for their work. The new credit system shows that they were shortchanged.
Windows gets the most attention by the developers.
None of these clients are using all of the processors power in any platform.
This is what needs to get fixed for my computers to go back online.
If all the clients were written to take advantage of all the features of operating system including hardware (Optimized) there would be a balance between them.
Then the project would get so much more science done than they know what to do with.


And you missed my point, Not everything is equal.


As for the linux points lower, nothing to do with Rosetta and not their fault, that is BOINC's doing (and hence Rosetta have now treid to do something about that) It does not make it any faster or slower though).


I said if (or maybe implied ;-) If you put Linux and Windows on a computer (the same computer, dual boot), if the Linux Rosetta takes 1hr longer than the Windows Rosetta then Linux credits/hr should be lower no matter what. It does not matter what is under the hood.

But you seem to miss something,
The Rosetta code needs to remain compatible across platforms, putting optimisations in that cannot be switch of and/or maintained properly would be a nightmare. It is used in more places than just here.
So like most places they use a compiler to do the hard work, if the compilers crap then don't blame Rosetta, blame to people that make the compiler.

They also have limited resources, this is not normally money but time and (wo)man hours. So if it was my time I would aim for Windows platform since by far the majority of users run Windows. You improve the code a little for windows users with less effort and you get a large reward. You mess about adjusting the code for a limited user base with 'Altivec' dodars where it's something the compiler should do for them, you waste a lot of time when it could have ben used for their science part (remember they are scientist not dedicated programmers).

I would much rather do somthing not using all the power than do nothing at all. My way at least something gets done and I can help while they try to improve things.


That being said, if you want to look over the code OR pay for somebady to look over the code for them and dedicate their time for you Altivec code then I think they would be very happy :-)

For Rosetta


Team mauisun.org
ID: 24998 · Rating: 4 · rate: Rate + / Rate - Report as offensive    Reply Quote
R.L. Casey

Send message
Joined: 7 Jun 06
Posts: 91
Credit: 2,728,885
RAC: 0
Message 25000 - Posted: 26 Aug 2006, 15:57:09 UTC
Last modified: 26 Aug 2006, 15:59:08 UTC

With regard to "optimization" of the Rosetta application(s), the info from the projet team, along with many constructive discussion threads, suggests that, to Rosetta, the "optimal" application is one that can be modified cheaply and quickly, since the algorithms and heuristics that the application uses are under constant revision in order to further the science. While speed and memory footprint are important--and have been addressed by the developers--they are secondary to having an application that is "agile" and able to be redirected with data files, along with code changes. "Optimal" just doesn't always mean "fast."
I am fond of the old saying about system development that has served me and my colleagues well over the years:

----> "Make it work first, then make it work fast." <----

Edit: BBCode-challenged typos...
ID: 25000 · Rating: 4 · rate: Rate + / Rate - Report as offensive    Reply Quote
Laurenu2

Send message
Joined: 6 Nov 05
Posts: 57
Credit: 3,818,778
RAC: 0
Message 25088 - Posted: 27 Aug 2006, 7:12:22 UTC

This to David Baker
It seems you have a No Win situation here
#1 you can not take away the points given in the past for the members that used opt. clients because is was said it was said by your staff that it was not against Rosetta's rules to do so
#2 If you do not reduce the past points the other 1/2 will feel they have been cheated. And will be mad at Rosetta for saying it was OK to use the opt. clients
So you (Rosetta) are in a No win situation here
Here is one thing you might consider to end this mater
#1 End Rosetta close the points

#2 Start Rosetta 2 with a new secure client that is run on the new point system and lets all start all over again

This post was from the call of carl.h for "O.k. guys...Positive input only. That means no tearing the other guys post.



If You Want The Best You Must forget The Rest
---------------And Join Free-DC----------------
ID: 25088 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
mnb

Send message
Joined: 15 Dec 05
Posts: 51
Credit: 69,458
RAC: 0
Message 25090 - Posted: 27 Aug 2006, 7:33:20 UTC

#2 There is no other half. Another group of few people might leave when they finally realise that the credits will not be backdated.

list of my results
ID: 25090 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
tralala

Send message
Joined: 8 Apr 06
Posts: 376
Credit: 581,806
RAC: 0
Message 25106 - Posted: 27 Aug 2006, 10:04:49 UTC - in response to Message 25088.  

This to David Baker
It seems you have a No Win situation here
#1 you can not take away the points given in the past for the members that used opt. clients because is was said it was said by your staff that it was not against Rosetta's rules to do so
#2 If you do not reduce the past points the other 1/2 will feel they have been cheated. And will be mad at Rosetta for saying it was OK to use the opt. clients
So you (Rosetta) are in a No win situation here
Here is one thing you might consider to end this mater
#1 End Rosetta close the points

#2 Start Rosetta 2 with a new secure client that is run on the new point system and lets all start all over again

This post was from the call of carl.h for "O.k. guys...Positive input only. That means no tearing the other guys post.


The situation is indeed unpleasant. Backdating was mainly discarded because of the tumultuous protest from XtremeSystem. In the meantime they left anyway and now we have exactly the situation as described here. I doubt this was intentionally or planned by XS but the result is the same.

That said I don't think starting over with zero credit will be a solution. Others will protest and leave because of that and in the end more people will be unhappy. Or could you guarantee lots of new hosts if the credit system was reset? ;-)
ID: 25106 · Rating: 2 · rate: Rate + / Rate - Report as offensive    Reply Quote
kevint

Send message
Joined: 8 Oct 05
Posts: 84
Credit: 2,530,451
RAC: 0
Message 25202 - Posted: 28 Aug 2006, 3:51:52 UTC - in response to Message 24905.  
Last modified: 28 Aug 2006, 4:14:08 UTC

XS_Vietnam_Soldiers,

I could present it at the boinc workshop (unless he/she plans to, I don't know who is going to attend) as I am sure all would be interested.




I saw this, looks interesting, and I think it would be good for some crunchers to go -
If there is still room. It is suppose to be open for all interested in BOINC, not just developers but crunchers as well.. Might be a good opportunity to chat about the crunchers frusterations and idea's.


SETI.USA


ID: 25202 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
kevint

Send message
Joined: 8 Oct 05
Posts: 84
Credit: 2,530,451
RAC: 0
Message 25203 - Posted: 28 Aug 2006, 3:57:09 UTC - in response to Message 24909.  

..and now I am gone.
Movieman



Does this mean you are quiting the project ? Just as our SIMAP challenge has ended and I am going to be coming back online, at least partly -
And I wanted to give you a good chase

Where are you going ? Maybe I should go to your team web site and say hi,

Stop in and visit me at www.setiusa.net



SETI.USA


ID: 25203 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
kevint

Send message
Joined: 8 Oct 05
Posts: 84
Credit: 2,530,451
RAC: 0
Message 25206 - Posted: 28 Aug 2006, 4:10:40 UTC - in response to Message 25088.  

This to David Baker
#1 you can not take away the points given in the past for the members that used opt. clients because is was said it was said by your staff that it was not against Rosetta's rules to do so
#2 If you do not reduce the past points the other 1/2 will feel they have been cheated. And will be mad at Rosetta for saying it was OK to use the opt. clients
So you (Rosetta) are in a No win situation here
Here is one thing you might consider to end this mater




The crunchers that feel they have been cheated by not using the optimized BOINC app.. well - all I can say to that is hmmm.. if they feel this way, maybe they should have upgraded.

If they do not care about credits and only the science then it should not matter one way or another. But don't complain.

Credits will not be back dated, so everyone just get over it and get on with it.
SETI.USA


ID: 25206 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Tymbrimi
Volunteer moderator
Avatar

Send message
Joined: 22 Aug 06
Posts: 148
Credit: 153
RAC: 0
Message 25243 - Posted: 28 Aug 2006, 9:50:33 UTC - in response to Message 25216.  

From Tony DeBari
The crunchers that feel they have been cheated by not using the optimized BOINC app.. well - all I can say to that is hmmm.. if they feel this way, maybe they should have upgraded.

Third-party BOINC core clients are not an upgrade. They are a niche product created for a specific purpose. Using them to increase credit output - but not science output - by exploiting Rosetta's previous quorum-of-one credit system (and having the project staff regard this behavior as acceptable) irks people who believe in equal credit for equal work.
If they do not care about credits and only the science then it should not matter one way or another. But don't complain.

I care about the science first and foremost. And even though some on this board would label me a ZeroRACer, I care about the credits in the sense that the only reason someone should have a higher RAC than me is if they actually produce more science output than I do. I have the utmost respect for people who have the dedication and the resources to crunch more work in one hour than I can in a week.

[flamebait comment deleted]

Credits will not be back dated, so everyone just get over it and get on with it.

This I agree with. There is so much to pick apart with the new credit system that there's no need to keep rehashing the old one.

Regards,

-- Tony


Rosetta Moderator: Mod.Tymbrimi
ROSETTA@home FAQ
Moderator Contact
ID: 25243 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Steve Cressman
Avatar

Send message
Joined: 25 Jul 06
Posts: 23
Credit: 9,432
RAC: 0
Message 25314 - Posted: 28 Aug 2006, 19:27:57 UTC - in response to Message 25206.  


The crunchers that feel they have been cheated by not using the optimized BOINC app.. well - all I can say to that is hmmm.. if they feel this way, maybe they should have upgraded.

It has been stated b4 that it was impossible for us to do that because then we would have been causing the same problem at other projects that happened here with overclaiming.
98SE XP2500+ @ 2.1GHz Boinc v5.8.8

And God said"Let there be light."But then the program crashed because he was trying to access the 'light' property of a NULL universe pointer.
ID: 25314 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile carl.h
Avatar

Send message
Joined: 28 Dec 05
Posts: 555
Credit: 183,449
RAC: 0
Message 25318 - Posted: 28 Aug 2006, 19:36:15 UTC

Steve, why do other projects matter ? It`s been stated that other projects did/do not have this problem due to quorums or other ?

Do you think in those other projects that work on quorums you have at anytime gained by getting extra from other crunchers in the quorum who have used 5.5 or such ? Did you give the points back ?
Not all Czech`s bounce but I`d like to try with Barbar ;-)

Make no mistake This IS the TEDDIES TEAM.
ID: 25318 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Saenger
Avatar

Send message
Joined: 19 Sep 05
Posts: 271
Credit: 824,883
RAC: 0
Message 25321 - Posted: 28 Aug 2006, 20:03:10 UTC - in response to Message 25318.  

Steve, why do other projects matter ? It`s been stated that other projects did/do not have this problem due to quorums or other ?

Do you think in those other projects that work on quorums you have at anytime gained by getting extra from other crunchers in the quorum who have used 5.5 or such ? Did you give the points back ?

Other projects matter. Perhaps not for you, but for a lot of people, especially from the big teams, like BoincSynergy, SETI.Germany, SETI.USA and such.

There is a standard in BOINC, and though it's not a really good and perfect one, the "optimised" 5.5.0 went off far too much on non-optimised applications like Rosetta, LHC, QMC and others. LHC has a quorum, so it didn't really matter, as 5.5.0 is here as everywhere just a client for a minority, and it's sorted out by the quorum. Rosetta and QMC don't have a quorum, so those who use it get an unfair advantage in credits without doing more in science. Why should the majority (stock client) follow a vocal minority ("opt." client) to get even? If you just keep everything in the standard BOINC, it's just fine.
ID: 25321 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile carl.h
Avatar

Send message
Joined: 28 Dec 05
Posts: 555
Credit: 183,449
RAC: 0
Message 25322 - Posted: 28 Aug 2006, 20:07:27 UTC
Last modified: 28 Aug 2006, 20:08:57 UTC

It isn`t sorted by a quorum though.

If say, there is a quorum of three and two are claiming using 5.5, the higher points are awarded even to the std.

I`m not arguing the point for or against 5.5 just stating what I believe are facts.
Not all Czech`s bounce but I`d like to try with Barbar ;-)

Make no mistake This IS the TEDDIES TEAM.
ID: 25322 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Whl.

Send message
Joined: 29 Dec 05
Posts: 203
Credit: 275,802
RAC: 0
Message 25325 - Posted: 28 Aug 2006, 20:35:11 UTC - in response to Message 25321.  
Last modified: 28 Aug 2006, 20:37:21 UTC

Steve, why do other projects matter ? It`s been stated that other projects did/do not have this problem due to quorums or other ?

Do you think in those other projects that work on quorums you have at anytime gained by getting extra from other crunchers in the quorum who have used 5.5 or such ? Did you give the points back ?

Other projects matter. Perhaps not for you, but for a lot of people, especially from the big teams, like BoincSynergy, SETI.Germany, SETI.USA and such.

There is a standard in BOINC, and though it's not a really good and perfect one, the "optimised" 5.5.0 went off far too much on non-optimised applications like Rosetta, LHC, QMC and others. LHC has a quorum, so it didn't really matter, as 5.5.0 is here as everywhere just a client for a minority, and it's sorted out by the quorum. Rosetta and QMC don't have a quorum, so those who use it get an unfair advantage in credits without doing more in science. Why should the majority (stock client) follow a vocal minority ("opt." client) to get even? If you just keep everything in the standard BOINC, it's just fine.


Hows about this then ? Picked at random. I give no names for obvious reasons.

A Seti.Germany member.

<core_client_version>5.5.0</core_client_version>
<stderr_txt>
# random seed: 3432459
# cpu_run_time_pref: 28800
# DONE :: 1 starting structures built 79 (nstruct) times
# This process generated 80 decoys from 80 attempts


A BoincSynergy member.

<core_client_version>5.5.0</core_client_version>
<stderr_txt>
# random seed: 1079336
# cpu_run_time_pref: 3600
# DONE :: 1 starting structures built 6 (nstruct) times
# This process generated 7 decoys from 7 attempts


A SETI.USA member.

<core_client_version>5.5.0</core_client_version>
<stderr_txt>
# random seed: 1165285
# cpu_run_time_pref: 10800
# DONE :: 1 starting structures built 17 (nstruct) times
# This process generated 17 decoys from 17 attempts


ID: 25325 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Ananas

Send message
Joined: 1 Jan 06
Posts: 232
Credit: 752,471
RAC: 0
Message 25341 - Posted: 28 Aug 2006, 22:02:29 UTC
Last modified: 28 Aug 2006, 22:12:44 UTC

You will find Crunch3r core clients in all bigger teams, especially in those with a strong share for SETI@Home.

None of those more or less inhomogenous teams has any control over the client that the people use. Compare the total number of crunchers for SETI.Germany with the number of people using the SETI.Germany forum frequently and you will understand why it is impossible to influence anything there.

Those teams have quite an average mix of client types, from 4.19 up to the latest one, including all flavours of optimized clients - keyword is "average" here, which is quite a difference to a team which has nearly nothing but the highest optimized clients.


p.s.: Imo. the member movement shows a very clear picture : Those who do use 5.5.0 and still stay here are at Rosetta are really interested to help the Rosetta science. Those who use 5.5.0 and are going to QAH now, are interested only in the credits. I wonder where they will go when QAH stops using the BOINC benchmark system (it has been announced).
ID: 25341 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile carl.h
Avatar

Send message
Joined: 28 Dec 05
Posts: 555
Credit: 183,449
RAC: 0
Message 25342 - Posted: 28 Aug 2006, 22:19:24 UTC

Ananas whilst your post stays analytical, I find it relevant and maybe useful, howether your ps tainted it and was an assumption.

Since all Boinc scores are skewed, and the people who called the most for a fairer credit system to be implemented are mostly cross project have they asked at all projects for such ?

Have these people asked Boinc to implement a fair system and reset the scores ?
Not all Czech`s bounce but I`d like to try with Barbar ;-)

Make no mistake This IS the TEDDIES TEAM.
ID: 25342 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Ananas

Send message
Joined: 1 Jan 06
Posts: 232
Credit: 752,471
RAC: 0
Message 25348 - Posted: 28 Aug 2006, 22:54:52 UTC
Last modified: 28 Aug 2006, 22:58:18 UTC

The BOINC benchmark has been a matter of many complaints, especially in the beginning when SETI migrated. We often pointed out the flaws. With 4.13 and 4.19, it was possible to double the benchmark results by making a program with high priority eat all CPU power of one CPU on a dual CPU host, 5.x isn't much better, a background program using no CPU time is able to reduce the integer benchmark to 10%, Linux still has totally crappy results - the BOINC benchmark is the most unreliable instrument to measure work done.

Many of those who complained gave up sooner or later and got used to claims varying by factor 3, but there the quorum reduced the impact of the flaws. With projects like Rosetta and QAH those flaws got a new dimension.

The reason, why Akos F. is not interested in helping Rosetta has been the quorum together with the benchmark. Maybe with the new system it would be possible to make him tweak the project clients and support the Rosetta developers team. (p.s.: I bet he will say : "75% speedup is possible" ;-) )

The first thing some people ask in new projects is : when will you switch to fixed credits?

Many multiproject BOINC crunchers are definitely not happy with this situation.
ID: 25348 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Whl.

Send message
Joined: 29 Dec 05
Posts: 203
Credit: 275,802
RAC: 0
Message 25358 - Posted: 29 Aug 2006, 0:41:20 UTC
Last modified: 29 Aug 2006, 0:47:31 UTC


There is a standard in BOINC, and though it's not a really good and perfect one, the "optimised" 5.5.0 went off far too much on non-optimised applications like Rosetta, LHC, QMC and others. LHC has a quorum, so it didn't really matter, as 5.5.0 is here as everywhere just a client for a minority, and it's sorted out by the quorum. Rosetta and QMC don't have a quorum, so those who use it get an unfair advantage in credits without doing more in science. Why should the majority (stock client) follow a vocal minority ("opt." client) to get even? If you just keep everything in the standard BOINC, it's just fine.


Saenger, I counted 4 different flavours of overclaiming clients on the first page alone of SETI.Germany members (your team). I could'nt check the hidden ones on the first page BTW. I stopped after the first page. Hmmmmm 450 members ? That is a lot of members.

ID: 25358 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
FluffyChicken
Avatar

Send message
Joined: 1 Nov 05
Posts: 1260
Credit: 369,635
RAC: 0
Message 25454 - Posted: 29 Aug 2006, 18:03:51 UTC

The is going to come a time when the corss project credit people will have to give up, isnce not all porjects will be CPU based. How do you start scoring projects that do not do work based on CPU strength (like XtremLabs, they tried fixed, one or two people complained so they changed it to Boinc standard, but Xtrem where right slow CPU's do jsut as much work as a super duper fast CPU, so all should get the same). When GPU or projects like DIMES start using boinc, what then ?

Cross project credits is also broken like with seti 'optimised' apps since the optimised apps are not really doing more work (they are just more efficient, they do less work to get teh same result so why should they get more than me here for the same of flip-flops ;-)
Team mauisun.org
ID: 25454 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · Next

Message boards : Number crunching : A Challenge



©2024 University of Washington
https://www.bakerlab.org