Message boards : Number crunching : Rosetta alpha ??
Author | Message |
---|---|
River~~ Send message Joined: 15 Dec 05 Posts: 761 Credit: 285,578 RAC: 0 |
Is there a Rosetta Alpha project? If not, can I put in a plea for you to start one ASAP. You have had a series of annoying bugs that have affected participants, and this is no surprise to anyone who has worked in the software industry. You will never stop producing a certain percentage of buggy apps unless you stop producing new apps altogether. It seems to me you could usefully screen new apps before general release and after hands-on testing by the original programmers which you already do. A trial release of 1000 or so WU to people willing to be guinea pigs, willing to keep a more careful watch on their boxes than the average participant, and self-selected as having some idea of how to report bugs or being willing to learn -- does that sound useful? All that can be yours with an alpha project. Participants will, if asked, sort themselves into three groups. Firstly those who enjoy finding bugs and will willingly join an Alpha project, and who are likely to be able to offer the most useful feedback to the project programmers. Secondly those who want their machines to be set and forget -- so they can tell their parents they are working on a biochem project without putting in any direct effort. And the third group is like me -- I have some machines where it is convenient to check daily and some where it is not. I'd join the first lot of boxes to alpha but not the second. It would not need new servers, just another instance of the existing BOINC software on the servers you already have, and a new master url at (say) /rosalpha instead of /rosetta. As I imagine it being used, the first WU for any app, or any new protein, would be sent to the alpha project. They would continue to be restricted to the alpha project till (say) 1000 WU had completed without nasty surprises - by which time more than 1000 would have been issued. After that the series would continue on the mainstream rosetta, and hopefully it would be a simple script to feed the successful alpha results through to the scientific databases for the results to be used together. Equally, dud results from buggy apps could easily be binned, and those problems could be identified and fixed without alienating the set-and-forget donors, and without frightening off newcomers who are unlucky enough to arrive at the wrong time. Alpha participants would also still be attached to the mainstream project for those times when there was no work in alpha. At first it woud be a bit more work for your programming team setting it all up, but I think the benefits of faster feedback on innovative WU, and of fewer confused mainstream participants would make it worthwhile. I would also hope that in the longer term it would actually save programmer time. |
David E K Volunteer moderator Project administrator Project developer Project scientist Send message Joined: 1 Jul 05 Posts: 1018 Credit: 4,334,829 RAC: 0 |
We are seriously considering setting up a test server in house to test work units before they go out to production, due to the recent issues. The problem was/is that we were/are trying to do too much before the holidays. |
Tern Send message Joined: 25 Oct 05 Posts: 576 Credit: 4,695,450 RAC: 15 |
I think an in-house SET of systems is an absolute requirement. A Windows XP box, a Linux box, and a Mac, would be the bare minimum. The first step after a programmer has come in and said "this is ready to ship", or a scientist has come in and said "here's the new WUs ready to send", would be to run for a day or so on the in-house systems. THEN, I think if there was _any_ reasonable "risk factor" involved, (always on an app, I don't know on WUs) River's idea of Rosalpha (Ralph?*) would be good. Just another project we could attach to, high resource share because it would rarely have work to send. Wouldn't mess with credits on it, unless you _did_ steal a lot of time... Make deadlines as short as you want there too, so you don't have to wait long for the feedback. Anyway, this would give you dozens or hundreds of "test systems" - at ZERO dollar cost. ---- *bizarre random brain cells firing, sleep deprivation mode; Rosetta Alpha; Rosalpha; R-alpha; Ralph; wasn't that the girl's name who was the tractor mechanic on Green Acres? Somehow Ralph just seems like a perfect project name for this... |
David E K Volunteer moderator Project administrator Project developer Project scientist Send message Joined: 1 Jul 05 Posts: 1018 Credit: 4,334,829 RAC: 0 |
Ralph it is. One more thing to add to the list of things to do for this project. But, I agree, this is a necessity. |
Tern Send message Joined: 25 Oct 05 Posts: 576 Credit: 4,695,450 RAC: 15 |
One more thing to add to the list of things to do for this project. But, I agree, this is a necessity. You didn't think this was going to be SIMPLE did you? :-) Have a good holiday. |
dgnuff Send message Joined: 1 Nov 05 Posts: 350 Credit: 24,773,605 RAC: 0 |
Ralph it is. Said in my best Wallace voice (*) (of Wallace and Gromit fame) "We'll call it Ralph." (*) The voice is actually that of Peter Sallis, and is, IMHO, a work of casting genius. But them I'm biased, having seen Peter Sallis in many episodes of Last of the Summer Wine. |
River~~ Send message Joined: 15 Dec 05 Posts: 761 Credit: 285,578 RAC: 0 |
We are seriously considering setting up a test server in house to test work units before they go out to production, due to the recent issues. After the in-house testing and before general release, it is well worth issuing WU to volunteer guinea pigs who promise to repoert any problems and promise not to get upset by them. So I suggest around 1000 volunteers to help with this -- out here in the community is a much bigger diversity of different test rigs than anything you could put together in the lab. You will get plenty - Orbit got 1000 alpha testers in a week - and they did not even have any code at the time they called for volunteers. The problem will be you will get too many, so be sure to know how to turn off account creation on the alpha accounts, and have a polite 'thanks but no thanks' page prepred in advance for those that miss the chance. The problem was/is that we were/are trying to do too much before the holidays. an understandable temptation, but on a DC project not one you are likely to get away with... 20,000x as many chances to find sneaky bugs and 20,000x the embarrassment when they do... River~~ |
River~~ Send message Joined: 15 Dec 05 Posts: 761 Credit: 285,578 RAC: 0 |
Wouldn't mess with credits on it, unless you _did_ steal a lot of time... I'd like credits. Not for the impact on my overall scores, but so my involvment in a limited edition project shows in my stats sig. I may be crazy, but I'm more proud of my 50 cobblestones of pirates credit than of my 39k CPDN. Especially as its the only project where I'm ever likley to beat a certain high scorer who only got... petty? On one level the credits are always beside the point, but they seem to matter to some donors. And cobblestones cost a lot less than pounds or dollars. BOINC out of the box does credits, and making the XML stats available once a day is not hard given that you've cracked it for the mainstream project. <flimsy rationalisation/> And then again, you want to test whether the credit scoring is broken by the new app don't you? </flimsy rationalisation> Make deadlines as short as you want there too, so you don't have to wait long for the feedback. Absolutely. This project is for the developer's benefit, not for the scientists. But not tight enough to push every box into EDF or you will not be testing the effects of pre-emption, which we already know is a Rosetta issue.
ho hum, oh well a Rosetta by any other name would smell as sweet River~~ ----- see those 50 credits in the last row ;-) |
Tern Send message Joined: 25 Oct 05 Posts: 576 Credit: 4,695,450 RAC: 15 |
I'd like credits. Not for the impact on my overall scores, but so my involvment in a limited edition project shows in my stats sig. True... which brings up the fact that even if the URL is "ralph", the exported project in the xml should be spelled out "Rosetta Alpha"... :-) Unless the "limited edition" project would gain a mystique from having a bizarre name to make people ask about it. Whatever. |
River~~ Send message Joined: 15 Dec 05 Posts: 761 Credit: 285,578 RAC: 0 |
...even if the URL is "ralph", the exported project in the xml should be spelled out "Rosetta Alpha"... :-) Unless the "limited edition" project would gain a mystique from having a bizarre name to make people ask about it. Whatever. Like Pirates being a support project for Einstein, developing screensavers and suchlike. Pirates originally so-called because it wasn't a part of the Einstein project team, but then the name took over and gave it a life of its own. Ralph is OK by me, shiver me timbers let's start off with an in-joke ;-) River~~ |
Keck_Komputers Send message Joined: 17 Sep 05 Posts: 211 Credit: 4,246,150 RAC: 0 |
...even if the URL is "ralph", the exported project in the xml should be spelled out "Rosetta Alpha"... :-) Unless the "limited edition" project would gain a mystique from having a bizarre name to make people ask about it. Whatever. I like ralph. That really will be an entertaining tag line in the stats sigs. It will give me another project to use my pirate name on as well hehe. BOINC WIKI BOINCing since 2002/12/8 |
Aaron Finney Send message Joined: 8 Oct 05 Posts: 52 Credit: 109,589 RAC: 0 |
If there is a beta (alpha, really) for this project.. I'd like to be a part of it also David :) pretty please |
Divide Overflow Send message Joined: 17 Sep 05 Posts: 82 Credit: 921,382 RAC: 0 |
I'd like to join Ralph as well, whenever it's ready. |
Yeti Send message Joined: 2 Nov 05 Posts: 45 Credit: 14,945,062 RAC: 0 |
|
Tern Send message Joined: 25 Oct 05 Posts: 576 Credit: 4,695,450 RAC: 15 |
RALPH seems to be a good idea, you could count me in. Anybody who would join a project called BURP... :-P |
KSMarksPsych Send message Joined: 15 Oct 05 Posts: 199 Credit: 22,337 RAC: 0 |
Oooo! Oooo! I want to play too. Can I play with "Ralph" when he's ready to come out and play! Kathryn Kathryn :o) The BOINC FAQ Service The Unofficial BOINC Wiki The Trac System More BOINC information than you can shake a stick of RAM at. |
Paul D. Buck Send message Joined: 17 Sep 05 Posts: 815 Credit: 1,812,737 RAC: 0 |
Oooo! Oooo! I want to play too. Can I play with "Ralph" when he's ready to come out and play! Kathryn, And here I thought you were sensable ... :) Aside from BOINC beta, I have stayed away from the test projects and have been very happy with the results ... :) |
Eremita Send message Joined: 6 Oct 05 Posts: 1 Credit: 19,253 RAC: 0 |
RALPH seems to be a good idea, you could count me in. I've yet joined BURP, so joining Ralph too isn't so bad for me... See you soon |
KSMarksPsych Send message Joined: 15 Oct 05 Posts: 199 Credit: 22,337 RAC: 0 |
Oooo! Oooo! I want to play too. Can I play with "Ralph" when he's ready to come out and play! I work with kids almost 10 hours a day. I lost all my sensibility when I took this job. Kathryn :o) The BOINC FAQ Service The Unofficial BOINC Wiki The Trac System More BOINC information than you can shake a stick of RAM at. |
Message boards :
Number crunching :
Rosetta alpha ??
©2024 University of Washington
https://www.bakerlab.org