"Sneaker-netting" Rosetta: Quad to Laptop

Message boards : Number crunching : "Sneaker-netting" Rosetta: Quad to Laptop

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
The_Bad_Penguin
Avatar

Send message
Joined: 5 Jun 06
Posts: 2751
Credit: 4,271,025
RAC: 0
Message 45282 - Posted: 22 Aug 2007, 23:35:28 UTC

My Dell 9200 Q6600 quadcore arrived today.

Long story short, the only internet access I will have for the next two weeks is via my laptop at the local library.

Once or twice before when I've lost internet access, I've tried unsuccessfully to "sneaker-net" my AMD desktop results to the laptop, and bring the laptop to internet access.

To potentially gain two weeks of 100% Rosetta crunching on a quadcore, I'm willing to try one more time.

If anyone can suggest how I can use a laptop and flash drive to get an isolated quadcore to run Rosetta workunits, I'm game.

Worst that can happen is it doesn't work, and Rosie has to wait two more weeks for my RAC to start increasing again.

Thanx in advance.
ID: 45282 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Nemesis
Avatar

Send message
Joined: 12 Mar 06
Posts: 149
Credit: 21,395
RAC: 0
Message 45284 - Posted: 23 Aug 2007, 0:05:11 UTC - in response to Message 45282.  

Haul that puppy into the library, load it up, and take it home again :)

My Dell 9200 Q6600 quadcore arrived today.

Long story short, the only internet access I will have for the next two weeks is via my laptop at the local library.

Once or twice before when I've lost internet access, I've tried unsuccessfully to "sneaker-net" my AMD desktop results to the laptop, and bring the laptop to internet access.

To potentially gain two weeks of 100% Rosetta crunching on a quadcore, I'm willing to try one more time.

If anyone can suggest how I can use a laptop and flash drive to get an isolated quadcore to run Rosetta workunits, I'm game.

Worst that can happen is it doesn't work, and Rosie has to wait two more weeks for my RAC to start increasing again.

Thanx in advance.

ID: 45284 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
The_Bad_Penguin
Avatar

Send message
Joined: 5 Jun 06
Posts: 2751
Credit: 4,271,025
RAC: 0
Message 45285 - Posted: 23 Aug 2007, 0:08:57 UTC - in response to Message 45284.  

Don't think that I haven't thought about doing just that, lol !!!

Haul that puppy into the library, load it up, and take it home again :)

ID: 45285 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 45289 - Posted: 23 Aug 2007, 1:19:18 UTC

If you could fit the entire BOINC subdirectory structure on a memory stick, then it should be portable for you. Just change your BOINC icon to direct it to the .exe on the drive letter used by the stick.

To reduce the memory footprint, you would want to set your preference to crunch 24hrs per task. That way you need fewer tasks to keep your 4 cores busy.

If it doesn't fit, you could zip up the whole structure for the transport. And if you get deeper in to it, you can find the slots directory where the currently crunching tasks are, and the results files where the compelted tasks are and just copy those... but that sounds like where you may have run in to trouble in your prior attempt.

And the transport could be a memory stick, USB to a SD-RAM, a CD-R, a rewritable DVD... it doesn't matter.

Just to be clear... you'd set up a NEW BOINC environment on your laptop (i.e. a new install path). Then download all of the work units and preferences. Then exit BOINC, bundle it up and load it on to the quad, and may as well delete it from the laptop. Run on the quad. Then when you are ready to report in the results, you'd just exit BOINC, bundle it all back up, restore it to the laptop and run BOINC from the new pathname. It should pick up right where the quad left off. Just as it does when you power up. It would then detect internet connection, report the results and get more work.

You might want to dummy up the benchmarks (i.e. make the ops/sec figures much higher) to help the laptop download enough work to keep 2 to 4 times more cores busy. That or get it used to a 1hr runtime preference, then change your runtime pref. to 24hrs, and your connect to network every... days at the same time and you'll have plenty of tasks.
Rosetta Moderator: Mod.Sense
ID: 45289 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
FluffyChicken
Avatar

Send message
Joined: 1 Nov 05
Posts: 1260
Credit: 369,635
RAC: 0
Message 45303 - Posted: 23 Aug 2007, 8:18:17 UTC

As Above, but I would install BOINC on the Quad to the USB drive.
Remembering to set it to No Network when it's not connected to the net ;-)


Then just attach to laptop when you need it and enable network and for it to do it's stuff.
(though close any existing boinc's running/services when you do this)

It works well like this, all of boinc will easily fit on a£10 flash drive ;-)

I used to do it a year and a half ago when I used Uni computers. I could even move from computer to computer around the uni.
Team mauisun.org
ID: 45303 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile dcdc

Send message
Joined: 3 Nov 05
Posts: 1829
Credit: 115,849,475
RAC: 59,455
Message 45305 - Posted: 23 Aug 2007, 8:33:07 UTC

what i would do is:

1. On laptop, install boinc to the memory stick.
2. Set the location for that computer using the online settings page.
3. Adjust the 'Connect to network about every' to 10.
4. Set the disk usage 'Use at most' settings very high, and the 'Leave at least' very low.
5. I would also increase the 'write to disk at most' setting (on my compactflash computer I use 600s) to reduce the number of writes to the flash drive.
6. Update BOINC to pick up these settings (using 'Update' under the Projects tab - or is it 'Retry Communications' in Tasks?)
7. After the queue has downloaded, now adjust the 'Target CPU run time' in the R@H preferences to something big - 24hrs would be good.
8. Exit BOINC and move memory stick to quad core.
9. If the drive letter is the same on the laptop and quad then you can skip this step. Otherwise, you need to go into the boincslots folder and edit the init_data.xml file to correct the path given in these tags:
<project_dir>
<boinc_dir>
Then save and close.
10. Start it crunching.

When moving this stick back to the laptop, don't forget to change the paths back before running boinc again! If running from the memory stick its probably easiest to set the drive letters to match on the two computers rather than having to edit init_data.xml every time. Easier still, install it to c:rah and then copy it to the same on the quad...

HTH
Danny
ID: 45305 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile dcdc

Send message
Joined: 3 Nov 05
Posts: 1829
Credit: 115,849,475
RAC: 59,455
Message 45306 - Posted: 23 Aug 2007, 8:34:22 UTC - in response to Message 45303.  

As Above, but I would install BOINC on the Quad to the USB drive.
Remembering to set it to No Network when it's not connected to the net ;-)


Then just attach to laptop when you need it and enable network and for it to do it's stuff.
(though close any existing boinc's running/services when you do this)

but make sure the path is the same, or edit init_data.xml!
ID: 45306 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Jmarks
Avatar

Send message
Joined: 16 Jul 07
Posts: 132
Credit: 98,025
RAC: 0
Message 45309 - Posted: 23 Aug 2007, 12:34:43 UTC

Great idea dcdc. If those are the settings you setup I think you would not need to network for 10 days this way.
Jmarks
ID: 45309 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 45312 - Posted: 23 Aug 2007, 13:34:31 UTC
Last modified: 23 Aug 2007, 13:37:45 UTC

Thanks for adding those key details. I guess I always ended up with same drive letter, and so was unaware of them.

I wanted to just remind you about the 10day deadline to report back results.

Also, I wanted to add the disclaimer for future readers that at this point Rosetta is not optimised for specific CPUs, only specific operating systems. In the description here, we are all assuming that the two machines are running the same operating system. If, in the future, CPU-specific optimizations are made to the application, then all of this would only be expected to work properly if the two machines were both running the same OS and using the same CPU type.

This also implies these steps may not work for other BOINC projects.
Rosetta Moderator: Mod.Sense
ID: 45312 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
FluffyChicken
Avatar

Send message
Joined: 1 Nov 05
Posts: 1260
Credit: 369,635
RAC: 0
Message 45313 - Posted: 23 Aug 2007, 14:05:28 UTC

Drive letters has never been a problem for me even with it changing.


I would not set the setting online in a different profile but use local preferences to set everything up. You have far more intant control...
The connect to every shouldn't matter but set get 7 days of extra work to err 7. (that's if our deadlines are still at 7?)

Though it has been a while and the boinc versions have changed since I used to do it... (about 1.5yrs difference)
Team mauisun.org
ID: 45313 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
FluffyChicken
Avatar

Send message
Joined: 1 Nov 05
Posts: 1260
Credit: 369,635
RAC: 0
Message 45314 - Posted: 23 Aug 2007, 14:07:20 UTC

Why is boinc using absolute paths when they should be relative paths ?
Team mauisun.org
ID: 45314 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
The_Bad_Penguin
Avatar

Send message
Joined: 5 Jun 06
Posts: 2751
Credit: 4,271,025
RAC: 0
Message 45315 - Posted: 23 Aug 2007, 15:05:12 UTC - in response to Message 45305.  

Thanx everyone !

I'll be attempting this a little later today. Will let you know how it goes.

what i would do is:

10. Start it crunching.

When moving this stick back to the laptop, don't forget to change the paths back before running boinc again! If running from the memory stick its probably easiest to set the drive letters to match on the two computers rather than having to edit init_data.xml every time. Easier still, install it to c:rah and then copy it to the same on the quad...

HTH
Danny

ID: 45315 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
FoldingSolutions
Avatar

Send message
Joined: 2 Apr 06
Posts: 129
Credit: 3,506,690
RAC: 0
Message 45325 - Posted: 23 Aug 2007, 20:50:31 UTC - in response to Message 45315.  

I just run it all from a USB drive. Copy and paste the BOINC folder from program files to anywhere on you USB drive and open the boincmgr.exe directly. Like mod.sense says set work to be 24hours and run the show from the stick. The only downside is that a computer (your laptop) will get credit for work it hasn't done. But at least useful work is still being done and the credit is still being added to your name. It works for me :)
ID: 45325 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
FluffyChicken
Avatar

Send message
Joined: 1 Nov 05
Posts: 1260
Credit: 369,635
RAC: 0
Message 45338 - Posted: 24 Aug 2007, 12:53:40 UTC - in response to Message 45325.  

I just run it all from a USB drive. Copy and paste the BOINC folder from program files to anywhere on you USB drive and open the boincmgr.exe directly. Like mod.sense says set work to be 24hours and run the show from the stick. The only downside is that a computer (your laptop) will get credit for work it hasn't done. But at least useful work is still being done and the credit is still being added to your name. It works for me :)


That's why you install it from the Quad, when the quad eventually goes online it will be the owner of the account and hence keeps all the credits it has crunched.

Team mauisun.org
ID: 45338 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
FoldingSolutions
Avatar

Send message
Joined: 2 Apr 06
Posts: 129
Credit: 3,506,690
RAC: 0
Message 45345 - Posted: 24 Aug 2007, 16:29:26 UTC - in response to Message 45338.  

[quote]

That's why you install it from the Quad, when the quad eventually goes online it will be the owner of the account and hence keeps all the credits it has crunched.


But BOINC just seems to give the cred to whichever comp returns the results...
ID: 45345 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
FluffyChicken
Avatar

Send message
Joined: 1 Nov 05
Posts: 1260
Credit: 369,635
RAC: 0
Message 45381 - Posted: 25 Aug 2007, 10:16:01 UTC - in response to Message 45345.  

[quote]

That's why you install it from the Quad, when the quad eventually goes online it will be the owner of the account and hence keeps all the credits it has crunched.


But BOINC just seems to give the cred to whichever comp returns the results...


It gives it to the 8installation* that returned the result, if you copy an already running BOINC directory, then all credit will go to that, but since you installed a fresh BOINC when it uploads and gets data it will go to that account (as such), and the computer information will be whatever it was last sent from, so if the Quad is the final resting place for that installation it will all be from the Quad.

Note: that's how it used to work last time I used the method.

Team mauisun.org
ID: 45381 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
EW-3

Send message
Joined: 1 Sep 06
Posts: 27
Credit: 2,561,427
RAC: 0
Message 45437 - Posted: 26 Aug 2007, 0:38:23 UTC - in response to Message 45282.  

My Dell 9200 Q6600 quadcore arrived today.


Looking forward to your results.
After reviewing the way the quad core works on the Intel site, I have to wonder if it really will help much when running a single instance of BOINC manager. Sounds like to really push this puppy you need to try 4 instances to keep the processors busy.
Or (question to all out there) does BOINC/Rosetta create multiple threads to take advantage of a multi-CPU machine?


ID: 45437 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile dcdc

Send message
Joined: 3 Nov 05
Posts: 1829
Credit: 115,849,475
RAC: 59,455
Message 45439 - Posted: 26 Aug 2007, 0:55:16 UTC - in response to Message 45437.  

My Dell 9200 Q6600 quadcore arrived today.


Looking forward to your results.
After reviewing the way the quad core works on the Intel site, I have to wonder if it really will help much when running a single instance of BOINC manager. Sounds like to really push this puppy you need to try 4 instances to keep the processors busy.
Or (question to all out there) does BOINC/Rosetta create multiple threads to take advantage of a multi-CPU machine?



rosetta is single threaded so boinc will run four instances of rosetta on a quad. HTH
Danny
ID: 45439 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 45457 - Posted: 26 Aug 2007, 5:06:56 UTC - in response to Message 45439.  

rosetta is single threaded so boinc will run four instances of rosetta on a quad. HTH
Danny


...if your BOINC general preferences are changed to a maximum number of CPUs of 4 (or more).
Rosetta Moderator: Mod.Sense
ID: 45457 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile dcdc

Send message
Joined: 3 Nov 05
Posts: 1829
Credit: 115,849,475
RAC: 59,455
Message 45460 - Posted: 26 Aug 2007, 8:50:45 UTC - in response to Message 45457.  

rosetta is single threaded so boinc will run four instances of rosetta on a quad. HTH
Danny


...if your BOINC general preferences are changed to a maximum number of CPUs of 4 (or more).

good call!

...and your maximum memory useage will allow four threads to fit!
ID: 45460 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
1 · 2 · Next

Message boards : Number crunching : "Sneaker-netting" Rosetta: Quad to Laptop



©2024 University of Washington
https://www.bakerlab.org