Exporting result data from website?

Message boards : Number crunching : Exporting result data from website?

To post messages, you must log in.

AuthorMessage
Profile Chilean
Avatar

Send message
Joined: 16 Oct 05
Posts: 711
Credit: 26,694,507
RAC: 0
Message 89240 - Posted: 8 Jul 2018, 21:23:07 UTC
Last modified: 8 Jul 2018, 21:25:06 UTC

Is there a way to easily export the results from a host? The table only shows 20 results at a time... it'd be extremely tedious to copy and paste 20 results at a time to Excel.

Is it possible to force the site to show 100 results at a time or so? Or maybe download everything in a CSV format?
ID: 89240 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 89243 - Posted: 9 Jul 2018, 3:14:27 UTC

You can export many tasks at a time, in XML format, by using the result status web RPC function of the BOINC Server. You have to know the specific task IDs you are interested in.

An example of formatting the URL:
boinc.bakerlab.org/rosetta/result_status.php?ids=1013720220,1013720221,1013720222,1013720223,1013720224,1013720225,1013720226,1013720227,1013720228,1013720229,1013720230,1013720231,1013720232,1013720233,1013720234,1013720235,1013720236,1013720237,1013720238,1013720239,1013720240,1013720241,1013720242,1013720243,1013720244,1013720245,1013720246,1013720247,1013720248,1013720249
Rosetta Moderator: Mod.Sense
ID: 89243 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Chilean
Avatar

Send message
Joined: 16 Oct 05
Posts: 711
Credit: 26,694,507
RAC: 0
Message 89247 - Posted: 9 Jul 2018, 13:35:25 UTC

I'm more interested in all of the results of a particular host.

I looked at the wiki, thinking there might be a similar thing to what you suggested but instead of result ID, a host ID. But didn't find anything :(
ID: 89247 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
4LG5zSZM7uiF1nVGZVqTRrjkXA6i

Send message
Joined: 7 Mar 10
Posts: 14
Credit: 111,245,665
RAC: 32
Message 89248 - Posted: 9 Jul 2018, 14:42:12 UTC

You could write a script that uses curl, wget, etc. to pull the information and put it into a CSV file or whatever you want.
ID: 89248 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Chilean
Avatar

Send message
Joined: 16 Oct 05
Posts: 711
Credit: 26,694,507
RAC: 0
Message 89253 - Posted: 10 Jul 2018, 14:12:09 UTC
Last modified: 10 Jul 2018, 14:12:43 UTC

Managed to do it with Excel Queries using VBA.

I have to do about 50 queries in total for a single host because each table shows only 20 results (hardcoded in the results.php according to the GitHub code...), but... that's what for loops are for I suppose lol
ID: 89253 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Message boards : Number crunching : Exporting result data from website?



©2024 University of Washington
https://www.bakerlab.org