Rosetta's role in fighting coronavirus

Message boards : News : Rosetta's role in fighting coronavirus

To post messages, you must log in.

Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · 9 . . . 21 · Next

AuthorMessage
dbaggett

Send message
Joined: 16 Aug 06
Posts: 3
Credit: 1,618,833
RAC: 0
Message 92263 - Posted: 25 Mar 2020, 11:41:25 UTC - in response to Message 92012.  

Using Android GPU is on the BOINC client roadmap at the main BOINC website. Not available yet.
ID: 92263 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile [VENETO] boboviz

Send message
Joined: 1 Dec 05
Posts: 2002
Credit: 9,790,281
RAC: 2,986
Message 92265 - Posted: 25 Mar 2020, 12:41:20 UTC - in response to Message 92259.  

New volunteers comming, don't see covid-WUs and disappear, because its not related to their interests.
Did we win? No.


Seems not
We're so grateful for our volunteer community:
• active users DOUBLED since late Feb
• 4 of our 10 best compute days EVER occurred in the last — (wait for it) — 4 days

ID: 92265 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jim1348

Send message
Joined: 19 Jan 06
Posts: 881
Credit: 52,257,545
RAC: 0
Message 92267 - Posted: 25 Mar 2020, 12:58:59 UTC - in response to Message 92265.  

We're so grateful for our volunteer community:
• active users DOUBLED since late Feb
• 4 of our 10 best compute days EVER occurred in the last — (wait for it) — 4 days

And continuing to grow. They are now up to 400,000 GigaFLOPS.
They must have had plenty of reserve server capacity.
ID: 92267 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Dotsch
Avatar

Send message
Joined: 12 Feb 06
Posts: 111
Credit: 241,803
RAC: 0
Message 92268 - Posted: 25 Mar 2020, 13:15:05 UTC

Thank you very much for this detailed descriptions!
ID: 92268 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
bcov
Volunteer moderator
Project developer
Project scientist

Send message
Joined: 8 Nov 16
Posts: 12
Credit: 11,348
RAC: 0
Message 92277 - Posted: 25 Mar 2020, 16:00:45 UTC
Last modified: 25 Mar 2020, 16:04:34 UTC

Using Android GPU is on the BOINC client roadmap at the main BOINC website. Not available yet.


I just wanted to add a comment here about GPU. We'd love to use GPUs and we're well aware of how powerful they are, but making Rosetta work on GPUs isn't as easy as just updating the website and the BOINC infrastructure.

Running on GPUs requires code that at the very CPU instruction level is doing the same thing millions of times. Like rendering every pixel on a screen or calculating the hash of a cryptocurrency function millions of times.

The problem with the Rosetta code base (which I should remind is 3M lines of C++ code), is that it was written well before the thought of ever using GPUs. Rosetta is this beautiful objected-oriented programming playground where everything is just a pointer away with elegant recursive functions to make everything work and a super-fast monte-carlo simulated annealer to pick new amino acids. The problem is that everything I just described is inherently single-CPU, and trying to change this would involve rewriting the core of Rosetta.

Now, with that in mind, some of the big names in Rosetta code development started a project 2 years ago to get Rosetta to run on GPUs. As I said, this is a full rewrite from the ground up. They've made great progress and have gotten the score function and minimizer to work. But I think the packer gave them a bit of trouble. As I said, the packer is a long series of trial and error that simply doesn't parallelize well. I think they eventually settled on trying to design like 100 proteins at once rather than making it truly parallelizable.

But yes, we want GPUs just as bad as you do. And while we are making progress with the GPU Rosetta, they've only recreated about 1% of the whole infrastructure so far.
ID: 92277 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile [VENETO] boboviz

Send message
Joined: 1 Dec 05
Posts: 2002
Credit: 9,790,281
RAC: 2,986
Message 92283 - Posted: 25 Mar 2020, 17:18:40 UTC - in response to Message 92277.  

But yes, we want GPUs just as bad as you do. And while we are making progress with the GPU Rosetta, they've only recreated about 1% of the whole infrastructure so far.

VERY interesting!!
Thanks for your effort!
ID: 92283 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Laurent

Send message
Joined: 15 Mar 20
Posts: 14
Credit: 88,800
RAC: 0
Message 92284 - Posted: 25 Mar 2020, 17:25:05 UTC - in response to Message 92277.  

.
But yes, we want GPUs just as bad as you do. And while we are making progress with the GPU Rosetta, they've only recreated about 1% of the whole infrastructure so far.


I do OpenCL coding for a living and I'm between jobs.

Any 2-3 weeks tasks?
ID: 92284 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
ceddybu

Send message
Joined: 25 Mar 20
Posts: 1
Credit: 240,601
RAC: 0
Message 92285 - Posted: 25 Mar 2020, 17:44:32 UTC

To try and maximize my contribution to fighting SARS-CoV-2, I've adopted the approach of running R@h for CPU work, and running Folding@home for my GPUs

Much thanks to the R@h team!
ID: 92285 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
torma99

Send message
Joined: 16 Feb 20
Posts: 14
Credit: 288,937
RAC: 0
Message 92287 - Posted: 25 Mar 2020, 17:59:39 UTC - in response to Message 92285.  

To try and maximize my contribution to fighting SARS-CoV-2, I've adopted the approach of running R@h for CPU work, and running Folding@home for my GPUs

Much thanks to the R@h team!


I am doing the same. Here in the morning I could get 2 work units for F@H (Nothing afterward the people in the US wake up) and it uses only 10 percent of my CPU, the other approx 85% goes to Rosetta, when the F@H units finish, usually early in the afternoon here, that 10 also goes to Rosetta.

I am considering the options to use my old config as a rosetta dedicated machine in the future, however I do not have a PSU so this has to wait till the pandemic is over...
ID: 92287 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
bcov
Volunteer moderator
Project developer
Project scientist

Send message
Joined: 8 Nov 16
Posts: 12
Credit: 11,348
RAC: 0
Message 92291 - Posted: 25 Mar 2020, 19:49:35 UTC - in response to Message 92284.  

.
I do OpenCL coding for a living and I'm between jobs.

Any 2-3 weeks tasks?


Unfortunately I don't think so. This is very much a long slough by the same people that wrote Rosetta the first two times. Much of the challenge here is trying to figure out how to redo the core algorithms but in parallel fashion (with performance being #1).

There might be GPU Rosetta jobs running someday, but they'll likely be doing very different tasks from what you see here. One of the goals of getting the GPUs going was for fast data-transfer to machine learning algorithms. So with that in mind, you might see some sort of deep-learning Rosetta thing in a few years.

The other issue with the GPU version is that like I said, there's a whole stack of science built on-top of the core code that would take thousands of hours to reproduce. The GPU version is very much a fork with different goals.
ID: 92291 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Laurent

Send message
Joined: 15 Mar 20
Posts: 14
Credit: 88,800
RAC: 0
Message 92298 - Posted: 25 Mar 2020, 21:33:47 UTC - in response to Message 92291.  

Unfortunately I don't think so. This is very much a long slough by the same people that wrote Rosetta the first two times. Much of the challenge here is trying to figure out how to redo the core algorithms but in parallel fashion (with performance being #1).


Pity, it sounded like a fun project. But i understand the answer after reading a bit on rosetta commons.

I wondered about the internal structure and found the page https://www.rosettacommons.org/docs/latest/rosetta_basics/structural_concepts/Rosetta-overview . The concept of interchangeable scoring functions and, i assume, interchangeable minimization procedures is a tough call for porting to the GPU. An efficient GPU implementation needs all those parts (Pose, MoveMap, Packer, scoring and the min-procedure) on the GPU, with a data structure adopted to GPU systems. Doing that is easy if all components are known, well maintained and no 3. party can add stuff. I can guess where the code comes from based on the papers and having worked with science people written high-performance code, that will not be fun.

That GPU-port will need to cut corners in some places. They can probably not get it all running in one go. As an advise from an internet stranger: pick the most commonly us
ID: 92298 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile yoerik
Avatar

Send message
Joined: 24 Mar 20
Posts: 128
Credit: 169,525
RAC: 0
Message 92307 - Posted: 26 Mar 2020, 2:14:25 UTC - in response to Message 92259.  

Run the project or don't.

I can only agree. They have bigger fish to fry than satisfying our curiosity at the moment.
We can quibble about it later.


They don't have bigger fish to fry.

New volunteers comming, don't see covid-WUs and disappear, because its not related to their interests.

Did we win? No.
So we, as old participants, and the rosetta-team should satisfy the curiosity.
Even if it's just to get the job done.


As a newcomer to BOINC with 2 laptops and 3 android devices running tasks - I appreciate that COVID-19 projects from the lab are labeled, and do wish all related to it were labeled as such, so I can prioritize those WUs manually, over others from Rosetta or other BOINC projects. I'm not upset about it - Rosetta has me running 4 COVID WU across my devices, and a bunch more in the queue. Thanks for standing up for us newbies - we're not all attention-seeking jerks ;)
ID: 92307 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
xdarma

Send message
Joined: 20 Jan 08
Posts: 5
Credit: 5,075,848
RAC: 266
Message 92321 - Posted: 26 Mar 2020, 8:52:52 UTC - in response to Message 92298.  

Pity, it sounded like a fun project. But i understand the answer after reading a bit on rosetta commons.


There is another project that "folds proteins" and use GPU: https://www.gpugrid.net/
But they use CUDA, not OpenCL despite some attempts over the years to support OpenCL.
If you are interested, try to contacting them.
Thanks in advance.
ID: 92321 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Dirk Broer

Send message
Joined: 16 Nov 05
Posts: 22
Credit: 3,405,524
RAC: 955
Message 92330 - Posted: 26 Mar 2020, 13:22:01 UTC - in response to Message 92277.  

But yes, we want GPUs just as bad as you do. And while we are making progress with the GPU Rosetta, they've only recreated about 1% of the whole infrastructure so far.


That is not true, people have managed to crunch e.g. MilkyWay@Home using their Android GPU by means of the alternate platform. The Boinc Client can handle Mali GPUs at the very least:

Tue May 15 15:19:00 GMT+03:00 2018||OS: Android: 3.18.35
Tue May 15 15:19:00 GMT+03:00 2018||Processor features: fp asimd evtstrm aes pmull sha1 sha2 crc32
Tue May 15 15:19:00 GMT+03:00 2018||Using 4 CPUs
Tue May 15 15:19:00 GMT+03:00 2018||Processor: 8 AArch64 Processor rev 2 (aarch64)
Tue May 15 15:19:00 GMT+03:00 2018||Host name: android_4cc605bf
Tue May 15 15:19:00 GMT+03:00 2018||OpenCL: Mali-T860 0: Mali-T860 (driver version 1.2, device version OpenCL 1.2 v1.r12p0-04rel0.44f2946824bb8739781564bffe2110c9, 3804MB, 3804MB available, 0 GFLOPS peak)
Tue May 15 15:19:00 GMT+03:00 2018||Data directory: /data/data/edu.berkeley.boinc/client
Tue May 15 15:19:00 GMT+03:00 2018||Running as a daemon
Tue May 15 15:19:00 GMT+03:00 2018||Libraries: libcurl/7.48.0 OpenSSL/1.0.2g zlib/1.2.8
Tue May 15 15:19:00 GMT+03:00 2018||log flags: file_xfer, sched_ops, task
Tue May 15 15:19:00 GMT+03:00 2018||Starting BOINC client version 7.4.53 for aarch64-android-linux-gnu
ID: 92330 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 92331 - Posted: 26 Mar 2020, 13:37:48 UTC - in response to Message 92330.  

Dirk, the post you quoted is referring to the Rosetta infrastructure, not the BOINC infrastructure. So, what other projects are doing is not directly related to what was being said.
Rosetta Moderator: Mod.Sense
ID: 92331 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile [VENETO] boboviz

Send message
Joined: 1 Dec 05
Posts: 2002
Credit: 9,790,281
RAC: 2,986
Message 92335 - Posted: 26 Mar 2020, 13:59:16 UTC - in response to Message 92300.  

As an advise from an internet stranger: pick the most commonly us

I cannot understand clearly this...
ID: 92335 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Chilean
Avatar

Send message
Joined: 16 Oct 05
Posts: 711
Credit: 26,694,507
RAC: 0
Message 92348 - Posted: 26 Mar 2020, 16:30:41 UTC - in response to Message 92285.  

To try and maximize my contribution to fighting SARS-CoV-2, I've adopted the approach of running R@h for CPU work, and running Folding@home for my GPUs

Much thanks to the R@h team!


This is the best approach in my opinion. GPU for Folding, CPU for Rosetta.

For me it makes little sense to do CPU for Folding since they can already do the same work with GPU which are way faster for that kind of work.
ID: 92348 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Laurent

Send message
Joined: 15 Mar 20
Posts: 14
Credit: 88,800
RAC: 0
Message 92349 - Posted: 26 Mar 2020, 16:50:48 UTC - in response to Message 92335.  

As an advise from an internet stranger: pick the most commonly us

I cannot understand clearly this...


I typed a lengthy post, hit "submit" and got an server error. I checked if the post made it, saw nothing. So i repeated like 10x. Still got errors, lost interest, aborted. You see the end result: 5 partial posts (if an admin could please trim the mess down to one post .... ?)

The short version of the end:

pick the most commonly used class combinations and build a monolithic GPU implementation (like the one used for most rosetta-boinc WUs). Do not care too much about making modules, but do care a lot about data layout on the GPU. Modules and stuff comes later, but getting to a data layout that is actually efficient (low number of copies between GPU and host) is hard. Making the data layout modular in the first go will bite you hard later.

I also wrote something about not aiming for MPI and multiple GPUs in the first go. I have seen a few do-it-all port attempts that failed hard because taking into consideration a rare corner case made the data layout on the GPU really, really awful. KISS (keep it simple and stupid) is king in GPU land. Adding multiple GPU / nodes later and using them in a task parallel way is very often easier and more efficient (coding-time and runtime).

BTW and very off-topic.: i saw your post about tn-grid and GPU. Thanks for the tip, that one looks doable in 2 weeks. I contacted valterc (picked the last admin posting anything GPU related), hoping to get a bit of feedback from the attempt made by Daniel.
ID: 92349 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Sid Celery

Send message
Joined: 11 Feb 08
Posts: 2146
Credit: 41,570,180
RAC: 8,210
Message 92351 - Posted: 26 Mar 2020, 18:07:20 UTC - in response to Message 92258.  

The self-serving arrogance of this.

It's NOT "run the project or don't!"
You are not "rosetta"
We are all rosetta.

Lol - I can see the gallery's applause from here.

Can I suggest something. Can you increase your runtimes back to the default 8hrs rather than the 4hrs <you've edited> it to on your PCs?

Because the project, which is benefitting from a fantastic surge of new users atm, has <run out> of tasks right now and if you hadn't run your tasks for <half> the time you wouldn't have grabbed <double> the number of tasks for yourself to the exclusion of <other people> and they'd be able to run <more> tasks for the project and for <longer> and maybe we wouldn't have run out quite so <early>

But look how many tasks <you've> got.

You are not "rosetta"
We are all rosetta.

And again, lol. Spare me
ID: 92351 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile [VENETO] boboviz

Send message
Joined: 1 Dec 05
Posts: 2002
Credit: 9,790,281
RAC: 2,986
Message 92352 - Posted: 26 Mar 2020, 18:39:40 UTC - in response to Message 92349.  

BTW and very off-topic.: i saw your post about tn-grid and GPU. Thanks for the tip, that one looks doable in 2 weeks. I contacted valterc (picked the last admin posting anything GPU related), hoping to get a bit of feedback from the attempt made by Daniel.

Great!!

P.S. If you have a problem to contact Valterc, send me a PM. I know him personally.
ID: 92352 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · 9 . . . 21 · Next

Message boards : News : Rosetta's role in fighting coronavirus



©2024 University of Washington
https://www.bakerlab.org