Posts by Kennywor

1) Message boards : Number crunching : Disk space calculation way off (BTRFS) (Message 96000)
Posted 4 May 2020 by Kennywor
Post:
Hello!

I just noticed this today. The disk space usage drastically reduced very recently, and I see I've received the newer application. From ~10GB to ~1GB. I checked what was going on with compsize and the 1GB is the native size (before compression, etc.). That's quite a reduction!

Very nice. It looks like it was released the same day you posted. Just-in-time releases. ;-)
2) Message boards : Rosetta@home Science : A quantum Rosetta Client? D-Wave offering free use of their Quantum Computer for anyone working on Covid19 (Message 95999)
Posted 4 May 2020 by Kennywor
Post:
Sounds like a PhD for someone.
3) Message boards : Number crunching : Disk space calculation way off (BTRFS) (Message 95541)
Posted 29 Apr 2020 by Kennywor
Post:
https://boinc.berkeley.edu/forum_thread.php?id=13662
4) Message boards : Number crunching : Disk space calculation way off (BTRFS) (Message 95540)
Posted 29 Apr 2020 by Kennywor
Post:
$ sudo du -sh /var/lib/boinc-client
8.4G	/var/lib/boinc-client


Turns out the numbers just might make sense.

Data directory: /var/lib/boinc-client


Indeed. It would appear that BOINC looks at its data directory usage and compares it to do the amount available on that particular disk. Given that I mounted the slots directory on a difference disk, BOINC had a brain fart.

Moving the mount to /var/lib/boinc-client, allows BOINC to correctly calculate disk space details.

We'll see if anyone is interested in fixing this over at the BOINC bug tracker.
5) Message boards : Number crunching : Disk space calculation way off (BTRFS) (Message 95538)
Posted 29 Apr 2020 by Kennywor
Post:
I realised after posting that the fault will be with BOINC, not R@H. Still looking at it.
6) Message boards : Number crunching : Disk space calculation way off (BTRFS) (Message 95537)
Posted 29 Apr 2020 by Kennywor
Post:
Hello!

To do my tiny bit during the COVID nightmare I decided to fire up some VMs exclusively to run Rosetta. I also plan on running it on (capable) local PCs too (they already crunch other stuff).

Because you pay for EVERYTHING when running a VM then it made sense to me to use a filesystem that could make things "nicer". In steps BTRFS with compression and deduplication. An initial 10 GB disk filled (though in hindsight it probably didn't), until deduped and compressed down to ~800 MB.

Unfortunately, this didn't actually help much.

[Rosetta@home] Rosetta needs 582.77MB more disk space.  You currently have 1133.85 MB available and it needs 1716.61 MB.


Hmm... This number makes no sense in any context.

$ df -hl
$ df -hl
Filesystem      Size  Used Avail Use% Mounted on
/dev/root       9.6G  2.2G  7.4G  23% /
devtmpfs         16G     0   16G   0% /dev
tmpfs            16G     0   16G   0% /dev/shm
tmpfs           3.2G  968K  3.2G   1% /run
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs            16G     0   16G   0% /sys/fs/cgroup
/dev/sda15      105M  3.9M  101M   4% /boot/efi
/dev/loop0       99M   99M     0 100% /snap/google-cloud-sdk/128
/dev/loop1       69M   69M     0 100% /snap/lxd/14804
/dev/loop2       55M   55M     0 100% /snap/core18/1705
/dev/loop3       28M   28M     0 100% /snap/snapd/7264
/dev/sdb         20G  736M   19G   4% /var/lib/boinc-client/slots
tmpfs           3.2G     0  3.2G   0% /run/user/1001


$ sudo btrfs de u /var/lib/boinc-client/slots
/dev/sdb, ID: 1
   Device size:            10.00GiB
   Device slack:              0.00B
   Data,single:             4.01GiB
   Metadata,RAID1:        256.00MiB
   Metadata,DUP:          512.00MiB
   System,RAID1:           32.00MiB
   System,DUP:             16.00MiB
   Unallocated:             5.20GiB

/dev/sdc, ID: 2
   Device size:            10.00GiB
   Device slack:              0.00B
   Metadata,RAID1:        256.00MiB
   System,RAID1:           32.00MiB
   Unallocated:             9.72GiB


$ sudo btrfs fi u /var/lib/boinc-client/slots
Overall:
    Device size:		  20.00GiB
    Device allocated:		   5.09GiB
    Device unallocated:		  14.91GiB
    Device missing:		     0.00B
    Used:			 729.63MiB
    Free (estimated):		  18.31GiB	(min: 10.85GiB)
    Data ratio:			      1.00
    Metadata ratio:		      2.00
    Global reserve:		   4.91MiB	(used: 0.00B)

Data,single: Size:4.01GiB, Used:630.63MiB (15.37%)
   /dev/sdb	   4.01GiB

Metadata,RAID1: Size:256.00MiB, Used:12.64MiB (4.94%)
   /dev/sdb	 256.00MiB
   /dev/sdc	 256.00MiB

Metadata,DUP: Size:256.00MiB, Used:36.84MiB (14.39%)
   /dev/sdb	 512.00MiB

System,RAID1: Size:32.00MiB, Used:16.00KiB (0.05%)
   /dev/sdb	  32.00MiB
   /dev/sdc	  32.00MiB

System,DUP: Size:8.00MiB, Used:0.00B (0.00%)
   /dev/sdb	  16.00MiB

Unallocated:
   /dev/sdb	   5.20GiB
   /dev/sdc	   9.72GiB


$ sudo du -sh /var/lib/boinc-client
8.4G	/var/lib/boinc-client


As you can see I even tried adding another 10GB but it made no difference. The client has no limits set on it (i.e. it can use 100% of all disks available to it).

I also tried the latest build from the Ubuntu PPA and restarting but it made no difference at all. To be honest, I didn't expect it to.

Because of this disk space weirdness, the best I could achieve is 8 instances of R@H (8 CPUs). Adding anything more is a waste of time. I could probably force additional BOINC instances onto additional partitions, but... :-/

So, before blaming BTRFS, which I now run on all new machines... help?

For those unaware: BTRFS is expected to replace EXT2,3,4 so apps will need to work with it.
7) Message boards : Cafe Rosetta : Kings Distributed Systems - Alpha Registration (Message 89820)
Posted 2 Nov 2018 by Kennywor
Post:
hnW_a1WdrvDxeak2C0AyluHkrx2XJDVK
8) Message boards : Number crunching : BOINC in Java code (Message 56364)
Posted 14 Oct 2008 by Kennywor
Post:
I have downloaded this application but cannot seem to install it on my phone, how do we do this? I have a Sony Ericsson W850i


The developers have re-released the code using CVS, you should look at the SF page for details.
The code, though, is written in Java SE, so it will need to be converted to Java ME to run on your mobile phone (I'm testing on a Sony Ericsson K610i), but I have not yet been successful.

I certainly haven't given up though, there's at least three Sony Ericsson phones here that could be crunching WUs. :-)

Only SETI has been ported to Java at the moment anyway, you would need to obtain the source code, and port it manually, for each product if it is available for download.

Remember: the code is pre-alpha, moving WUs around needs to be done manually also.






©2024 University of Washington
https://www.bakerlab.org