glusterfs 2.0.x maxs out CPU

Actually reading the glusterfs mailing lists will give a different impression.
2.0.9 runs very fine for most people while the incompatible 3.0.x releases
still seem a bit rough.

3.0.2 was released recently which seemed to fix some major issues some people have been experiencing. The relnotes are available at http://ftp.gluster.com/pub/gluster/glusterfs/3.0/LATEST/GlusterFS_3.0.2_Release_Notes.pdf

More details on the issues closed in 3.0.2 can be found at http://is.gd/8hUNy- (the full url is really long and ugly).

Based on a quick test here 3.0.2 works far better than 2.0.x ever did on ubuntu 9.10 amd64 servers. We are running 3.0.0 in production with no issues either.

Debian now has 3.0.2 in sid, so I think that is a good indicator of the quality of the release. http://packages.debian.org/search?keywords=glusterfs

I really don't want to have to maintain my own packages for 2-3 years because ubuntu ships a broken version in a LTS release.

I agree with Dave on this one.

Had the same issue and 3.0.x fixed it.

Hello guys,

I agree with you. I'll prepare test packages to see if the problem is fixed and will require your testing. Once confirmed that the new upstream release fixes this bug, I'll personally oversee its inclusion in lucid.

Cheers

I have since upgraded to 3.0.2 debs based on the Debian packaging. They are working fine on my 9.10 AMD64 boxes. If the Lucid debs built by Andres are backwards compatible with 9.10, I can give them a try in our staging environment in the coming days. Thanks Andres for taking care f this one.

Someone emailed me and asked where I got my 9.10 debs for gluster from. I used the debian unstable (or was it testing?) source and compiled it locally. Info on the testing source is available at http://packages.debian.org/source/squeeze/glusterfs

It _should_ be possible to grab the binary packages linked from that page for glusterfs-client, glusterfs-server and libglusterfs0 and install them using the following commands "sudo dpkg -i /path/to/my-glusterfs-debs-from-debian/*.deb && sudo apt-get install -f"

The debian packages as they are should be working fine in Ubuntu. However, I wan't to test if they build/install before requesting a Sync from debian so that we don't have an FTBFS in archive. But, due to the history of the package in Ubuntu, it should be fine witht a sync. i'll work on it today.

Any update on this Andres? Let me know if there is anything I can do to help things along.

Dave,

The FFe is in process. Could you please test glusterfs that's on my ppa?

sudo add-apt-repository ppa:andreserl/other
sudo apt-get update

And then install glusterfs and test if it works as it should please. Thanks a lot.

I will try to spin up a couple of VMs tomorrow and run it with bonnie++ and some other stuff to stress it and make sure it doesn't max cpu. I'll post a follow up here when done.

Looks good here. I did my testing on a couple 256 slices from slicehost. glusterfs hit about 15% of CPU and glusterfsd never seemed to pass 35% with both nodes being hammered by bonnie++ at the same time.

Anything else I can do to help the process along?

This is good enough for me. This package is in the Feature Freeze Exception queue. Once it gets accepted, i will be uploading it to karmic.

Thanks for the testing.

Cheers,

I meant: it will be synced from debian into lucid :).

Thanks for your work on this Andres.

3.0.3 is out, any chance of a update?

I have just realised that this isn't even on the Release Team's radar for a FFE.

GlusterFS 2.0.x has some serious issues such as maxing out CPU in certain (random yet reproducible) circumstances. The upgrade path from 2.0.x to 3.0.0 was a bit rough but it seems that most of the 3.0 issues were resolved in 3.0.2.

Upstream has mostly dropped support 2.0.x and encourage all users with bugs/issues to try 3.0.x. The referenced upstream bug report is one example of this.

I think it would be a shame for Ubuntu to ship a broken version of glusterfs in lucid, especially as it will be around for a long time.

As I noted in comment #11 the debs in Andres ppa worked ok when I tested them.

Sorry for the noise. I didn't realise that there was a separate bug report in for FFE. See bug #531545 for more info.

No problem. The FFe has already been granted. I'm unsubscribing ubuntu-release from this bug.

Marking this bug as Fix Released due to this haves been fixed in new upstream version. Please see bug 531545.