[gfarm-announce:12757] Re: Gfarm version 2.0.0 released

[Matt <mattmoran76@xxxxxxxxx>]

Osamu,

Congratulations on releasing Gfarm v2.

Can you advise on how you have improved the handling of small files, as I noticed you are still using either a ldap or PostgreSQL backend for the mds.  When I was testing gfarm, I found when reaching millions of files that this was my bottleneck.

It's possible that I didn't have the mds configured properly to grab all available memory (4gb), is there specific settings for this? will a 64bit version make more memory available to the mds?

Also, can you advise if performance has been improved, as I found results using iozone disappointing compared to a standard NFS server and lustre cluster.

Thirdly, have you any thoughts or suggestions about clustering/failing over the mds server?

Thanks,

Matt

On 28/11/2007, Osamu Tatebe <tatebe@xxxxxxxxxxxxxxxx> wrote:

Hi all,

We are very pleased to announce the first public release of Gfarm file
system version 2.0.0, aka Gfarm v2, which is a major new release of
the Gfarm file system. It solves several security issues in Gfarm v1,
and improves performance for small files dramatically.

                http://sourceforge.net/projects/gfarm/

To mount the Gfarm file system, gfarm2fs is also required to be
installed. Since it is a major new release, there is no compatibility
in structure of a spool directory on each file system node. Easiest
way to migrate files from a Gfarm v1 file system is

1. Install Gfarm v2 to a different target directory, and configure a
   Gfarm v2 file system using a different spool directory and
   different ports from Gfarm v1.

2. Mount Gfarm v1 file system and Gfarm v2 file system by gfarmfs and
   gfarm2fs, respectively, on different mount points.

3. Copy files possibly in parallel using multiple clients.

Enjoy!
Osamu