[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[gfarm-announce:00001] Gfarm Version 1.0b1 Available



Hello all,

The Grid Datafarm team is pleased to announce the first public
release of Gfarm Data Grid middleware, version 1.0b1.  Gfarm is a
reference implementation of the Grid Datafarm architecture designed
for Petascale Data-intensive computing.  It provides a global file
system using local disks of cluster nodes, and supports data-parallel
execution via file-affinity scheduling.

The global file system has a capability to manage file replicas for
fault tolerance and load balancing.  It supports several features for
worldwide fast file replication.  Actually, it achieved 741 Mbps out
of 893 Mbps for file replication from US to Japan using 4 nodes at
each side during the SC2002 conference, which is a record speed at
that time.

The software can be downloaded from: http://datafarm.apgrid.org/

Bug tracking system will be available until mid May.

Release note for Gfarm 1.0b1
============================

Features

 * Supported client commands

   file management - gfls, gfreg, gfrep, gfrm, gfwhere
   file utilities  - gfexport, gfimport_text, gfimport_fixed
   scheduling & host management - gfsched, gfhost
   process management - gfrun, gfrcmd, gfmpirun_p4, gfps
   security - gfkey, digest

 * Unsupported client commands

   gfmkdir, gfrmdir,
   gfchmod, gfchown, gfchgrp,
   gfcd, gfchdir, gfpwd,
   gfcp, gfdf, gfsck.

 * Gfarm filesystem

   Gfarm filesystem supports a Gfarm file that is a group of ranked
   files.  Each file of a Gfarm file can be replicated and stored in
   any filesystem node.

 * Gfarm filesystem daemon (gfsd)

   Gfsd has a capability of remote file operations, user
   authentication, file replication, remote program
   invocation, and node status monitoring.

 * Gfarm job-management daemon (gfmd)

   Gfmd has a capability of job management for gfps.

 * Gfarm filesystem metadata daemon (slapd)

   This implementation utilizes the slapd provided by
   the OpenLDAP software.

 * Syscall hooking libraries

   Legacy applications can utilize a Gfarm filesystem just
   linking with syscall-hooking library, gfs_hook.o or
   gfs_hook_mpi.o.

 * Sample Gfarm parallel commands

   gfgrep    - parallel grep
   gfwc      - parallel word count
   gfcp      - parallel copy
   gfcombine - reduce the number of fragments by combining file fragments

---
Osamu Tatebe, Ph.D.   Tel: +81-29-861-5844  FAX: +81-29-861-5301
Grid Technology Research Center,
National Institute of Advanced Industrial Science and Technology
AIST Tsukuba Central 2, 1-1-1 Umezono, Tsukuba, Ibaraki 3058568 JAPAN
E-mail: o.tatebe@xxxxxxxxxx     http://www.hpcc.jp/people/tatebe/