[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[gfarm-announce:00001] Gfarm Version 1.0b1 Available
- From: Osamu Tatebe <o.tatebe@xxxxxxxxxx>
- Date: Mon, 28 Apr 2003 15:48:05 +0900 (JST)
Hello all,
The Grid Datafarm team is pleased to announce the first public
release of Gfarm Data Grid middleware, version 1.0b1. Gfarm is a
reference implementation of the Grid Datafarm architecture designed
for Petascale Data-intensive computing. It provides a global file
system using local disks of cluster nodes, and supports data-parallel
execution via file-affinity scheduling.
The global file system has a capability to manage file replicas for
fault tolerance and load balancing. It supports several features for
worldwide fast file replication. Actually, it achieved 741 Mbps out
of 893 Mbps for file replication from US to Japan using 4 nodes at
each side during the SC2002 conference, which is a record speed at
that time.
The software can be downloaded from: http://datafarm.apgrid.org/
Bug tracking system will be available until mid May.
Release note for Gfarm 1.0b1
============================
Features
* Supported client commands
file management - gfls, gfreg, gfrep, gfrm, gfwhere
file utilities - gfexport, gfimport_text, gfimport_fixed
scheduling & host management - gfsched, gfhost
process management - gfrun, gfrcmd, gfmpirun_p4, gfps
security - gfkey, digest
* Unsupported client commands
gfmkdir, gfrmdir,
gfchmod, gfchown, gfchgrp,
gfcd, gfchdir, gfpwd,
gfcp, gfdf, gfsck.
* Gfarm filesystem
Gfarm filesystem supports a Gfarm file that is a group of ranked
files. Each file of a Gfarm file can be replicated and stored in
any filesystem node.
* Gfarm filesystem daemon (gfsd)
Gfsd has a capability of remote file operations, user
authentication, file replication, remote program
invocation, and node status monitoring.
* Gfarm job-management daemon (gfmd)
Gfmd has a capability of job management for gfps.
* Gfarm filesystem metadata daemon (slapd)
This implementation utilizes the slapd provided by
the OpenLDAP software.
* Syscall hooking libraries
Legacy applications can utilize a Gfarm filesystem just
linking with syscall-hooking library, gfs_hook.o or
gfs_hook_mpi.o.
* Sample Gfarm parallel commands
gfgrep - parallel grep
gfwc - parallel word count
gfcp - parallel copy
gfcombine - reduce the number of fragments by combining file fragments
---
Osamu Tatebe, Ph.D. Tel: +81-29-861-5844 FAX: +81-29-861-5301
Grid Technology Research Center,
National Institute of Advanced Industrial Science and Technology
AIST Tsukuba Central 2, 1-1-1 Umezono, Tsukuba, Ibaraki 3058568 JAPAN
E-mail: o.tatebe@xxxxxxxxxx http://www.hpcc.jp/people/tatebe/