[gfarm-discuss:04057] GFarm performance test

["Supakit Prueksaaroon" <supakit.prueksaaroon@xxxxxxxxxxxx>]

Dear Gfarm staff

I'm Supakit from NECTEC, Thailand. My research around in the Parallel file
system.
 I try to test Gfarm 1.3.x with the parallel benchmark tools, IOR benchmark
http://www.llnl.gov/icc/lc/siop/downloads/download.html


But i have a few problem
1. IOR try to multiple access single files, parallel read and write from
compute node. But I found the problem, The second node and other nodes
can't access file  that the first node created.   (System show that "Can't
open files"). I think your Gfarm have been file's locked algorithm then
it's not allow to multiple write, or not?


2. Simul is used for testing file system operations simultaneously from
many processes to test the correctness and coherence of parallel file
systems. By test multiple read, write, rename, delete and so on but i got
some error message like this

#mpirun -np 10 -machinefile ../machines.LINUX simul -d /tmp/fuse/pao/
Simul is running with 10 process(es)
20:09:35: Running test #0(iter 0): open, shared mode.
20:09:35: Running test #1(iter 0): close, shared mode.
20:09:36: Running test #2(iter 0): file stat, shared mode.
20:09:36: Running test #3(iter 0): lseek, shared mode.
20:09:36: Running test #4(iter 0): read, shared mode.
20:09:37: Running test #5(iter 0): write, shared mode.
20:09:37: Running test #6(iter 0): chdir, shared mode.
20:09:37: Running test #7(iter 0): directory stat, shared mode.
20:09:38: Running test #8(iter 0): statfs, shared mode.
20:09:38: Running test #9(iter 0): readdir, shared mode.
20:09:38: Running test #10(iter 0): mkdir, shared mode.
20:09:38: Running test #11(iter 0): rmdir, shared mode.
20:09:38: Running test #12(iter 0): unlink, shared mode.
20:09:38: Running test #13(iter 0): rename, shared mode.
stale file found
20:09:38: FAILED in simul_rename: too many operations succeeded (2).
[0] MPI Abort by user Aborting program !
[0] Aborting program!
p0_5912:  p4_error: : 1

Above message show that the benchmark can't simultaneous rename file in
Gfarm FS. But I don't found any problem in NFS and Lustre


3. I try to use my self development benchmark by use many C's API for
access file such as "read","write","fread", "fwrite","putc" and "getc".
The bechmark wil be created temporary files for each test but I found that
all temorary files created on the execute node only. Its make the result
is good but i think it not correct. How do i set the temporary file will
be created on separated nodes?


For our system, I have 1 Meta server and 6 file system nodes build on
ROCKS IA64 Cluster 3.3.0 and use Gfarm 1.3.1 with PostgreSQL databases
access through GfarmFUSE 1.2.x

Please suggest me for the aviod files locking or another solution

Best Regards,
Supakit


-- 
Mr. Supakit Prueksaaroon
National Electronics and Computer Technology Center, 112 Phahon Yothin
Rd., Klong 1, Klong Luang,Pathumthani 12120, THAILAND
Tel :  02-564-6900 ext 2278
Email :  supakit.prueksaaroon@xxxxxxxxxxxx