julian.kunkel
/
ddn-ime-evaluation
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Merge results from 2 experiments

This commit is contained in:
Eugen Betke 2018-10-25 14:50:28 +02:00
parent 0aa3a02413
commit 9f04097b9c
498 changed files with 64314 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

59
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,59 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 01:26:41 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:26:41 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 150 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 827084800.
read 13.12 157286400 100.00 0.001573 60.10 0.000181 60.10 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 836710400.
read 13.28 157286400 100.00 0.000471 60.10 0.000155 60.10 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 855961600.
read 13.58 157286400 100.00 0.000498 60.10 0.000212 60.10 2
Max Read: 13.58 MiB/sec (14.24 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 13.58 13.12 13.33 0.19 60.09874 0 1 1 3 0 0 1 0 0 1 161061273600 102400 827084800 MPIIO 0
Finished: Wed Oct 24 01:29:41 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 7
obdidx objid objid group
7 12463344 0xbe2cf0 0
1 12644630 0xc0f116 0

46
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:1#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:41:46 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:41:46 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 150 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 1463603200.
read 46.38 157286400 100.00 0.001650 30.09 0.000175 30.10 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 1441689600.
read 45.68 157286400 100.00 0.000482 30.10 0.000180 30.10 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 1480089600.
read 46.89 157286400 100.00 0.000491 30.10 0.000157 30.11 2
Max Read: 46.89 MiB/sec (49.16 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 46.89 45.68 46.31 0.50 30.10094 0 1 1 3 0 0 1 0 0 1 161061273600 102400 1463603200 MPIIO 0
Finished: Wed Oct 24 08:43:17 2018
+ set +x

45
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,45 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 01:23:25 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:23:25 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 150 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 14564761600.
write 226.59 157286400 100.00 0.001550 61.30 0.000260 61.30 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 14794547200.
write 234.39 157286400 100.00 0.001500 60.19 0.000187 60.20 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161055641600.
WARNING: Using actual aggregate bytes moved = 15000166400.
write 237.98 157286400 100.00 0.017489 60.09 0.000163 60.11 2
Max Write: 237.98 MiB/sec (249.54 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 237.98 226.59 232.98 4.76 60.53637 0 1 1 3 0 0 1 0 0 1 161061273600 102400 14564761600 MPIIO 0
Finished: Wed Oct 24 01:26:37 2018

59
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,59 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 141180272640 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:1048576.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 22:44:31 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 141180272640 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 22:44:31 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 131.48 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 12832473088.
read 101.97 137871360 1024.00 0.002383 120.01 0.000238 120.01 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 14103347200.
read 112.07 137871360 1024.00 0.000527 120.01 0.000175 120.01 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 15566110720.
read 123.69 137871360 1024.00 0.000479 120.01 0.000169 120.02 2
Max Read: 123.69 MiB/sec (129.70 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 123.69 101.97 112.58 8.87 120.01440 0 1 1 3 0 0 1 0 0 1 141180272640 1048576 12832473088 MPIIO 0
Finished: Mon Oct 22 22:50:31 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 6
obdidx objid objid group
6 12591863 0xc022f7 0
0 12420249 0xbd8499 0

46
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:1#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:33:30 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:33:30 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 150 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 6948913152.
read 220.73 157286400 1024.00 0.000976 30.02 0.000203 30.02 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 7444889600.
read 236.48 157286400 1024.00 0.000519 30.02 0.000163 30.02 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 7632584704.
read 242.46 157286400 1024.00 0.000487 30.02 0.000147 30.02 2
Max Read: 242.46 MiB/sec (254.24 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 242.46 220.73 233.23 9.17 30.02252 0 1 1 3 0 0 1 0 0 1 161061273600 1048576 6948913152 MPIIO 0
Finished: Wed Oct 24 08:35:00 2018
+ set +x

36
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,36 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 141180272640 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:1048576.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 22:38:39 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 141180272640 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 22:38:39 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 131.48 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
write 1200.79 137871360 1024.00 0.001562 112.12 0.000251 112.13 0
write 1203.01 137871360 1024.00 0.049815 111.87 0.000188 111.92 1
write 1196.68 137871360 1024.00 0.001396 112.51 0.000207 112.51 2
Max Write: 1203.01 MiB/sec (1261.44 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 1203.01 1196.68 1200.16 2.62 112.18573 0 1 1 3 0 0 1 0 0 1 141180272640 1048576 141180272640 MPIIO 0
Finished: Mon Oct 22 22:44:26 2018

49
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,49 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 141180272640 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:10485760.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 16:14:37 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 141180272640 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 16:14:37 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 131.48 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 45183139840.
read 358.77 137871360 10240 0.093677 120.01 0.000213 120.10 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 54473523200.
read 432.87 137871360 10240 0.000489 120.01 0.000175 120.01 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 53267660800.
read 423.20 137871360 10240 0.000498 120.04 0.000167 120.04 2
Max Read: 432.87 MiB/sec (453.90 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 432.87 358.77 404.95 32.89 120.05124 0 1 1 3 0 0 1 0 0 1 141180272640 10485760 45183139840 MPIIO 0
Finished: Mon Oct 22 16:20:37 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1

46
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:1#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:25:13 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:25:13 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 150 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 8724152320.
read 276.64 157286400 10240 0.001482 30.07 0.000286 30.07 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 9353297920.
read 296.58 157286400 10240 0.000463 30.08 0.000158 30.08 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 10276044800.
read 325.63 157286400 10240 0.000476 30.10 0.000165 30.10 2
Max Read: 325.63 MiB/sec (341.45 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 325.63 276.64 299.62 20.11 30.08238 0 1 1 3 0 0 1 0 0 1 161061273600 10485760 8724152320 MPIIO 0
Finished: Wed Oct 24 08:26:43 2018
+ set +x

36
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,36 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 141180272640 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:10485760.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 16:08:59 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 141180272640 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 16:08:59 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 131.48 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
write 1254.27 137871360 10240 0.001584 107.34 0.000219 107.35 0
write 1266.86 137871360 10240 0.001460 106.28 0.000206 106.28 1
write 1245.55 137871360 10240 0.036590 108.06 0.000175 108.10 2
Max Write: 1266.86 MiB/sec (1328.40 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 1266.86 1245.55 1255.56 8.75 107.24007 0 1 1 3 0 0 1 0 0 1 141180272640 10485760 141180272640 MPIIO 0
Finished: Mon Oct 22 16:14:31 2018

59
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,59 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 141180272640 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Tue Oct 23 00:53:23 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 141180272640 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Tue Oct 23 00:53:23 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 131.48 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 474710016.
read 3.75 137871360 16.00 0.005226 120.74 0.000198 120.75 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 481837056.
read 3.81 137871360 16.00 0.000473 120.74 0.000144 120.74 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 479100928.
read 3.78 137871360 16.00 0.000469 120.75 0.000163 120.75 2
Max Read: 3.81 MiB/sec (3.99 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 3.81 3.75 3.78 0.02 120.74686 0 1 1 3 0 0 1 0 0 1 141180272640 16384 474710016 MPIIO 0
Finished: Tue Oct 23 00:59:26 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 1
obdidx objid objid group
1 12638255 0xc0d82f 0
3 12486567 0xbe87a7 0

46
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:1#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:49:48 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:49:48 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 150 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 312459264.
read 9.65 157286400 16.00 0.005558 30.86 0.000170 30.87 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 293568512.
read 9.07 157286400 16.00 0.000488 30.86 0.000182 30.86 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 297844736.
read 9.21 157286400 16.00 0.000475 30.85 0.000148 30.86 2
Max Read: 9.65 MiB/sec (10.12 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 9.65 9.07 9.31 0.25 30.86067 0 1 1 3 0 0 1 0 0 1 161061273600 16384 312459264 MPIIO 0
Finished: Wed Oct 24 08:51:21 2018
+ set +x

45
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,45 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 141180272640 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Tue Oct 23 00:46:45 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 141180272640 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Tue Oct 23 00:46:45 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 131.48 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180190720.
WARNING: Using actual aggregate bytes moved = 5065080832.
write 39.86 137871360 16.00 0.001628 121.19 0.000224 121.19 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179682816.
WARNING: Using actual aggregate bytes moved = 5168660480.
write 40.46 137871360 16.00 0.018273 121.80 0.000166 121.82 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179699200.
WARNING: Using actual aggregate bytes moved = 4824580096.
write 38.02 137871360 16.00 0.000969 121.01 0.000177 121.02 2
Max Write: 40.46 MiB/sec (42.43 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 40.46 38.02 39.45 1.04 121.34342 0 1 1 3 0 0 1 0 0 1 141180272640 16384 5065080832 MPIIO 0
Finished: Tue Oct 23 00:53:21 2018

58
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:POSIX#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,58 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:POSIX#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 01:20:25 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:20:25 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 150 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 540057600.
read 8.58 157286400 100.00 0.000167 60.05 0.000121 60.05 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 535040000.
read 8.50 157286400 100.00 0.000140 60.04 0.000117 60.04 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 550707200.
read 8.75 157286400 100.00 0.000152 60.04 0.000120 60.04 2
Max Read: 8.75 MiB/sec (9.17 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 8.75 8.50 8.61 0.10 60.04260 0 1 1 3 1 0 1 0 0 1 161061273600 102400 540057600 POSIX 0
Finished: Wed Oct 24 01:23:25 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 7
obdidx objid objid group
7 12463343 0xbe2cef 0
1 12644629 0xc0f115 0

44
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:POSIX#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,44 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:POSIX#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 01:17:05 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:17:05 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 150 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161059430400.
WARNING: Using actual aggregate bytes moved = 14742425600.
write 222.75 157286400 100.00 0.000200 63.12 0.000128 63.12 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161058508800.
WARNING: Using actual aggregate bytes moved = 14849945600.
write 224.83 157286400 100.00 0.000409 62.99 0.000118 62.99 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161059840000.
WARNING: Using actual aggregate bytes moved = 14929920000.
write 226.41 157286400 100.00 0.000409 62.89 0.000124 62.89 2
Max Write: 226.41 MiB/sec (237.41 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 226.41 222.75 224.66 1.50 62.99806 0 1 1 3 1 0 1 0 0 1 161061273600 102400 14742425600 POSIX 0
Finished: Wed Oct 24 01:20:19 2018

58
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:POSIX#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,58 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 141180272640 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:POSIX#T:1048576.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 22:32:38 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 141180272640 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 22:32:38 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 131.48 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 11049893888.
read 87.80 137871360 1024.00 0.000177 120.02 0.000132 120.02 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 12142510080.
read 96.49 137871360 1024.00 0.000134 120.01 0.000118 120.01 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 13043236864.
read 103.65 137871360 1024.00 0.000133 120.01 0.000120 120.01 2
Max Read: 103.65 MiB/sec (108.69 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 103.65 87.80 95.98 6.48 120.01393 0 1 1 3 1 0 1 0 0 1 141180272640 1048576 11049893888 POSIX 0
Finished: Mon Oct 22 22:38:38 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 6
obdidx objid objid group
6 12591862 0xc022f6 0
0 12420248 0xbd8498 0

41
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:POSIX#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,41 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 141180272640 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:POSIX#T:1048576.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 22:26:34 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 141180272640 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 22:26:34 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 131.48 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179224064.
WARNING: Using actual aggregate bytes moved = 133425004544.
write 1053.09 137871360 1024.00 0.000198 120.83 0.000132 120.83 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 132905959424.
write 1050.83 137871360 1024.00 0.000405 120.62 0.000126 120.62 1
write 1164.88 137871360 1024.00 0.000585 115.58 0.000123 115.58 2
Max Write: 1164.88 MiB/sec (1221.46 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 1164.88 1050.83 1089.60 53.24 119.01027 0 1 1 3 1 0 1 0 0 1 141180272640 1048576 133425004544 POSIX 0
Finished: Mon Oct 22 22:32:32 2018

58
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:POSIX#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,58 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 141180272640 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:POSIX#T:10485760.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 21:04:07 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 141180272640 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 21:04:07 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 131.48 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 14784921600.
read 117.45 137871360 10240 0.000182 120.05 0.000133 120.05 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 16294871040.
read 129.47 137871360 10240 0.000146 120.03 0.000125 120.03 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 18192793600.
read 144.52 137871360 10240 0.000143 120.05 0.000127 120.05 2
Max Read: 144.52 MiB/sec (151.54 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 144.52 117.45 130.48 11.07 120.04435 0 1 1 3 1 0 1 0 0 1 141180272640 10485760 14784921600 POSIX 0
Finished: Mon Oct 22 21:10:08 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 1
obdidx objid objid group
1 12638213 0xc0d805 0
3 12486523 0xbe877b 0

35
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:POSIX#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,35 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 141180272640 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:POSIX#T:10485760.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 20:58:37 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 141180272640 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 20:58:37 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 131.48 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
write 1139.69 137871360 10240 0.000205 118.14 0.000172 118.14 0
write 1311.72 137871360 10240 0.000421 102.64 0.000130 102.64 1
write 1314.63 137871360 10240 0.000412 102.42 0.000166 102.42 2
Max Write: 1314.63 MiB/sec (1378.49 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 1314.63 1139.69 1255.35 81.79 107.73261 0 1 1 3 1 0 1 0 0 1 141180272640 10485760 141180272640 POSIX 0
Finished: Mon Oct 22 21:04:02 2018

58
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:POSIX#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,58 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 141180272640 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:POSIX#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Tue Oct 23 00:40:43 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 141180272640 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Tue Oct 23 00:40:43 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 131.48 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 264077312.
read 2.09 137871360 16.00 0.000170 120.42 0.000128 120.42 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 264945664.
read 2.10 137871360 16.00 0.000134 120.42 0.000124 120.42 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 265240576.
read 2.10 137871360 16.00 0.000139 120.43 0.000129 120.43 2
Max Read: 2.10 MiB/sec (2.20 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 2.10 2.09 2.10 0.00 120.42428 0 1 1 3 1 0 1 0 0 1 141180272640 16384 264077312 POSIX 0
Finished: Tue Oct 23 00:46:44 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 1
obdidx objid objid group
1 12638254 0xc0d82e 0
3 12486566 0xbe87a6 0

44
benchmark/merged_output/COUNT:1#NN:1#PPN:1#API:POSIX#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,44 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 141180272640 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:POSIX#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Tue Oct 23 00:33:52 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 141180272640 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Tue Oct 23 00:33:52 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 131.48 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180223488.
WARNING: Using actual aggregate bytes moved = 4903501824.
write 34.60 137871360 16.00 0.000200 135.16 0.000113 135.16 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179682816.
WARNING: Using actual aggregate bytes moved = 5213257728.
write 36.91 137871360 16.00 0.000426 134.70 0.000104 134.70 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179633664.
WARNING: Using actual aggregate bytes moved = 5065080832.
write 35.76 137871360 16.00 0.000415 135.10 0.000099 135.10 2
Max Write: 36.91 MiB/sec (38.70 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 36.91 34.60 35.75 0.94 134.98834 0 1 1 3 1 0 1 0 0 1 141180272640 16384 4903501824 POSIX 0
Finished: Tue Oct 23 00:40:40 2018

59
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,59 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:102400.txt
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 01:52:11 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:52:11 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 2116505600.
read 33.59 78643200 100.00 0.001503 60.10 0.000510 60.10 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 2126131200.
read 33.74 78643200 100.00 0.000598 60.10 0.000234 60.10 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 2150195200.
read 34.12 78643200 100.00 0.000571 60.09 0.000161 60.09 2
Max Read: 34.12 MiB/sec (35.78 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 34.12 33.59 33.82 0.23 60.09716 0 2 2 3 0 0 1 0 0 1 80530636800 102400 2116505600 MPIIO 0
Finished: Wed Oct 24 01:55:12 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12514730 0xbef5aa 0
7 12463352 0xbe2cf8 0

46
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:2#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:44:59 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:44:59 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 3387494400.
read 107.30 78643200 100.00 0.004619 30.10 0.000188 30.11 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 3434393600.
read 108.83 78643200 100.00 0.000592 30.09 0.000207 30.09 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 3450777600.
read 109.34 78643200 100.00 0.000579 30.10 0.000173 30.10 2
Max Read: 109.34 MiB/sec (114.66 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 109.34 107.30 108.49 0.87 30.09988 0 2 2 3 0 0 1 0 0 1 80530636800 102400 3387494400 MPIIO 0
Finished: Wed Oct 24 08:46:30 2018
+ set +x

45
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,45 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 01:48:53 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:48:53 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060556800.
WARNING: Using actual aggregate bytes moved = 15162880000.
write 239.86 78643200 100.00 0.003220 60.28 0.000273 60.29 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161059123200.
WARNING: Using actual aggregate bytes moved = 14554009600.
write 228.51 78643200 100.00 0.016505 60.72 0.000201 60.74 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161057792000.
WARNING: Using actual aggregate bytes moved = 15849881600.
write 251.13 78643200 100.00 0.030138 60.16 0.000190 60.19 2
Max Write: 251.13 MiB/sec (263.33 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 251.13 228.51 239.83 9.23 60.40618 0 2 2 3 0 0 1 0 0 1 80530636800 102400 15162880000 MPIIO 0
Finished: Wed Oct 24 01:52:04 2018

59
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,59 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 70590136320 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:1048576.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 22:20:33 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 70590136320 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 22:20:33 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 65.74 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 26353860608.
read 209.40 68935680 1024.00 0.007453 120.02 0.001721 120.03 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 32643219456.
read 259.40 68935680 1024.00 0.000607 120.01 0.000201 120.01 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 36842766336.
read 292.77 68935680 1024.00 0.000661 120.01 0.000191 120.01 2
Max Read: 292.77 MiB/sec (306.99 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 292.77 209.40 253.86 34.26 120.01655 0 2 2 3 0 0 1 0 0 1 70590136320 1048576 26353860608 MPIIO 0
Finished: Mon Oct 22 22:26:33 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 6
obdidx objid objid group
6 12591861 0xc022f5 0
0 12420247 0xbd8497 0

46
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:2#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:36:47 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:36:47 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 19476250624.
read 618.84 78643200 1024.00 0.001592 30.01 0.000258 30.01 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 20935868416.
read 665.22 78643200 1024.00 0.000605 30.01 0.000198 30.01 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 20709376000.
read 657.90 78643200 1024.00 0.000543 30.02 0.000200 30.02 2
Max Read: 665.22 MiB/sec (697.53 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 665.22 618.84 647.32 20.36 30.01609 0 2 2 3 0 0 1 0 0 1 80530636800 1048576 19476250624 MPIIO 0
Finished: Wed Oct 24 08:38:17 2018
+ set +x

45
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,45 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 70590136320 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:1048576.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 22:15:03 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 70590136320 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 22:15:03 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 65.74 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 141162446848.
write 1274.07 68935680 1024.00 0.001456 105.66 0.000487 105.66 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179224064.
WARNING: Using actual aggregate bytes moved = 141345947648.
write 1260.08 68935680 1024.00 0.050349 106.93 0.000219 106.98 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179224064.
WARNING: Using actual aggregate bytes moved = 140948537344.
write 1303.71 68935680 1024.00 0.001498 103.10 0.000228 103.10 2
Max Write: 1303.71 MiB/sec (1367.04 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 1303.71 1260.08 1279.29 18.19 105.24803 0 2 2 3 0 0 1 0 0 1 70590136320 1048576 141162446848 MPIIO 0
Finished: Mon Oct 22 22:20:25 2018

49
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,49 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 70590136320 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:10485760.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 15:57:14 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 70590136320 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 15:57:14 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 65.74 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 98817802240.
read 783.70 68935680 10240 0.241708 120.01 0.000258 120.25 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 109020446720.
read 866.12 68935680 10240 0.000593 120.04 0.000207 120.04 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 107489525760.
read 853.98 68935680 10240 0.000554 120.04 0.000177 120.04 2
Max Read: 866.12 MiB/sec (908.19 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 866.12 783.70 834.60 36.33 120.10975 0 2 2 3 0 0 1 0 0 1 70590136320 10485760 98817802240 MPIIO 0
Finished: Mon Oct 22 16:03:15 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1

46
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:2#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:28:30 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:28:30 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 26560430080.
read 843.37 78643200 10240 0.001179 30.03 0.000241 30.03 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 25773998080.
read 818.39 78643200 10240 0.000627 30.03 0.000208 30.03 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 26287800320.
read 834.31 78643200 10240 0.000554 30.05 0.000189 30.05 2
Max Read: 843.37 MiB/sec (884.34 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 843.37 818.39 832.02 10.32 30.03927 0 2 2 3 0 0 1 0 0 1 80530636800 10485760 26560430080 MPIIO 0
Finished: Wed Oct 24 08:30:00 2018
+ set +x

45
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,45 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 70590136320 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:10485760.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 15:52:47 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 70590136320 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 15:52:47 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 65.74 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141159301120.
WARNING: Using actual aggregate bytes moved = 139817123840.
write 1637.59 68935680 10240 0.001477 81.42 0.000244 81.42 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141169786880.
WARNING: Using actual aggregate bytes moved = 142438563840.
write 1627.79 68935680 10240 0.237321 83.21 0.000253 83.45 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 141694074880.
write 1600.18 68935680 10240 0.001663 84.45 0.000219 84.45 2
Max Write: 1637.59 MiB/sec (1717.14 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 1637.59 1600.18 1621.85 15.84 83.10728 0 2 2 3 0 0 1 0 0 1 70590136320 10485760 139817123840 MPIIO 0
Finished: Mon Oct 22 15:57:06 2018

59
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,59 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 70590136320 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Tue Oct 23 00:27:50 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 70590136320 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Tue Oct 23 00:27:50 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 65.74 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 1085882368.
read 8.59 68935680 16.00 0.001933 120.57 0.000227 120.57 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 1100529664.
read 8.70 68935680 16.00 0.000612 120.58 0.000172 120.58 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 1114898432.
read 8.82 68935680 16.00 0.000570 120.57 0.000168 120.57 2
Max Read: 8.82 MiB/sec (9.25 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 8.82 8.59 8.70 0.09 120.57250 0 2 2 3 0 0 1 0 0 1 70590136320 16384 1085882368 MPIIO 0
Finished: Tue Oct 23 00:33:52 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 1
obdidx objid objid group
1 12638253 0xc0d82d 0
3 12486565 0xbe87a5 0

46
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:2#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:52:59 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:52:59 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 704462848.
read 21.91 78643200 16.00 0.001598 30.66 0.000192 30.66 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 713703424.
read 22.20 78643200 16.00 0.000567 30.66 0.000227 30.66 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 723910656.
read 22.51 78643200 16.00 0.000594 30.67 0.000168 30.67 2
Max Read: 22.51 MiB/sec (23.61 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 22.51 21.91 22.21 0.25 30.66487 0 2 2 3 0 0 1 0 0 1 80530636800 16384 704462848 MPIIO 0
Finished: Wed Oct 24 08:54:31 2018
+ set +x

45
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,45 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 70590136320 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Tue Oct 23 00:21:26 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 70590136320 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Tue Oct 23 00:21:26 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 65.74 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179469824.
WARNING: Using actual aggregate bytes moved = 5164302336.
write 40.52 68935680 16.00 0.001840 121.54 0.000237 121.55 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179469824.
WARNING: Using actual aggregate bytes moved = 5294505984.
write 40.73 68935680 16.00 0.006822 123.95 0.000245 123.96 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179404288.
WARNING: Using actual aggregate bytes moved = 5482807296.
write 42.99 68935680 16.00 0.047784 121.58 0.000187 121.63 2
Max Write: 42.99 MiB/sec (45.08 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 42.99 40.52 41.41 1.12 122.37880 0 2 2 3 0 0 1 0 0 1 70590136320 16384 5164302336 MPIIO 0
Finished: Tue Oct 23 00:27:46 2018

68
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:POSIX#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,68 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:POSIX#T:102400.txt
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 01:45:52 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:45:52 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 1250201600.
read 19.86 78643200 100.00 0.000162 60.02 0.000138 60.02 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 1249177600.
read 19.84 78643200 100.00 0.000168 60.03 0.000139 60.03 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 1258393600.
read 19.99 78643200 100.00 0.000163 60.02 0.000138 60.02 2
Max Read: 19.99 MiB/sec (20.97 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 19.99 19.84 19.90 0.07 60.02582 0 2 2 3 1 0 1 0 0 1 80530636800 102400 1250201600 POSIX 0
Finished: Wed Oct 24 01:48:52 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 0
obdidx objid objid group
0 12426653 0xbd9d9d 0
2 12572991 0xbfd93f 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12514729 0xbef5a9 0
7 12463351 0xbe2cf7 0

44
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:POSIX#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,44 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:POSIX#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 01:42:29 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:42:29 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 30632038400.
write 474.39 78643200 100.00 0.000420 61.58 0.000147 61.58 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061068800.
WARNING: Using actual aggregate bytes moved = 30516838400.
write 460.34 78643200 100.00 0.000706 63.22 0.000131 63.22 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161059430400.
WARNING: Using actual aggregate bytes moved = 30322176000.
write 454.71 78643200 100.00 0.000663 63.59 0.000250 63.59 2
Max Write: 474.39 MiB/sec (497.43 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 474.39 454.71 463.15 8.27 62.79877 0 2 2 3 1 0 1 0 0 1 80530636800 102400 30632038400 POSIX 0
Finished: Wed Oct 24 01:45:44 2018

68
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:POSIX#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,68 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:POSIX#T:1048576.txt
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 70590136320 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 22:09:02 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 70590136320 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 22:09:02 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 65.74 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 282360545280.
WARNING: Using actual aggregate bytes moved = 26806845440.
read 213.03 68935680 1024.00 0.000171 120.01 0.000136 120.01 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 282360545280.
WARNING: Using actual aggregate bytes moved = 31547457536.
read 250.70 68935680 1024.00 0.000157 120.01 0.000140 120.01 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 282360545280.
WARNING: Using actual aggregate bytes moved = 39363543040.
read 312.79 68935680 1024.00 0.000190 120.02 0.000143 120.02 2
Max Read: 312.79 MiB/sec (327.98 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 312.79 213.03 258.84 41.13 120.01022 0 2 2 3 1 0 1 0 0 1 70590136320 1048576 26806845440 POSIX 0
Finished: Mon Oct 22 22:15:02 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 3
obdidx objid objid group
3 12486542 0xbe878e 0
5 12378597 0xbce1e5 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 6
obdidx objid objid group
6 12591860 0xc022f4 0
0 12420246 0xbd8496 0

35
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:POSIX#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,35 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 70590136320 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:POSIX#T:1048576.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 22:05:54 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 70590136320 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 22:05:54 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 65.74 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
write 2040.06 68935680 1024.00 0.000439 66.00 0.000176 66.00 0
write 2420.07 68935680 1024.00 0.000691 55.63 0.000173 55.63 1
write 2502.54 68935680 1024.00 0.000652 53.80 0.000160 53.80 2
Max Write: 2502.54 MiB/sec (2624.11 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 2502.54 2040.06 2320.89 201.41 58.47800 0 2 2 3 1 0 1 0 0 1 70590136320 1048576 141180272640 POSIX 0
Finished: Mon Oct 22 22:08:54 2018

68
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:POSIX#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,68 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 70590136320 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:POSIX#T:10485760.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 20:52:36 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 70590136320 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 20:52:36 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 65.74 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 282360545280.
WARNING: Using actual aggregate bytes moved = 37203476480.
read 295.55 68935680 10240 0.000163 120.05 0.000140 120.05 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 282360545280.
WARNING: Using actual aggregate bytes moved = 42446356480.
read 337.12 68935680 10240 0.000161 120.07 0.000138 120.07 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 282360545280.
WARNING: Using actual aggregate bytes moved = 50394562560.
read 400.45 68935680 10240 0.000163 120.01 0.000149 120.01 2
Max Read: 400.45 MiB/sec (419.90 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 400.45 295.55 344.38 43.13 120.04549 0 2 2 3 1 0 1 0 0 1 70590136320 10485760 37203476480 POSIX 0
Finished: Mon Oct 22 20:58:36 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12508297 0xbedc89 0
7 12456937 0xbe13e9 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 1
obdidx objid objid group
1 12638212 0xc0d804 0
3 12486522 0xbe877a 0

35
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:POSIX#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,35 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 70590136320 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:POSIX#T:10485760.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 20:49:39 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 70590136320 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 20:49:39 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 65.74 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
write 2396.14 68935680 10240 0.000421 56.19 0.000192 56.19 0
write 2463.72 68935680 10240 0.002461 54.65 0.000157 54.65 1
write 2537.98 68935680 10240 0.000687 53.05 0.000181 53.05 2
Max Write: 2537.98 MiB/sec (2661.27 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 2537.98 2396.14 2465.95 57.93 54.62977 0 2 2 3 1 0 1 0 0 1 70590136320 10485760 141180272640 POSIX 0
Finished: Mon Oct 22 20:52:28 2018

68
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:POSIX#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,68 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 70590136320 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:POSIX#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Tue Oct 23 00:15:24 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 70590136320 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Tue Oct 23 00:15:24 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 65.74 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 282360545280.
WARNING: Using actual aggregate bytes moved = 631586816.
read 5.01 68935680 16.00 0.000313 120.18 0.000136 120.18 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 282360545280.
WARNING: Using actual aggregate bytes moved = 640942080.
read 5.09 68935680 16.00 0.000159 120.19 0.000141 120.19 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 282360545280.
WARNING: Using actual aggregate bytes moved = 655769600.
read 5.20 68935680 16.00 0.000163 120.19 0.000135 120.19 2
Max Read: 5.20 MiB/sec (5.46 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 5.20 5.01 5.10 0.08 120.18716 0 2 2 3 1 0 1 0 0 1 70590136320 16384 631586816 POSIX 0
Finished: Tue Oct 23 00:21:25 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 1
obdidx objid objid group
1 12638252 0xc0d82c 0
3 12486564 0xbe87a4 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12508338 0xbedcb2 0
7 12456978 0xbe1412 0

44
benchmark/merged_output/COUNT:1#NN:1#PPN:2#API:POSIX#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,44 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 70590136320 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:POSIX#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Tue Oct 23 00:08:35 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 70590136320 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Tue Oct 23 00:08:35 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 65.74 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180043264.
WARNING: Using actual aggregate bytes moved = 10365878272.
write 75.84 68935680 16.00 0.000423 130.34 0.000137 130.34 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179813888.
WARNING: Using actual aggregate bytes moved = 9952854016.
write 68.99 68935680 16.00 0.000696 137.58 0.000120 137.59 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 10229530624.
write 74.02 68935680 16.00 0.000714 131.80 0.000125 131.80 2
Max Write: 75.84 MiB/sec (79.53 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 75.84 68.99 72.95 2.90 133.24379 0 2 2 3 1 0 1 0 0 1 70590136320 16384 10365878272 POSIX 0
Finished: Tue Oct 23 00:15:18 2018

59
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,59 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:102400.txt
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 01:14:04 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:14:04 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 37.50 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 3567923200.
read 56.62 39321600 100.00 0.004228 60.09 0.000179 60.10 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 3673702400.
read 58.31 39321600 100.00 0.000730 60.09 0.000251 60.09 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 3749273600.
read 59.51 39321600 100.00 0.000752 60.08 0.000169 60.08 2
Max Read: 59.51 MiB/sec (62.40 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 59.51 56.62 58.15 1.19 60.08803 0 4 4 3 0 0 1 0 0 1 40265318400 102400 3567923200 MPIIO 0
Finished: Wed Oct 24 01:17:04 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12514721 0xbef5a1 0
7 12463342 0xbe2cee 0

46
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:4#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:40:08 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:40:08 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 37.50 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 7606886400.
read 241.07 39321600 100.00 0.004575 30.09 0.000247 30.09 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 7775129600.
read 246.40 39321600 100.00 0.000749 30.09 0.000171 30.09 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 7871488000.
read 249.45 39321600 100.00 0.000711 30.09 0.000173 30.09 2
Max Read: 249.45 MiB/sec (261.56 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 249.45 241.07 245.64 3.46 30.09313 0 4 4 3 0 0 1 0 0 1 40265318400 102400 7606886400 MPIIO 0
Finished: Wed Oct 24 08:41:39 2018
+ set +x

45
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,45 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 01:10:41 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:10:41 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 37.50 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161059737600.
WARNING: Using actual aggregate bytes moved = 14886502400.
write 235.82 39321600 100.00 0.001613 60.20 0.000283 60.20 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061068800.
WARNING: Using actual aggregate bytes moved = 13940326400.
write 218.90 39321600 100.00 0.026797 60.71 0.000167 60.73 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060147200.
WARNING: Using actual aggregate bytes moved = 14323404800.
write 220.98 39321600 100.00 0.001549 61.81 0.000175 61.81 2
Max Write: 235.82 MiB/sec (247.27 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 235.82 218.90 225.23 7.53 60.91658 0 4 4 3 0 0 1 0 0 1 40265318400 102400 14886502400 MPIIO 0
Finished: Wed Oct 24 01:13:55 2018

59
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,59 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 35295068160 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:1048576.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 21:59:52 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 35295068160 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 21:59:52 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 32.87 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 49221206016.
read 391.10 34467840 1024.00 0.001724 120.02 0.000263 120.02 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 62731059200.
read 498.38 34467840 1024.00 0.000741 120.04 0.000189 120.04 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 63361253376.
read 503.42 34467840 1024.00 0.000696 120.03 0.000217 120.03 2
Max Read: 503.42 MiB/sec (527.88 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 503.42 391.10 464.30 51.80 120.03115 0 4 4 3 0 0 1 0 0 1 35295068160 1048576 49221206016 MPIIO 0
Finished: Mon Oct 22 22:05:53 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 2
obdidx objid objid group
2 12566598 0xbfc046 0
4 12508315 0xbedc9b 0

46
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:4#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:31:53 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:31:53 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 37.50 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 33224130560.
read 1055.42 39321600 1024.00 0.001879 30.02 0.000229 30.02 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 34140585984.
read 1084.16 39321600 1024.00 0.000761 30.03 0.000175 30.03 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 34597765120.
read 1099.35 39321600 1024.00 0.000776 30.01 0.000192 30.01 2
Max Read: 1099.35 MiB/sec (1152.75 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1099.35 1055.42 1079.64 18.22 30.02200 0 4 4 3 0 0 1 0 0 1 40265318400 1048576 33224130560 MPIIO 0
Finished: Wed Oct 24 08:33:23 2018
+ set +x

45
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,45 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 35295068160 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:1048576.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 21:54:33 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 35295068160 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 21:54:33 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 32.87 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 141580828672.
write 1366.54 34467840 1024.00 0.006336 98.80 0.000266 98.81 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179224064.
WARNING: Using actual aggregate bytes moved = 141389987840.
write 1314.35 34467840 1024.00 0.059727 102.53 0.000210 102.59 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 140744065024.
write 1344.58 34467840 1024.00 0.024153 99.80 0.000231 99.83 2
Max Write: 1366.54 MiB/sec (1432.92 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 1366.54 1314.35 1341.83 21.39 100.40729 0 4 4 3 0 0 1 0 0 1 35295068160 1048576 141580828672 MPIIO 0
Finished: Mon Oct 22 21:59:43 2018

49
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,49 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 35295068160 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:10485760.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 15:44:26 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 35295068160 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 15:44:26 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 32.87 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 141882818560.
read 1300.58 34467840 10240 0.085615 103.95 0.000470 104.04 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 142165934080.
read 1391.81 34467840 10240 0.000767 97.41 0.000214 97.41 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 141631160320.
read 1353.29 34467840 10240 0.000717 99.81 0.000210 99.81 2
Max Read: 1391.81 MiB/sec (1459.41 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1391.81 1300.58 1348.56 37.39 100.41994 0 4 4 3 0 0 1 0 0 1 35295068160 10485760 141882818560 MPIIO 0
Finished: Mon Oct 22 15:49:27 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1

46
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:4#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:23:34 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:23:34 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 37.50 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 25406996480.
read 805.30 39321600 10240 0.002072 30.09 0.000240 30.09 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 29685186560.
read 939.46 39321600 10240 0.000735 30.13 0.000230 30.13 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 34005319680.
read 1077.09 39321600 10240 0.000682 30.11 0.000232 30.11 2
Max Read: 1077.09 MiB/sec (1129.41 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1077.09 805.30 940.62 110.96 30.11042 0 4 4 3 0 0 1 0 0 1 40265318400 10485760 25406996480 MPIIO 0
Finished: Wed Oct 24 08:25:04 2018
+ set +x

45
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,45 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 35295068160 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:10485760.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 15:40:09 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 35295068160 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 15:40:09 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 32.87 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 141169786880.
write 1715.66 34467840 10240 0.008235 78.46 0.000289 78.47 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 141138329600.
write 1737.39 34467840 10240 0.059053 77.41 0.000201 77.47 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 141882818560.
write 1730.10 34467840 10240 0.094761 78.11 0.000240 78.21 2
Max Write: 1737.39 MiB/sec (1821.79 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 1737.39 1715.66 1727.72 9.03 78.05092 0 4 4 3 0 0 1 0 0 1 35295068160 10485760 141169786880 MPIIO 0
Finished: Mon Oct 22 15:44:15 2018

59
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,59 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 35295068160 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Tue Oct 23 00:02:33 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 35295068160 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Tue Oct 23 00:02:33 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 32.87 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 2193473536.
read 17.36 34467840 16.00 0.019826 120.46 0.000260 120.48 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 2254274560.
read 17.85 34467840 16.00 0.000787 120.47 0.000189 120.47 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 2290745344.
read 18.13 34467840 16.00 0.000760 120.47 0.000180 120.47 2
Max Read: 18.13 MiB/sec (19.02 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 18.13 17.36 17.78 0.32 120.47336 0 4 4 3 0 0 1 0 0 1 35295068160 16384 2193473536 MPIIO 0
Finished: Tue Oct 23 00:08:34 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12378618 0xbce1fa 0
6 12591881 0xc02309 0

46
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:4#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:48:13 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:48:13 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 37.50 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 1815003136.
read 56.69 39321600 16.00 0.006031 30.53 0.000245 30.53 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 1801043968.
read 56.26 39321600 16.00 0.000764 30.53 0.000156 30.53 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 1690976256.
read 52.83 39321600 16.00 0.000727 30.53 0.000182 30.53 2
Max Read: 56.69 MiB/sec (59.44 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 56.69 52.83 55.26 1.73 30.52981 0 4 4 3 0 0 1 0 0 1 40265318400 16384 1815003136 MPIIO 0
Finished: Wed Oct 24 08:49:45 2018
+ set +x

45
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,45 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 35295068160 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 23:55:46 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 35295068160 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 23:55:46 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 32.87 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141178732544.
WARNING: Using actual aggregate bytes moved = 5211865088.
write 38.02 34467840 16.00 0.001959 130.74 0.000262 130.74 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179404288.
WARNING: Using actual aggregate bytes moved = 5158879232.
write 38.72 34467840 16.00 0.001565 127.06 0.000208 127.06 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179355136.
WARNING: Using actual aggregate bytes moved = 5104254976.
write 38.64 34467840 16.00 0.000971 125.99 0.000187 125.99 2
Max Write: 38.72 MiB/sec (40.60 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 38.72 38.02 38.46 0.31 127.92968 0 4 4 3 0 0 1 0 0 1 35295068160 16384 5211865088 MPIIO 0
Finished: Tue Oct 23 00:02:26 2018

88
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:POSIX#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,88 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:POSIX#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 01:07:40 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:07:40 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 37.50 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 2536550400.
read 40.31 39321600 100.00 0.000199 60.02 0.000147 60.02 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 2612326400.
read 41.51 39321600 100.00 0.000182 60.02 0.000137 60.02 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 2664652800.
read 42.34 39321600 100.00 0.000166 60.02 0.000136 60.02 2
Max Read: 42.34 MiB/sec (44.40 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 42.34 40.31 41.38 0.84 60.01977 0 4 4 3 1 0 1 0 0 1 40265318400 102400 2536550400 POSIX 0
Finished: Wed Oct 24 01:10:40 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000002
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12514720 0xbef5a0 0
7 12463341 0xbe2ced 0
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 0
obdidx objid objid group
0 12426644 0xbd9d94 0
2 12572981 0xbfd935 0
/esfs/jtacquaviva/ioperf/file_write.00000003
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 7
obdidx objid objid group
7 12463340 0xbe2cec 0
1 12644626 0xc0f112 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12384983 0xbcfad7 0
6 12598239 0xc03bdf 0

44
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:POSIX#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,44 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:POSIX#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 01:04:12 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:04:12 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 37.50 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060454400.
WARNING: Using actual aggregate bytes moved = 49498112000.
write 741.94 39321600 100.00 0.000807 63.62 0.000151 63.62 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161057792000.
WARNING: Using actual aggregate bytes moved = 48220979200.
write 723.09 39321600 100.00 0.001075 63.60 0.000144 63.60 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060044800.
WARNING: Using actual aggregate bytes moved = 48337817600.
write 725.81 39321600 100.00 0.001092 63.51 0.000154 63.51 2
Max Write: 741.94 MiB/sec (777.98 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 741.94 723.09 730.28 8.32 63.57836 0 4 4 3 1 0 1 0 0 1 40265318400 102400 49498112000 POSIX 0
Finished: Wed Oct 24 01:07:27 2018

88
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:POSIX#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,88 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 35295068160 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:POSIX#T:1048576.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 21:48:31 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 35295068160 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 21:48:31 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 32.87 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 564721090560.
WARNING: Using actual aggregate bytes moved = 57900269568.
read 460.09 34467840 1024.00 0.000194 120.02 0.000203 120.02 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 564721090560.
WARNING: Using actual aggregate bytes moved = 87379935232.
read 694.36 34467840 1024.00 0.000161 120.01 0.000199 120.01 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 564721090560.
WARNING: Using actual aggregate bytes moved = 127142985728.
read 1010.30 34467840 1024.00 0.000192 120.02 0.000170 120.02 2
Max Read: 1010.30 MiB/sec (1059.38 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1010.30 460.09 721.59 225.45 120.01485 0 4 4 3 1 0 1 0 0 1 35295068160 1048576 57900269568 POSIX 0
Finished: Mon Oct 22 21:54:31 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000002
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 1
obdidx objid objid group
1 12638227 0xc0d813 0
3 12486539 0xbe878b 0
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12508313 0xbedc99 0
7 12456953 0xbe13f9 0
/esfs/jtacquaviva/ioperf/file_write.00000003
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 2
obdidx objid objid group
2 12566597 0xbfc045 0
4 12508314 0xbedc9a 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12378594 0xbce1e2 0
6 12591857 0xc022f1 0

35
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:POSIX#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,35 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 35295068160 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:POSIX#T:1048576.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 21:45:57 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 35295068160 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 21:45:57 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 32.87 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
write 2890.64 34467840 1024.00 0.000807 46.58 0.000208 46.58 0
write 2810.40 34467840 1024.00 0.001055 47.91 0.000175 47.91 1
write 2948.45 34467840 1024.00 0.001035 45.66 0.000167 45.66 2
Max Write: 2948.45 MiB/sec (3091.67 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 2948.45 2810.40 2883.16 56.61 46.71684 0 4 4 3 1 0 1 0 0 1 35295068160 1048576 141180272640 POSIX 0
Finished: Mon Oct 22 21:48:22 2018

88
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:POSIX#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,88 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:POSIX#T:10485760.txt
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 35295068160 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 20:44:08 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 35295068160 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 20:44:08 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 32.87 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 564721090560.
WARNING: Using actual aggregate bytes moved = 80708894720.
read 640.91 34467840 10240 0.000718 120.09 0.000175 120.10 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 564721090560.
WARNING: Using actual aggregate bytes moved = 113959239680.
read 905.12 34467840 10240 0.000153 120.07 0.000165 120.07 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 564721090560.
WARNING: Using actual aggregate bytes moved = 141180272640.
read 1501.27 34467840 10240 0.000197 89.68 0.000169 89.68 2
Max Read: 1501.27 MiB/sec (1574.19 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1501.27 640.91 1015.77 359.85 109.95041 0 4 4 3 1 0 1 0 0 1 35295068160 10485760 80708894720 POSIX 0
Finished: Mon Oct 22 20:49:38 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000002
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12378572 0xbce1cc 0
6 12591835 0xc022db 0
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 7
obdidx objid objid group
7 12456930 0xbe13e2 0
1 12638205 0xc0d7fd 0
/esfs/jtacquaviva/ioperf/file_write.00000003
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 2
obdidx objid objid group
2 12566573 0xbfc02d 0
4 12508290 0xbedc82 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 6
obdidx objid objid group
6 12591834 0xc022da 0
0 12420220 0xbd847c 0

35
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:POSIX#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,35 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 35295068160 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:POSIX#T:10485760.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 20:41:51 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 35295068160 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 20:41:51 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 32.87 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
write 2661.11 34467840 10240 0.000798 50.59 0.000182 50.60 0
write 3391.94 34467840 10240 0.001092 39.69 0.000205 39.69 1
write 4102 34467840 10240 0.001069 32.82 0.000197 32.82 2
Max Write: 4102.20 MiB/sec (4301.47 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 4102.20 2661.11 3385.08 588.34 41.03695 0 4 4 3 1 0 1 0 0 1 35295068160 10485760 141180272640 POSIX 0
Finished: Mon Oct 22 20:43:58 2018

88
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:POSIX#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,88 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 35295068160 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:POSIX#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 23:49:44 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 35295068160 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 23:49:44 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 32.87 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 564721090560.
WARNING: Using actual aggregate bytes moved = 1782857728.
read 14.16 34467840 16.00 0.000179 120.10 0.000144 120.10 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 564721090560.
WARNING: Using actual aggregate bytes moved = 1877540864.
read 14.91 34467840 16.00 0.000184 120.10 0.000153 120.10 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 564721090560.
WARNING: Using actual aggregate bytes moved = 1892745216.
read 15.03 34467840 16.00 0.000173 120.10 0.000144 120.10 2
Max Read: 15.03 MiB/sec (15.76 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 15.03 14.16 14.70 0.39 120.09736 0 4 4 3 1 0 1 0 0 1 35295068160 16384 1782857728 POSIX 0
Finished: Mon Oct 22 23:55:45 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000002
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 6
obdidx objid objid group
6 12591879 0xc02307 0
0 12420265 0xbd84a9 0
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 2
obdidx objid objid group
2 12566618 0xbfc05a 0
4 12508335 0xbedcaf 0
/esfs/jtacquaviva/ioperf/file_write.00000003
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12378617 0xbce1f9 0
6 12591880 0xc02308 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 7
obdidx objid objid group
7 12456975 0xbe140f 0
1 12638249 0xc0d829 0

44
benchmark/merged_output/COUNT:1#NN:1#PPN:4#API:POSIX#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,44 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 35295068160 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:POSIX#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 23:42:48 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 35295068160 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 23:42:48 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 32.87 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179879424.
WARNING: Using actual aggregate bytes moved = 18400575488.
write 128.96 34467840 16.00 0.000815 136.07 0.000182 136.07 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141178568704.
WARNING: Using actual aggregate bytes moved = 17841750016.
write 130.93 34467840 16.00 0.001049 129.95 0.000175 129.95 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180207104.
WARNING: Using actual aggregate bytes moved = 18589237248.
write 131.83 34467840 16.00 0.001016 134.48 0.000151 134.48 2
Max Write: 131.83 MiB/sec (138.23 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 131.83 128.96 130.57 1.20 133.50294 0 4 4 3 1 0 1 0 0 1 35295068160 16384 18400575488 POSIX 0
Finished: Mon Oct 22 23:49:32 2018

59
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,59 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 01:39:28 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:39:28 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 25 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 5692006400.
read 90.34 26214400 100.00 0.007037 60.08 0.000263 60.09 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 5929369600.
read 94.12 26214400 100.00 0.000932 60.08 0.000185 60.08 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 6173798400.
read 98.00 26214400 100.00 0.000894 60.08 0.000180 60.08 2
Max Read: 98.00 MiB/sec (102.76 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 98.00 90.34 94.15 3.13 60.08164 0 6 6 3 0 0 1 0 0 1 26843545600 102400 5692006400 MPIIO 0
Finished: Wed Oct 24 01:42:29 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 1
obdidx objid objid group
1 12644635 0xc0f11b 0
3 12492930 0xbea082 0

46
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:6#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:43:21 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:43:21 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 25 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 12445081600.
read 394.53 26214400 100.00 0.002136 30.08 0.000237 30.08 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 12079718400.
read 383.00 26214400 100.00 0.000896 30.08 0.000180 30.08 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 12653977600.
read 401.22 26214400 100.00 0.000907 30.08 0.000157 30.08 2
Max Read: 401.22 MiB/sec (420.71 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 401.22 383.00 392.92 7.53 30.07955 0 6 6 3 0 0 1 0 0 1 26843545600 102400 12445081600 MPIIO 0
Finished: Wed Oct 24 08:44:51 2018
+ set +x

45
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,45 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 01:36:09 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:36:09 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 25 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060147200.
WARNING: Using actual aggregate bytes moved = 13878067200.
write 217.53 26214400 100.00 0.006332 60.84 0.000235 60.84 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161056563200.
WARNING: Using actual aggregate bytes moved = 14127308800.
write 224.14 26214400 100.00 0.001595 60.11 0.000205 60.11 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060966400.
WARNING: Using actual aggregate bytes moved = 14639411200.
write 227.50 26214400 100.00 0.018975 61.35 0.000240 61.37 2
Max Write: 227.50 MiB/sec (238.56 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 227.50 217.53 223.06 4.15 60.77317 0 6 6 3 0 0 1 0 0 1 26843545600 102400 13878067200 MPIIO 0
Finished: Wed Oct 24 01:39:20 2018

59
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,59 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 23530045440 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:1048576.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 21:39:55 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 23530045440 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 21:39:55 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 21.91 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 44938821632.
read 356.87 22978560 1024.00 0.042674 120.05 0.000256 120.09 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 58208550912.
read 462.40 22978560 1024.00 0.000904 120.05 0.000207 120.05 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 58485374976.
read 464.67 22978560 1024.00 0.000940 120.03 0.000198 120.03 2
Max Read: 464.67 MiB/sec (487.24 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 464.67 356.87 427.98 50.29 120.05991 0 6 6 3 0 0 1 0 0 1 23530045440 1048576 44938821632 MPIIO 0
Finished: Mon Oct 22 21:45:55 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 3
obdidx objid objid group
3 12486536 0xbe8788 0
5 12378592 0xbce1e0 0

46
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:6#API:MPIIO#T:1048576#TYPE:read.txt
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:35:07 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:35:07 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 25 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 52439285760.
read 1665.64 26214400 1024.00 0.002850 30.02 0.000248 30.02 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 54208233472.
read 1721.35 26214400 1024.00 0.000961 30.03 0.000186 30.03 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 55190749184.
read 1753.45 26214400 1024.00 0.000755 30.02 0.000191 30.02 2
Max Read: 1753.45 MiB/sec (1838.62 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1753.45 1665.64 1713.48 36.28 30.02496 0 6 6 3 0 0 1 0 0 1 26843545600 1048576 52439285760 MPIIO 0
Finished: Wed Oct 24 08:36:38 2018
+ set +x

45
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,45 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 23530045440 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:1048576.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 21:34:43 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 23530045440 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 21:34:43 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 21.91 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 141151961088.
write 1325.44 22978560 1024.00 0.005407 101.56 0.000274 101.56 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 141527351296.
write 1373.27 22978560 1024.00 0.005024 98.28 0.000279 98.28 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 140823756800.
write 1348.71 22978560 1024.00 0.030859 99.55 0.000239 99.58 2
Max Write: 1373.27 MiB/sec (1439.98 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 1373.27 1325.44 1349.14 19.53 99.80739 0 6 6 3 0 0 1 0 0 1 23530045440 1048576 141151961088 MPIIO 0
Finished: Mon Oct 22 21:39:46 2018

49
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,49 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 23530045440 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:10485760.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 15:34:14 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 23530045440 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 15:34:14 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 21.91 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 141903790080.
read 1667.35 22978560 10240 0.076982 81.09 0.000287 81.16 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 141914275840.
read 1740.24 22978560 10240 0.000922 77.77 0.000222 77.77 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 141075415040.
read 1715.50 22978560 10240 0.000941 78.42 0.000247 78.43 2
Max Read: 1740.24 MiB/sec (1824.77 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1740.24 1667.35 1707.70 30.27 79.12064 0 6 6 3 0 0 1 0 0 1 23530045440 10485760 141903790080 MPIIO 0
Finished: Mon Oct 22 15:38:11 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1

46
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:6#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:26:51 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:26:51 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 25 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 58521026560.
read 1854.90 26214400 10240 0.006318 30.08 0.000228 30.09 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 65777172480.
read 2081.15 26214400 10240 0.000871 30.14 0.000197 30.14 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 67612180480.
read 2144.13 26214400 10240 0.000911 30.07 0.000197 30.07 2
Max Read: 2144.13 MiB/sec (2248.28 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 2144.13 1854.90 2026.73 124.19 30.10087 0 6 6 3 0 0 1 0 0 1 26843545600 10485760 58521026560 MPIIO 0
Finished: Wed Oct 24 08:28:21 2018
+ set +x

45
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,45 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 23530045440 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:10485760.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 15:29:33 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 23530045440 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 15:29:33 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 21.91 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 140844728320.
write 1568.05 22978560 10240 0.001879 85.66 0.000354 85.66 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 140813271040.
write 1559.09 22978560 10240 0.345781 85.79 0.000278 86.13 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 143424225280.
write 1556.13 22978560 10240 0.469190 87.43 0.000301 87.90 2
Max Write: 1568.05 MiB/sec (1644.22 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 1568.05 1556.13 1561.09 5.07 86.56379 0 6 6 3 0 0 1 0 0 1 23530045440 10485760 140844728320 MPIIO 0
Finished: Mon Oct 22 15:34:04 2018

59
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,59 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 23530045440 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 23:36:45 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 23530045440 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 23:36:45 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 21.91 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 3196665856.
read 25.31 22978560 16.00 0.002243 120.43 0.000221 120.43 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 3265265664.
read 25.86 22978560 16.00 0.000921 120.43 0.000202 120.43 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 3335749632.
read 26.42 22978560 16.00 0.000911 120.43 0.000197 120.43 2
Max Read: 26.42 MiB/sec (27.70 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 26.42 25.31 25.86 0.45 120.42791 0 6 6 3 0 0 1 0 0 1 23530045440 16384 3196665856 MPIIO 0
Finished: Mon Oct 22 23:42:47 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12508332 0xbedcac 0
7 12456973 0xbe140d 0

46
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:6#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:51:24 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:51:24 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 25 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 2514714624.
read 78.63 26214400 16.00 0.002352 30.50 0.000221 30.50 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 2557575168.
read 79.96 26214400 16.00 0.000893 30.50 0.000179 30.50 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 2575958016.
read 80.55 26214400 16.00 0.000921 30.50 0.000164 30.50 2
Max Read: 80.55 MiB/sec (84.47 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 80.55 78.63 79.72 0.80 30.49964 0 6 6 3 0 0 1 0 0 1 26843545600 16384 2514714624 MPIIO 0
Finished: Wed Oct 24 08:52:55 2018
+ set +x

45
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,45 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 23530045440 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 23:30:03 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 23530045440 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 23:30:03 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 21.91 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141178667008.
WARNING: Using actual aggregate bytes moved = 5166858240.
write 40.55 22978560 16.00 0.005347 121.50 0.000256 121.50 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179846656.
WARNING: Using actual aggregate bytes moved = 4936187904.
write 37.87 22978560 16.00 0.001034 124.30 0.000186 124.30 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179650048.
WARNING: Using actual aggregate bytes moved = 5161730048.
write 40.86 22978560 16.00 0.013837 120.47 0.000193 120.48 2
Max Write: 40.86 MiB/sec (42.84 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 40.86 37.87 39.76 1.34 122.09637 0 6 6 3 0 0 1 0 0 1 23530045440 16384 5166858240 MPIIO 0
Finished: Mon Oct 22 23:36:39 2018

108
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:POSIX#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,108 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:POSIX#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 01:33:07 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:33:07 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 25 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 966367641600.
WARNING: Using actual aggregate bytes moved = 4031488000.
read 64.04 26214400 100.00 0.000204 60.03 0.000173 60.03 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 966367641600.
WARNING: Using actual aggregate bytes moved = 4278784000.
read 67.99 26214400 100.00 0.000208 60.02 0.000152 60.02 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 966367641600.
WARNING: Using actual aggregate bytes moved = 4422758400.
read 70.27 26214400 100.00 0.000217 60.02 0.000169 60.02 2
Max Read: 70.27 MiB/sec (73.68 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 70.27 64.04 67.43 2.57 60.02534 0 6 6 3 1 0 1 0 0 1 26843545600 102400 4031488000 POSIX 0
Finished: Wed Oct 24 01:36:07 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000002
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12384991 0xbcfadf 0
6 12598246 0xc03be6 0
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 1
obdidx objid objid group
1 12644634 0xc0f11a 0
3 12492928 0xbea080 0
/esfs/jtacquaviva/ioperf/file_write.00000004
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 2
obdidx objid objid group
2 12572987 0xbfd93b 0
4 12514725 0xbef5a5 0
/esfs/jtacquaviva/ioperf/file_write.00000003
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 3
obdidx objid objid group
3 12492929 0xbea081 0
5 12384992 0xbcfae0 0
/esfs/jtacquaviva/ioperf/file_write.00000005
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 0
obdidx objid objid group
0 12426650 0xbd9d9a 0
2 12572988 0xbfd93c 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12514726 0xbef5a6 0
7 12463348 0xbe2cf4 0

44
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:POSIX#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,44 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:POSIX#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 01:29:43 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:29:43 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 25 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060864000.
WARNING: Using actual aggregate bytes moved = 60960972800.
write 916.90 26214400 100.00 0.001193 63.40 0.000175 63.41 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161059430400.
WARNING: Using actual aggregate bytes moved = 50419200000.
write 754.87 26214400 100.00 0.001385 63.70 0.000164 63.70 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 58768588800.
write 879.53 26214400 100.00 0.001391 63.72 0.000157 63.72 2
Max Write: 916.90 MiB/sec (961.44 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 916.90 754.87 850.43 69.27 63.60897 0 6 6 3 1 0 1 0 0 1 26843545600 102400 60960972800 POSIX 0
Finished: Wed Oct 24 01:32:58 2018

108
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:POSIX#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,108 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 23530045440 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:POSIX#T:1048576.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 21:29:30 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 23530045440 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 21:29:30 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 21.91 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 847081635840.
WARNING: Using actual aggregate bytes moved = 82219892736.
read 653.31 22978560 1024.00 0.000224 120.02 0.000190 120.02 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 847081635840.
WARNING: Using actual aggregate bytes moved = 137311027200.
read 1091.16 22978560 1024.00 0.000197 120.01 0.000197 120.01 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 847081635840.
WARNING: Using actual aggregate bytes moved = 141180272640.
read 1902.92 22978560 1024.00 0.000191 70.75 0.000186 70.75 2
Max Read: 1902.92 MiB/sec (1995.36 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1902.92 653.31 1215.80 517.71 103.59530 0 6 6 3 1 0 1 0 0 1 23530045440 1048576 82219892736 POSIX 0
Finished: Mon Oct 22 21:34:41 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000002
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 2
obdidx objid objid group
2 12566591 0xbfc03f 0
4 12508308 0xbedc94 0
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12378590 0xbce1de 0
6 12591853 0xc022ed 0
/esfs/jtacquaviva/ioperf/file_write.00000004
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 1
obdidx objid objid group
1 12638224 0xc0d810 0
3 12486534 0xbe8786 0
/esfs/jtacquaviva/ioperf/file_write.00000003
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 3
obdidx objid objid group
3 12486535 0xbe8787 0
5 12378591 0xbce1df 0
/esfs/jtacquaviva/ioperf/file_write.00000005
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 0
obdidx objid objid group
0 12420240 0xbd8490 0
2 12566592 0xbfc040 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12508309 0xbedc95 0
7 12456949 0xbe13f5 0

35
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:POSIX#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,35 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 23530045440 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:POSIX#T:1048576.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 21:27:45 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 23530045440 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 21:27:45 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 21.91 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
write 4418 22978560 1024.00 0.001158 30.47 0.000194 30.48 0
write 4372 22978560 1024.00 0.001450 30.79 0.000180 30.79 1
write 4458 22978560 1024.00 0.001382 30.20 0.000175 30.20 2
Max Write: 4458.46 MiB/sec (4675.03 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 4458.46 4372.45 4416.29 35.13 30.48908 0 6 6 3 1 0 1 0 0 1 23530045440 1048576 141180272640 POSIX 0
Finished: Mon Oct 22 21:29:20 2018

108
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:POSIX#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,108 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:POSIX#T:10485760.txt
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 23530045440 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 18:17:27 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 23530045440 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 18:17:27 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 21.91 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 847081635840.
WARNING: Using actual aggregate bytes moved = 132980408320.
read 1055.51 22978560 10240 0.000196 120.15 0.000208 120.15 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 847081635840.
WARNING: Using actual aggregate bytes moved = 141180272640.
read 1513.33 22978560 10240 0.000221 88.97 0.000175 88.97 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 847081635840.
WARNING: Using actual aggregate bytes moved = 141180272640.
read 2388.40 22978560 10240 0.000229 56.37 0.000185 56.37 2
Max Read: 2388.40 MiB/sec (2504.42 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 2388.40 1055.51 1652.41 552.97 88.49760 0 6 6 3 1 0 1 0 0 1 23530045440 10485760 132980408320 POSIX 0
Finished: Mon Oct 22 18:21:53 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000002
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 0
obdidx objid objid group
0 12420127 0xbd841f 0
2 12566482 0xbfbfd2 0
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 3
obdidx objid objid group
3 12486425 0xbe8719 0
5 12378479 0xbce16f 0
/esfs/jtacquaviva/ioperf/file_write.00000004
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 1
obdidx objid objid group
1 12638113 0xc0d7a1 0
3 12486426 0xbe871a 0
/esfs/jtacquaviva/ioperf/file_write.00000003
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 7
obdidx objid objid group
7 12456840 0xbe1388 0
1 12638112 0xc0d7a0 0
/esfs/jtacquaviva/ioperf/file_write.00000005
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12508199 0xbedc27 0
7 12456841 0xbe1389 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12378480 0xbce170 0
6 12591742 0xc0227e 0

35
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:POSIX#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,35 @@
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:POSIX#T:10485760.txt
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 23530045440 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 18:15:52 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 23530045440 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 18:15:52 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 21.91 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
write 4739 22978560 10240 0.001139 28.41 0.000202 28.41 0
write 5012 22978560 10240 0.003508 26.86 0.000235 26.87 1
write 5144 22978560 10240 0.002094 26.17 0.000239 26.17 2
Max Write: 5144.25 MiB/sec (5394.13 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 5144.25 4738.59 4964.82 168.88 27.15067 0 6 6 3 1 0 1 0 0 1 23530045440 10485760 141180272640 POSIX 0
Finished: Mon Oct 22 18:17:18 2018

108
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:POSIX#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,108 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 23530045440 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:POSIX#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 23:24:00 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 23530045440 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 23:24:00 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 21.91 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 847081635840.
WARNING: Using actual aggregate bytes moved = 2841722880.
read 22.57 22978560 16.00 0.000229 120.07 0.001204 120.07 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 847081635840.
WARNING: Using actual aggregate bytes moved = 3014508544.
read 23.94 22978560 16.00 0.000234 120.07 0.000178 120.07 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 847081635840.
WARNING: Using actual aggregate bytes moved = 3021340672.
read 24.00 22978560 16.00 0.000192 120.07 0.000172 120.07 2
Max Read: 24.00 MiB/sec (25.16 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 24.00 22.57 23.50 0.66 120.07070 0 6 6 3 1 0 1 0 0 1 23530045440 16384 2841722880 POSIX 0
Finished: Mon Oct 22 23:30:01 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000002
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 2
obdidx objid objid group
2 12566615 0xbfc057 0
4 12508330 0xbedcaa 0
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 7
obdidx objid objid group
7 12456971 0xbe140b 0
1 12638245 0xc0d825 0
/esfs/jtacquaviva/ioperf/file_write.00000004
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12508331 0xbedcab 0
7 12456972 0xbe140c 0
/esfs/jtacquaviva/ioperf/file_write.00000003
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12378611 0xbce1f3 0
6 12591874 0xc02302 0
/esfs/jtacquaviva/ioperf/file_write.00000005
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 6
obdidx objid objid group
6 12591875 0xc02303 0
0 12420261 0xbd84a5 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 3
obdidx objid objid group
3 12486558 0xbe879e 0
5 12378612 0xbce1f4 0

44
benchmark/merged_output/COUNT:1#NN:1#PPN:6#API:POSIX#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,44 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 23530045440 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:POSIX#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 23:17:05 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 23530045440 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 23:17:05 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 21.91 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180076032.
WARNING: Using actual aggregate bytes moved = 25803784192.
write 180.20 22978560 16.00 0.001147 136.56 0.000180 136.56 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179617280.
WARNING: Using actual aggregate bytes moved = 25233440768.
write 184.25 22978560 16.00 0.001454 130.61 0.000185 130.61 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141178535936.
WARNING: Using actual aggregate bytes moved = 25464586240.
write 180.65 22978560 16.00 0.004355 134.43 0.000167 134.43 2
Max Write: 184.25 MiB/sec (193.20 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 184.25 180.20 181.70 1.81 133.86699 0 6 6 3 1 0 1 0 0 1 23530045440 16384 25803784192 POSIX 0
Finished: Mon Oct 22 23:23:50 2018

59
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,59 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:102400.txt
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 01:01:10 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:01:10 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 18.75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 6008320000.
read 95.36 19660800 100.00 0.006084 60.08 0.000243 60.09 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 6281113600.
read 99.70 19660800 100.00 0.001106 60.08 0.000289 60.08 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 6569676800.
read 104.29 19660800 100.00 0.001119 60.07 0.000213 60.08 2
Max Read: 104.29 MiB/sec (109.36 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 104.29 95.36 99.79 3.65 60.08071 0 8 8 3 0 0 1 0 0 1 20132659200 102400 6008320000 MPIIO 0
Finished: Wed Oct 24 01:04:11 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12384980 0xbcfad4 0
6 12598236 0xc03bdc 0

46
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:8#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:38:27 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:38:27 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 18.75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 16035737600.
read 508.39 19660800 100.00 0.002243 30.08 0.000280 30.08 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 15484518400.
read 490.96 19660800 100.00 0.001064 30.08 0.000186 30.08 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 15903232000.
read 504.19 19660800 100.00 0.001041 30.08 0.000175 30.08 2
Max Read: 508.39 MiB/sec (533.09 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 508.39 490.96 501.18 7.43 30.07996 0 8 8 3 0 0 1 0 0 1 20132659200 102400 16035737600 MPIIO 0
Finished: Wed Oct 24 08:39:57 2018
+ set +x

45
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,45 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 00:57:49 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 00:57:49 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 18.75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060147200.
WARNING: Using actual aggregate bytes moved = 14386278400.
write 223.36 19660800 100.00 0.008652 61.42 0.000296 61.42 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060147200.
WARNING: Using actual aggregate bytes moved = 14757171200.
write 231.38 19660800 100.00 0.020601 60.80 0.000238 60.82 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060966400.
WARNING: Using actual aggregate bytes moved = 14609510400.
write 227.67 19660800 100.00 0.010475 61.19 0.000243 61.20 2
Max Write: 231.38 MiB/sec (242.62 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 231.38 223.36 227.47 3.28 61.14912 0 8 8 3 0 0 1 0 0 1 20132659200 102400 14386278400 MPIIO 0
Finished: Wed Oct 24 01:00:59 2018

59
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,59 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 17647534080 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:1048576.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 21:21:43 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 17647534080 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 21:21:43 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 16.44 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 50769952768.
read 403.38 17233920 1024.00 0.002663 120.03 0.000268 120.03 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 60143173632.
read 477.74 17233920 1024.00 0.001079 120.06 0.000247 120.06 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 61476962304.
read 488.37 17233920 1024.00 0.001143 120.05 0.000220 120.05 2
Max Read: 488.37 MiB/sec (512.09 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 488.37 403.38 456.49 37.81 120.04743 0 8 8 3 0 0 1 0 0 1 17647534080 1048576 50769952768 MPIIO 0
Finished: Mon Oct 22 21:27:43 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 7
obdidx objid objid group
7 12456945 0xbe13f1 0
1 12638220 0xc0d80c 0

46
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:8#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:30:11 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:30:11 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 18.75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 62083039232.
read 1971.30 19660800 1024.00 0.002403 30.03 0.000215 30.03 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 58500055040.
read 1858.12 19660800 1024.00 0.001101 30.02 0.000305 30.02 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 56201576448.
read 1778.27 19660800 1024.00 0.001074 30.14 0.000205 30.14 2
Max Read: 1971.30 MiB/sec (2067.05 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1971.30 1778.27 1869.23 79.19 30.06669 0 8 8 3 0 0 1 0 0 1 20132659200 1048576 62083039232 MPIIO 0
Finished: Wed Oct 24 08:31:41 2018
+ set +x

45
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,45 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 17647534080 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:1048576.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 21:16:22 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 17647534080 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 21:16:22 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 16.44 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179224064.
WARNING: Using actual aggregate bytes moved = 141393133568.
write 1341.52 17233920 1024.00 0.006187 100.51 0.000394 100.52 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 141208584192.
write 1300.42 17233920 1024.00 0.022214 103.53 0.000317 103.56 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 140952731648.
write 1376.55 17233920 1024.00 0.016399 97.64 0.000286 97.65 2
Max Write: 1376.55 MiB/sec (1443.42 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 1376.55 1300.42 1339.50 31.11 100.57450 0 8 8 3 0 0 1 0 0 1 17647534080 1048576 141393133568 MPIIO 0
Finished: Mon Oct 22 21:21:31 2018

49
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,49 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 17647534080 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:10485760.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 15:24:18 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 17647534080 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 15:24:18 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 16.44 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 141694074880.
read 1706.21 17233920 10240 0.058433 79.14 0.000337 79.20 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 140288983040.
read 1890.77 17233920 10240 0.001087 70.76 0.000277 70.76 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 140666470400.
read 1992.99 17233920 10240 0.001099 67.31 0.000207 67.31 2
Max Read: 1992.99 MiB/sec (2089.80 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1992.99 1706.21 1863.32 118.68 72.42319 0 8 8 3 0 0 1 0 0 1 17647534080 10485760 141694074880 MPIIO 0
Finished: Mon Oct 22 15:27:56 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1

46
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:8#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:21:52 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:21:52 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 18.75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 27367833600.
read 865.72 19660800 10240 0.002712 30.15 0.000249 30.15 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 32264683520.
read 1022.33 19660800 10240 0.001086 30.10 0.000268 30.10 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 38199623680.
read 1209.66 19660800 10240 0.001084 30.11 0.000204 30.12 2
Max Read: 1209.66 MiB/sec (1268.42 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1209.66 865.72 1032.57 140.60 30.12076 0 8 8 3 0 0 1 0 0 1 20132659200 10485760 27367833600 MPIIO 0
Finished: Wed Oct 24 08:23:23 2018
+ set +x

45
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,45 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 17647534080 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:10485760.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 15:19:28 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 17647534080 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 15:19:28 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 16.44 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 141599703040.
write 1540.40 17233920 10240 0.002347 87.66 0.000382 87.67 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 141316587520.
write 1509.42 17233920 10240 0.117178 89.17 0.000275 89.29 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 141798932480.
write 1490.90 17233920 10240 0.214682 90.49 0.000251 90.70 2
Max Write: 1540.40 MiB/sec (1615.22 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 1540.40 1490.90 1513.57 20.42 89.21839 0 8 8 3 0 0 1 0 0 1 17647534080 10485760 141599703040 MPIIO 0
Finished: Mon Oct 22 15:24:06 2018

59
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:no.txt Normal file
View File

@ -0,0 +1,59 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 17647534080 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 23:11:02 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 17647534080 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 23:11:02 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 16.44 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 4092526592.
read 32.41 17233920 16.00 0.002418 120.41 0.000254 120.41 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 4224303104.
read 33.46 17233920 16.00 0.000925 120.40 0.000182 120.40 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 4356243456.
read 34.50 17233920 16.00 0.000914 120.40 0.000175 120.41 2
Max Read: 34.50 MiB/sec (36.18 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 34.50 32.41 33.46 0.85 120.40629 0 8 8 3 0 0 1 0 0 1 17647534080 16384 4092526592 MPIIO 0
Finished: Mon Oct 22 23:17:03 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 0
obdidx objid objid group
0 12420257 0xbd84a1 0
2 12566611 0xbfc053 0

46
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:8#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:46:35 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:46:35 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 18.75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 3639099392.
read 113.93 19660800 16.00 0.002673 30.46 0.002983 30.46 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 3703963648.
read 115.97 19660800 16.00 0.001092 30.46 0.000232 30.46 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 3627073536.
read 113.56 19660800 16.00 0.001068 30.46 0.000199 30.46 2
Max Read: 115.97 MiB/sec (121.60 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 115.97 113.56 114.48 1.06 30.46106 0 8 8 3 0 0 1 0 0 1 20132659200 16384 3639099392 MPIIO 0
Finished: Wed Oct 24 08:48:06 2018
+ set +x

45
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,45 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 17647534080 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Mon Oct 22 23:04:08 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 17647534080 -D 120 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 23:04:08 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 16.44 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180125184.
WARNING: Using actual aggregate bytes moved = 5007572992.
write 39.58 17233920 16.00 0.006125 120.65 0.001161 120.65 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179551744.
WARNING: Using actual aggregate bytes moved = 5154930688.
write 38.04 17233920 16.00 0.001755 129.23 0.000201 129.24 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180108800.
WARNING: Using actual aggregate bytes moved = 5222072320.
write 39.44 17233920 16.00 0.001761 126.27 0.000198 126.28 2
Max Write: 39.58 MiB/sec (41.50 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 39.58 38.04 39.02 0.70 125.38790 0 8 8 3 0 0 1 0 0 1 17647534080 16384 5007572992 MPIIO 0
Finished: Mon Oct 22 23:10:53 2018

128
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:POSIX#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,128 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:POSIX#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 00:54:46 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 00:54:46 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 18.75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 5145702400.
read 81.77 19660800 100.00 0.001214 60.01 0.000247 60.02 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 5171200000.
read 82.17 19660800 100.00 0.000245 60.02 0.000207 60.02 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 5682585600.
read 90.29 19660800 100.00 0.000298 60.02 0.000214 60.02 2
Max Read: 90.29 MiB/sec (94.68 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 90.29 81.77 84.74 3.93 60.01693 0 8 8 3 1 0 1 0 0 1 20132659200 102400 5145702400 POSIX 0
Finished: Wed Oct 24 00:57:46 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000006
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 1
obdidx objid objid group
1 12644623 0xc0f10f 0
3 12492918 0xbea076 0
/esfs/jtacquaviva/ioperf/file_write.00000002
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12384979 0xbcfad3 0
6 12598235 0xc03bdb 0
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 2
obdidx objid objid group
2 12572977 0xbfd931 0
4 12514714 0xbef59a 0
/esfs/jtacquaviva/ioperf/file_write.00000004
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12514715 0xbef59b 0
7 12463337 0xbe2ce9 0
/esfs/jtacquaviva/ioperf/file_write.00000007
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 6
obdidx objid objid group
6 12598234 0xc03bda 0
0 12426639 0xbd9d8f 0
/esfs/jtacquaviva/ioperf/file_write.00000003
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 7
obdidx objid objid group
7 12463336 0xbe2ce8 0
1 12644622 0xc0f10e 0
/esfs/jtacquaviva/ioperf/file_write.00000005
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 3
obdidx objid objid group
3 12492917 0xbea075 0
5 12384978 0xbcfad2 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12384977 0xbcfad1 0
6 12598233 0xc03bd9 0

44
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:POSIX#T:102400#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,44 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:POSIX#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 00:51:19 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 00:51:19 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 18.75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161059020800.
WARNING: Using actual aggregate bytes moved = 72529510400.
write 1090.36 19660800 100.00 0.001503 63.44 0.000231 63.44 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161059635200.
WARNING: Using actual aggregate bytes moved = 59135385600.
write 890.22 19660800 100.00 0.003580 63.34 0.000244 63.35 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161059430400.
WARNING: Using actual aggregate bytes moved = 60045619200.
write 903.90 19660800 100.00 0.004637 63.35 0.000216 63.35 2
Max Write: 1090.36 MiB/sec (1143.32 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 1090.36 890.22 961.49 91.29 63.38006 0 8 8 3 1 0 1 0 0 1 20132659200 102400 72529510400 POSIX 0
Finished: Wed Oct 24 00:54:34 2018

128
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:POSIX#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,128 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 17647534080 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:POSIX#T:1048576.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 21:12:11 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 17647534080 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 21:12:11 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 16.44 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 1129442181120.
WARNING: Using actual aggregate bytes moved = 114182586368.
read 907.34 17233920 1024.00 0.000688 120.01 0.000304 120.01 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 1129442181120.
WARNING: Using actual aggregate bytes moved = 141180272640.
read 1366.67 17233920 1024.00 0.000268 98.52 0.000259 98.52 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 1129442181120.
WARNING: Using actual aggregate bytes moved = 141180272640.
read 4447 17233920 1024.00 0.000357 30.27 0.000273 30.27 2
Max Read: 4447.43 MiB/sec (4663.47 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 4447.43 907.34 2240.48 1571.77 82.93445 0 8 8 3 1 0 1 0 0 1 17647534080 1048576 114182586368 POSIX 0
Finished: Mon Oct 22 21:16:19 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000006
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 7
obdidx objid objid group
7 12456942 0xbe13ee 0
1 12638217 0xc0d809 0
/esfs/jtacquaviva/ioperf/file_write.00000002
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 0
obdidx objid objid group
0 12420234 0xbd848a 0
2 12566586 0xbfc03a 0
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12378585 0xbce1d9 0
6 12591846 0xc022e6 0
/esfs/jtacquaviva/ioperf/file_write.00000004
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 2
obdidx objid objid group
2 12566587 0xbfc03b 0
4 12508304 0xbedc90 0
/esfs/jtacquaviva/ioperf/file_write.00000007
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 6
obdidx objid objid group
6 12591847 0xc022e7 0
0 12420235 0xbd848b 0
/esfs/jtacquaviva/ioperf/file_write.00000003
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 7
obdidx objid objid group
7 12456944 0xbe13f0 0
1 12638219 0xc0d80b 0
/esfs/jtacquaviva/ioperf/file_write.00000005
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 1
obdidx objid objid group
1 12638218 0xc0d80a 0
3 12486528 0xbe8780 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12508303 0xbedc8f 0
7 12456943 0xbe13ef 0

35
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:POSIX#T:1048576#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,35 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 17647534080 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:POSIX#T:1048576.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 21:10:10 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 17647534080 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 21:10:10 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 16.44 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
write 3995 17233920 1024.00 0.001577 33.70 0.000219 33.70 0
write 3867 17233920 1024.00 0.002179 34.81 0.000257 34.81 1
write 3899 17233920 1024.00 0.001851 34.52 0.000215 34.53 2
Max Write: 3995.24 MiB/sec (4189.31 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 3995.24 3867.42 3920.66 54.32 34.34767 0 8 8 3 1 0 1 0 0 1 17647534080 1048576 141180272640 POSIX 0
Finished: Mon Oct 22 21:11:58 2018

128
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:POSIX#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,128 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 17647534080 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:POSIX#T:10485760.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 18:12:37 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 17647534080 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 18:12:37 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 16.44 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 1129442181120.
WARNING: Using actual aggregate bytes moved = 122714849280.
read 974.47 17233920 10240 0.000374 120.09 0.000285 120.10 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 1129442181120.
WARNING: Using actual aggregate bytes moved = 141180272640.
read 3081.20 17233920 10240 0.000268 43.70 0.000238 43.70 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 1129442181120.
WARNING: Using actual aggregate bytes moved = 141180272640.
read 4532 17233920 10240 0.000245 29.71 0.000257 29.71 2
Max Read: 4532.05 MiB/sec (4752.20 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 4532.05 974.47 2862.58 1460.58 64.50042 0 8 8 3 1 0 1 0 0 1 17647534080 10485760 122714849280 POSIX 0
Finished: Mon Oct 22 18:15:50 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000006
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 6
obdidx objid objid group
6 12591735 0xc02277 0
0 12420120 0xbd8418 0
/esfs/jtacquaviva/ioperf/file_write.00000002
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12378474 0xbce16a 0
6 12591736 0xc02278 0
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 1
obdidx objid objid group
1 12638108 0xc0d79c 0
3 12486420 0xbe8714 0
/esfs/jtacquaviva/ioperf/file_write.00000004
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 2
obdidx objid objid group
2 12566475 0xbfbfcb 0
4 12508192 0xbedc20 0
/esfs/jtacquaviva/ioperf/file_write.00000007
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 0
obdidx objid objid group
0 12420121 0xbd8419 0
2 12566476 0xbfbfcc 0
/esfs/jtacquaviva/ioperf/file_write.00000003
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 3
obdidx objid objid group
3 12486421 0xbe8715 0
5 12378475 0xbce16b 0
/esfs/jtacquaviva/ioperf/file_write.00000005
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 6
obdidx objid objid group
6 12591737 0xc02279 0
0 12420122 0xbd841a 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12508193 0xbedc21 0
7 12456835 0xbe1383 0

35
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:POSIX#T:10485760#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,35 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 17647534080 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:POSIX#T:10485760.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 18:11:04 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 17647534080 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 18:11:04 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 16.44 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
write 5134 17233920 10240 0.002389 26.22 0.000231 26.23 0
write 5461 17233920 10240 0.001829 24.65 0.000202 24.66 1
write 5548 17233920 10240 0.001759 24.27 0.000242 24.27 2
Max Write: 5547.69 MiB/sec (5817.18 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 5547.69 5133.69 5380.68 178.23 25.05087 0 8 8 3 1 0 1 0 0 1 17647534080 10485760 141180272640 POSIX 0
Finished: Mon Oct 22 18:12:24 2018

128
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:POSIX#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:read#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,128 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 17647534080 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:POSIX#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 22:58:06 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 17647534080 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 22:58:06 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 16.44 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 1129442181120.
WARNING: Using actual aggregate bytes moved = 3643408384.
read 28.94 17233920 16.00 0.000359 120.07 0.000223 120.07 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 1129442181120.
WARNING: Using actual aggregate bytes moved = 3886481408.
read 30.87 17233920 16.00 0.000286 120.05 0.000238 120.06 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 1129442181120.
WARNING: Using actual aggregate bytes moved = 4003840000.
read 31.81 17233920 16.00 0.000252 120.05 0.000242 120.05 2
Max Read: 31.81 MiB/sec (33.35 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 31.81 28.94 30.54 1.19 120.06106 0 8 8 3 1 0 1 0 0 1 17647534080 16384 3643408384 POSIX 0
Finished: Mon Oct 22 23:04:06 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000006
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 7
obdidx objid objid group
7 12456966 0xbe1406 0
1 12638238 0xc0d81e 0
/esfs/jtacquaviva/ioperf/file_write.00000002
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 0
obdidx objid objid group
0 12420254 0xbd849e 0
2 12566608 0xbfc050 0
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 0
obdidx objid objid group
0 12420256 0xbd84a0 0
2 12566610 0xbfc052 0
/esfs/jtacquaviva/ioperf/file_write.00000004
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 3
obdidx objid objid group
3 12486552 0xbe8798 0
5 12378606 0xbce1ee 0
/esfs/jtacquaviva/ioperf/file_write.00000007
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 2
obdidx objid objid group
2 12566609 0xbfc051 0
4 12508324 0xbedca4 0
/esfs/jtacquaviva/ioperf/file_write.00000003
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 1
obdidx objid objid group
1 12638239 0xc0d81f 0
3 12486553 0xbe8799 0
/esfs/jtacquaviva/ioperf/file_write.00000005
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 6
obdidx objid objid group
6 12591869 0xc022fd 0
0 12420255 0xbd849f 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12378607 0xbce1ef 0
6 12591870 0xc022fe 0

44
benchmark/merged_output/COUNT:1#NN:1#PPN:8#API:POSIX#T:16384#APP:ior-default#FS:lustre#IOTYPE:random#ACCESSTYPE:write#STRIPING:yes.txt Normal file
View File

@ -0,0 +1,44 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 17647534080 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:POSIX#T:16384.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Mon Oct 22 22:51:16 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 17647534080 -D 120 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Mon Oct 22 22:51:16 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 16.44 GiB
aggregate filesize = 131.48 GiB
Using stonewalling = 120 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141178634240.
WARNING: Using actual aggregate bytes moved = 32019611648.
write 234.47 17233920 16.00 0.001957 130.23 0.000285 130.23 0
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141179027456.
WARNING: Using actual aggregate bytes moved = 31119147008.
write 229.00 17233920 16.00 0.018787 129.58 0.000220 129.60 1
WARNING: Expected aggregate file size = 141180272640.
WARNING: Stat() of aggregate file size = 141180272640.
WARNING: Using actual aggregate bytes moved = 31432753152.
write 226.90 17233920 16.00 0.001744 132.11 0.000247 132.11 2
Max Write: 234.47 MiB/sec (245.86 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 234.47 226.90 230.12 3.19 130.64780 0 8 8 3 1 0 1 0 0 1 17647534080 16384 32019611648 POSIX 0
Finished: Mon Oct 22 22:57:53 2018

Some files were not shown because too many files have changed in this diff Show More