julian.kunkel
/
ddn-ime-evaluation
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Striping benchmark (read only)

This commit is contained in:
Eugen Betke 2018-10-24 11:10:10 +02:00
parent a351cab075
commit 11c822a62a
98 changed files with 4508 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

46
output_v2/COUNT:1#NN:1#PPN:1#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:1#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:41:46 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:41:46 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 150 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 1463603200.
read 46.38 157286400 100.00 0.001650 30.09 0.000175 30.10 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 1441689600.
read 45.68 157286400 100.00 0.000482 30.10 0.000180 30.10 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 1480089600.
read 46.89 157286400 100.00 0.000491 30.10 0.000157 30.11 2
Max Read: 46.89 MiB/sec (49.16 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 46.89 45.68 46.31 0.50 30.10094 0 1 1 3 0 0 1 0 0 1 161061273600 102400 1463603200 MPIIO 0
Finished: Wed Oct 24 08:43:17 2018
+ set +x

46
output_v2/COUNT:1#NN:1#PPN:1#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:1#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:33:30 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:33:30 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 150 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 6948913152.
read 220.73 157286400 1024.00 0.000976 30.02 0.000203 30.02 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 7444889600.
read 236.48 157286400 1024.00 0.000519 30.02 0.000163 30.02 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 7632584704.
read 242.46 157286400 1024.00 0.000487 30.02 0.000147 30.02 2
Max Read: 242.46 MiB/sec (254.24 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 242.46 220.73 233.23 9.17 30.02252 0 1 1 3 0 0 1 0 0 1 161061273600 1048576 6948913152 MPIIO 0
Finished: Wed Oct 24 08:35:00 2018
+ set +x

46
output_v2/COUNT:1#NN:1#PPN:1#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:1#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:25:13 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:25:13 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 150 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 8724152320.
read 276.64 157286400 10240 0.001482 30.07 0.000286 30.07 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 9353297920.
read 296.58 157286400 10240 0.000463 30.08 0.000158 30.08 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 10276044800.
read 325.63 157286400 10240 0.000476 30.10 0.000165 30.10 2
Max Read: 325.63 MiB/sec (341.45 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 325.63 276.64 299.62 20.11 30.08238 0 1 1 3 0 0 1 0 0 1 161061273600 10485760 8724152320 MPIIO 0
Finished: Wed Oct 24 08:26:43 2018
+ set +x

46
output_v2/COUNT:1#NN:1#PPN:1#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:1#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:49:48 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:49:48 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 150 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 312459264.
read 9.65 157286400 16.00 0.005558 30.86 0.000170 30.87 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 293568512.
read 9.07 157286400 16.00 0.000488 30.86 0.000182 30.86 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 297844736.
read 9.21 157286400 16.00 0.000475 30.85 0.000148 30.86 2
Max Read: 9.65 MiB/sec (10.12 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 9.65 9.07 9.31 0.25 30.86067 0 1 1 3 0 0 1 0 0 1 161061273600 16384 312459264 MPIIO 0
Finished: Wed Oct 24 08:51:21 2018
+ set +x

46
output_v2/COUNT:1#NN:1#PPN:2#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:2#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:44:59 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:44:59 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 3387494400.
read 107.30 78643200 100.00 0.004619 30.10 0.000188 30.11 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 3434393600.
read 108.83 78643200 100.00 0.000592 30.09 0.000207 30.09 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 3450777600.
read 109.34 78643200 100.00 0.000579 30.10 0.000173 30.10 2
Max Read: 109.34 MiB/sec (114.66 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 109.34 107.30 108.49 0.87 30.09988 0 2 2 3 0 0 1 0 0 1 80530636800 102400 3387494400 MPIIO 0
Finished: Wed Oct 24 08:46:30 2018
+ set +x

46
output_v2/COUNT:1#NN:1#PPN:2#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:2#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:36:47 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:36:47 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 19476250624.
read 618.84 78643200 1024.00 0.001592 30.01 0.000258 30.01 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 20935868416.
read 665.22 78643200 1024.00 0.000605 30.01 0.000198 30.01 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 20709376000.
read 657.90 78643200 1024.00 0.000543 30.02 0.000200 30.02 2
Max Read: 665.22 MiB/sec (697.53 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 665.22 618.84 647.32 20.36 30.01609 0 2 2 3 0 0 1 0 0 1 80530636800 1048576 19476250624 MPIIO 0
Finished: Wed Oct 24 08:38:17 2018
+ set +x

46
output_v2/COUNT:1#NN:1#PPN:2#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:2#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:28:30 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:28:30 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 26560430080.
read 843.37 78643200 10240 0.001179 30.03 0.000241 30.03 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 25773998080.
read 818.39 78643200 10240 0.000627 30.03 0.000208 30.03 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 26287800320.
read 834.31 78643200 10240 0.000554 30.05 0.000189 30.05 2
Max Read: 843.37 MiB/sec (884.34 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 843.37 818.39 832.02 10.32 30.03927 0 2 2 3 0 0 1 0 0 1 80530636800 10485760 26560430080 MPIIO 0
Finished: Wed Oct 24 08:30:00 2018
+ set +x

46
output_v2/COUNT:1#NN:1#PPN:2#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:2#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:52:59 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:52:59 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 704462848.
read 21.91 78643200 16.00 0.001598 30.66 0.000192 30.66 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 713703424.
read 22.20 78643200 16.00 0.000567 30.66 0.000227 30.66 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 723910656.
read 22.51 78643200 16.00 0.000594 30.67 0.000168 30.67 2
Max Read: 22.51 MiB/sec (23.61 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 22.51 21.91 22.21 0.25 30.66487 0 2 2 3 0 0 1 0 0 1 80530636800 16384 704462848 MPIIO 0
Finished: Wed Oct 24 08:54:31 2018
+ set +x

46
output_v2/COUNT:1#NN:1#PPN:4#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:4#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:40:08 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:40:08 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 37.50 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 7606886400.
read 241.07 39321600 100.00 0.004575 30.09 0.000247 30.09 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 7775129600.
read 246.40 39321600 100.00 0.000749 30.09 0.000171 30.09 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 7871488000.
read 249.45 39321600 100.00 0.000711 30.09 0.000173 30.09 2
Max Read: 249.45 MiB/sec (261.56 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 249.45 241.07 245.64 3.46 30.09313 0 4 4 3 0 0 1 0 0 1 40265318400 102400 7606886400 MPIIO 0
Finished: Wed Oct 24 08:41:39 2018
+ set +x

46
output_v2/COUNT:1#NN:1#PPN:4#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:4#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:31:53 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:31:53 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 37.50 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 33224130560.
read 1055.42 39321600 1024.00 0.001879 30.02 0.000229 30.02 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 34140585984.
read 1084.16 39321600 1024.00 0.000761 30.03 0.000175 30.03 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 34597765120.
read 1099.35 39321600 1024.00 0.000776 30.01 0.000192 30.01 2
Max Read: 1099.35 MiB/sec (1152.75 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1099.35 1055.42 1079.64 18.22 30.02200 0 4 4 3 0 0 1 0 0 1 40265318400 1048576 33224130560 MPIIO 0
Finished: Wed Oct 24 08:33:23 2018
+ set +x

46
output_v2/COUNT:1#NN:1#PPN:4#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:4#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:23:34 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:23:34 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 37.50 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 25406996480.
read 805.30 39321600 10240 0.002072 30.09 0.000240 30.09 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 29685186560.
read 939.46 39321600 10240 0.000735 30.13 0.000230 30.13 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 34005319680.
read 1077.09 39321600 10240 0.000682 30.11 0.000232 30.11 2
Max Read: 1077.09 MiB/sec (1129.41 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1077.09 805.30 940.62 110.96 30.11042 0 4 4 3 0 0 1 0 0 1 40265318400 10485760 25406996480 MPIIO 0
Finished: Wed Oct 24 08:25:04 2018
+ set +x

46
output_v2/COUNT:1#NN:1#PPN:4#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:4#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:48:13 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:48:13 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 37.50 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 1815003136.
read 56.69 39321600 16.00 0.006031 30.53 0.000245 30.53 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 1801043968.
read 56.26 39321600 16.00 0.000764 30.53 0.000156 30.53 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 1690976256.
read 52.83 39321600 16.00 0.000727 30.53 0.000182 30.53 2
Max Read: 56.69 MiB/sec (59.44 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 56.69 52.83 55.26 1.73 30.52981 0 4 4 3 0 0 1 0 0 1 40265318400 16384 1815003136 MPIIO 0
Finished: Wed Oct 24 08:49:45 2018
+ set +x

46
output_v2/COUNT:1#NN:1#PPN:6#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:6#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:43:21 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:43:21 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 25 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 12445081600.
read 394.53 26214400 100.00 0.002136 30.08 0.000237 30.08 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 12079718400.
read 383.00 26214400 100.00 0.000896 30.08 0.000180 30.08 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 12653977600.
read 401.22 26214400 100.00 0.000907 30.08 0.000157 30.08 2
Max Read: 401.22 MiB/sec (420.71 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 401.22 383.00 392.92 7.53 30.07955 0 6 6 3 0 0 1 0 0 1 26843545600 102400 12445081600 MPIIO 0
Finished: Wed Oct 24 08:44:51 2018
+ set +x

46
output_v2/COUNT:1#NN:1#PPN:6#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:6#API:MPIIO#T:1048576#TYPE:read.txt
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:35:07 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:35:07 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 25 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 52439285760.
read 1665.64 26214400 1024.00 0.002850 30.02 0.000248 30.02 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 54208233472.
read 1721.35 26214400 1024.00 0.000961 30.03 0.000186 30.03 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 55190749184.
read 1753.45 26214400 1024.00 0.000755 30.02 0.000191 30.02 2
Max Read: 1753.45 MiB/sec (1838.62 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1753.45 1665.64 1713.48 36.28 30.02496 0 6 6 3 0 0 1 0 0 1 26843545600 1048576 52439285760 MPIIO 0
Finished: Wed Oct 24 08:36:38 2018
+ set +x

46
output_v2/COUNT:1#NN:1#PPN:6#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:6#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:26:51 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:26:51 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 25 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 58521026560.
read 1854.90 26214400 10240 0.006318 30.08 0.000228 30.09 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 65777172480.
read 2081.15 26214400 10240 0.000871 30.14 0.000197 30.14 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 67612180480.
read 2144.13 26214400 10240 0.000911 30.07 0.000197 30.07 2
Max Read: 2144.13 MiB/sec (2248.28 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 2144.13 1854.90 2026.73 124.19 30.10087 0 6 6 3 0 0 1 0 0 1 26843545600 10485760 58521026560 MPIIO 0
Finished: Wed Oct 24 08:28:21 2018
+ set +x

46
output_v2/COUNT:1#NN:1#PPN:6#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:6#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:51:24 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:51:24 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 25 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 2514714624.
read 78.63 26214400 16.00 0.002352 30.50 0.000221 30.50 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 2557575168.
read 79.96 26214400 16.00 0.000893 30.50 0.000179 30.50 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 2575958016.
read 80.55 26214400 16.00 0.000921 30.50 0.000164 30.50 2
Max Read: 80.55 MiB/sec (84.47 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 80.55 78.63 79.72 0.80 30.49964 0 6 6 3 0 0 1 0 0 1 26843545600 16384 2514714624 MPIIO 0
Finished: Wed Oct 24 08:52:55 2018
+ set +x

46
output_v2/COUNT:1#NN:1#PPN:8#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:8#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:38:27 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:38:27 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 18.75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 16035737600.
read 508.39 19660800 100.00 0.002243 30.08 0.000280 30.08 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 15484518400.
read 490.96 19660800 100.00 0.001064 30.08 0.000186 30.08 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 15903232000.
read 504.19 19660800 100.00 0.001041 30.08 0.000175 30.08 2
Max Read: 508.39 MiB/sec (533.09 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 508.39 490.96 501.18 7.43 30.07996 0 8 8 3 0 0 1 0 0 1 20132659200 102400 16035737600 MPIIO 0
Finished: Wed Oct 24 08:39:57 2018
+ set +x

46
output_v2/COUNT:1#NN:1#PPN:8#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:8#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:30:11 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:30:11 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 18.75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 62083039232.
read 1971.30 19660800 1024.00 0.002403 30.03 0.000215 30.03 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 58500055040.
read 1858.12 19660800 1024.00 0.001101 30.02 0.000305 30.02 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 56201576448.
read 1778.27 19660800 1024.00 0.001074 30.14 0.000205 30.14 2
Max Read: 1971.30 MiB/sec (2067.05 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1971.30 1778.27 1869.23 79.19 30.06669 0 8 8 3 0 0 1 0 0 1 20132659200 1048576 62083039232 MPIIO 0
Finished: Wed Oct 24 08:31:41 2018
+ set +x

46
output_v2/COUNT:1#NN:1#PPN:8#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:8#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:21:52 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:21:52 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 18.75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 27367833600.
read 865.72 19660800 10240 0.002712 30.15 0.000249 30.15 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 32264683520.
read 1022.33 19660800 10240 0.001086 30.10 0.000268 30.10 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 38199623680.
read 1209.66 19660800 10240 0.001084 30.11 0.000204 30.12 2
Max Read: 1209.66 MiB/sec (1268.42 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1209.66 865.72 1032.57 140.60 30.12076 0 8 8 3 0 0 1 0 0 1 20132659200 10485760 27367833600 MPIIO 0
Finished: Wed Oct 24 08:23:23 2018
+ set +x

46
output_v2/COUNT:1#NN:1#PPN:8#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
+ tee -a ./output_v2/COUNT:1#NN:1#PPN:8#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:46:35 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:46:35 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread1/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 18.75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 3639099392.
read 113.93 19660800 16.00 0.002673 30.46 0.002983 30.46 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 3703963648.
read 115.97 19660800 16.00 0.001092 30.46 0.000232 30.46 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 3627073536.
read 113.56 19660800 16.00 0.001068 30.46 0.000199 30.46 2
Max Read: 115.97 MiB/sec (121.60 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 115.97 113.56 114.48 1.06 30.46106 0 8 8 3 0 0 1 0 0 1 20132659200 16384 3639099392 MPIIO 0
Finished: Wed Oct 24 08:48:06 2018
+ set +x

46
output_v2/COUNT:1#NN:16#PPN:1#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 16 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12,isc17-c13,isc17-c14,isc17-c15,isc17-c18,isc17-c22,isc17-c01,isc17-c02,isc17-c03 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
+ tee -a ./output_v2/COUNT:1#NN:16#PPN:1#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:57:54 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:57:54 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread16/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 16 (1 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 150 GiB
aggregate filesize = 2400 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 6318694400.
read 192.03 157286400 100.00 0.013787 31.37 0.000757 31.38 0
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 6317568000.
read 192.12 157286400 100.00 0.001160 31.36 0.000690 31.36 1
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 6335692800.
read 192.66 157286400 100.00 0.001125 31.36 0.000696 31.36 2
Max Read: 192.66 MiB/sec (202.02 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 192.66 192.03 192.27 0.28 31.36741 0 16 1 3 0 0 1 0 0 1 161061273600 102400 6318694400 MPIIO 0
Finished: Wed Oct 24 10:59:28 2018
+ set +x

46
output_v2/COUNT:1#NN:16#PPN:1#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 16 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12,isc17-c13,isc17-c14,isc17-c15,isc17-c18,isc17-c22,isc17-c01,isc17-c02,isc17-c03 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
+ tee -a ./output_v2/COUNT:1#NN:16#PPN:1#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:49:21 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:49:21 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread16/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 16 (1 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 150 GiB
aggregate filesize = 2400 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 41849716736.
read 1323.36 157286400 1024.00 0.013149 30.15 0.002285 30.16 0
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 41687187456.
read 1317.99 157286400 1024.00 0.004196 30.16 0.002193 30.16 1
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 41407217664.
read 1310.06 157286400 1024.00 0.002553 30.14 0.002140 30.14 2
Max Read: 1323.36 MiB/sec (1387.65 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1323.36 1310.06 1317.14 5.47 30.15525 0 16 1 3 0 0 1 0 0 1 161061273600 1048576 41849716736 MPIIO 0
Finished: Wed Oct 24 10:50:51 2018
+ set +x

46
output_v2/COUNT:1#NN:16#PPN:1#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 16 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12,isc17-c13,isc17-c14,isc17-c15,isc17-c18,isc17-c22,isc17-c01,isc17-c02,isc17-c03 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
+ tee -a ./output_v2/COUNT:1#NN:16#PPN:1#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:40:36 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:40:36 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread16/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 16 (1 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 150 GiB
aggregate filesize = 2400 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 46871347200.
read 1481.94 157286400 10240 0.016358 30.15 0.008740 30.16 0
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 46923776000.
read 1483.66 157286400 10240 0.006818 30.16 0.006038 30.16 1
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 46703575040.
read 1469.05 157286400 10240 0.006450 30.32 0.006004 30.32 2
Max Read: 1483.66 MiB/sec (1555.73 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1483.66 1469.05 1478.22 6.52 30.21463 0 16 1 3 0 0 1 0 0 1 161061273600 10485760 46871347200 MPIIO 0
Finished: Wed Oct 24 10:42:07 2018
+ set +x

46
output_v2/COUNT:1#NN:16#PPN:1#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 16 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12,isc17-c13,isc17-c14,isc17-c15,isc17-c18,isc17-c22,isc17-c01,isc17-c02,isc17-c03 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
+ tee -a ./output_v2/COUNT:1#NN:16#PPN:1#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 11:06:52 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 11:06:52 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread16/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 16 (1 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 150 GiB
aggregate filesize = 2400 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 1232732160.
read 30.32 157286400 16.00 0.021774 38.76 0.009758 38.78 0
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 1235877888.
read 30.41 157286400 16.00 0.006330 38.76 0.005658 38.76 1
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 1232617472.
read 30.33 157286400 16.00 0.006114 38.76 0.005708 38.76 2
Max Read: 30.41 MiB/sec (31.89 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 30.41 30.32 30.35 0.04 38.76440 0 16 1 3 0 0 1 0 0 1 161061273600 16384 1232732160 MPIIO 0
Finished: Wed Oct 24 11:08:48 2018
+ set +x

46
output_v2/COUNT:1#NN:16#PPN:2#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 32 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12,isc17-c13,isc17-c14,isc17-c15,isc17-c18,isc17-c22,isc17-c01,isc17-c02,isc17-c03 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
+ tee -a ./output_v2/COUNT:1#NN:16#PPN:2#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 11:01:14 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 11:01:14 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread16/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 32 (2 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 75 GiB
aggregate filesize = 2400 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 12837068800.
read 389.92 78643200 100.00 0.025030 31.37 0.004789 31.40 0
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 12863488000.
read 391.26 78643200 100.00 0.005519 31.35 0.004795 31.35 1
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 12883763200.
read 391.96 78643200 100.00 0.005816 31.34 0.004740 31.35 2
Max Read: 391.96 MiB/sec (411.00 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 391.96 389.92 391.05 0.85 31.36608 0 32 2 3 0 0 1 0 0 1 80530636800 102400 12837068800 MPIIO 0
Finished: Wed Oct 24 11:02:48 2018
+ set +x

46
output_v2/COUNT:1#NN:16#PPN:2#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 32 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12,isc17-c13,isc17-c14,isc17-c15,isc17-c18,isc17-c22,isc17-c01,isc17-c02,isc17-c03 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
+ tee -a ./output_v2/COUNT:1#NN:16#PPN:2#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:52:49 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:52:49 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread16/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 32 (2 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 75 GiB
aggregate filesize = 2400 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 80519102464.
read 2546.72 78643200 1024.00 0.010515 30.14 0.000936 30.15 0
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 80268492800.
read 2538.86 78643200 1024.00 0.001529 30.15 0.000931 30.15 1
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 80049340416.
read 2531.95 78643200 1024.00 0.001903 30.15 0.000892 30.15 2
Max Read: 2546.72 MiB/sec (2670.42 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 2546.72 2531.95 2539.18 6.03 30.15150 0 32 2 3 0 0 1 0 0 1 80530636800 1048576 80519102464 MPIIO 0
Finished: Wed Oct 24 10:54:19 2018
+ set +x

46
output_v2/COUNT:1#NN:16#PPN:2#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 32 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12,isc17-c13,isc17-c14,isc17-c15,isc17-c18,isc17-c22,isc17-c01,isc17-c02,isc17-c03 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
+ tee -a ./output_v2/COUNT:1#NN:16#PPN:2#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:44:04 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:44:04 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread16/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 32 (2 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 75 GiB
aggregate filesize = 2400 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 89569361920.
read 2829.56 78643200 10240 0.014503 30.18 0.005045 30.19 0
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 89716162560.
read 2834.92 78643200 10240 0.005623 30.17 0.004831 30.18 1
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 90827653120.
read 2859.44 78643200 10240 0.005661 30.29 0.004782 30.29 2
Max Read: 2859.44 MiB/sec (2998.34 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 2859.44 2829.56 2841.31 13.01 30.22061 0 32 2 3 0 0 1 0 0 1 80530636800 10485760 89569361920 MPIIO 0
Finished: Wed Oct 24 10:45:35 2018
+ set +x

46
output_v2/COUNT:1#NN:16#PPN:4#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 64 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12,isc17-c13,isc17-c14,isc17-c15,isc17-c18,isc17-c22,isc17-c01,isc17-c02,isc17-c03 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
+ tee -a ./output_v2/COUNT:1#NN:16#PPN:4#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:56:16 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:56:16 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread16/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 64 (4 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 37.50 GiB
aggregate filesize = 2400 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 24792780800.
read 754.15 39321600 100.00 0.017684 31.34 0.005502 31.35 0
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 24816742400.
read 755.00 39321600 100.00 0.006999 31.34 0.005383 31.35 1
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 24818073600.
read 755.22 39321600 100.00 0.007435 31.34 0.005391 31.34 2
Max Read: 755.22 MiB/sec (791.91 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 755.22 754.15 754.79 0.46 31.34630 0 64 4 3 0 0 1 0 0 1 40265318400 102400 24792780800 MPIIO 0
Finished: Wed Oct 24 10:57:50 2018
+ set +x

46
output_v2/COUNT:1#NN:16#PPN:4#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 64 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12,isc17-c13,isc17-c14,isc17-c15,isc17-c18,isc17-c22,isc17-c01,isc17-c02,isc17-c03 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
+ tee -a ./output_v2/COUNT:1#NN:16#PPN:4#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:47:37 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:47:37 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread16/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 64 (4 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 37.50 GiB
aggregate filesize = 2400 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 136541372416.
read 4309 39321600 1024.00 0.022358 30.20 0.007330 30.22 0
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 136475312128.
read 4306 39321600 1024.00 0.008615 30.23 0.007308 30.23 1
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 137487187968.
read 4342 39321600 1024.00 0.009318 30.19 0.007298 30.20 2
Max Read: 4342.10 MiB/sec (4553.02 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 4342.10 4305.75 4319.05 16.36 30.21404 0 64 4 3 0 0 1 0 0 1 40265318400 1048576 136541372416 MPIIO 0
Finished: Wed Oct 24 10:49:08 2018
+ set +x

46
output_v2/COUNT:1#NN:16#PPN:4#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 64 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12,isc17-c13,isc17-c14,isc17-c15,isc17-c18,isc17-c22,isc17-c01,isc17-c02,isc17-c03 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
+ tee -a ./output_v2/COUNT:1#NN:16#PPN:4#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:38:53 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:38:53 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread16/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 64 (4 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 37.50 GiB
aggregate filesize = 2400 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 149684224000.
read 4724 39321600 10240 0.017620 30.21 0.005101 30.22 0
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 150145597440.
read 4728 39321600 10240 0.006350 30.28 0.005072 30.28 1
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 151466803200.
read 4789 39321600 10240 0.007150 30.16 0.005005 30.16 2
Max Read: 4789.23 MiB/sec (5021.88 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 4789.23 4723.63 4747.09 29.86 30.22157 0 64 4 3 0 0 1 0 0 1 40265318400 10485760 149684224000 MPIIO 0
Finished: Wed Oct 24 10:40:23 2018
+ set +x

46
output_v2/COUNT:1#NN:16#PPN:4#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 64 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12,isc17-c13,isc17-c14,isc17-c15,isc17-c18,isc17-c22,isc17-c01,isc17-c02,isc17-c03 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
+ tee -a ./output_v2/COUNT:1#NN:16#PPN:4#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 11:04:54 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 11:04:54 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread16/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 64 (4 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 37.50 GiB
aggregate filesize = 2400 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 4986011648.
read 124.12 39321600 16.00 0.016409 38.30 0.007266 38.31 0
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 4989829120.
read 124.26 39321600 16.00 0.008272 38.29 0.007056 38.30 1
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 4981325824.
read 124.05 39321600 16.00 0.009229 38.29 0.007061 38.30 2
Max Read: 124.26 MiB/sec (130.30 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 124.26 124.05 124.14 0.09 38.30089 0 64 4 3 0 0 1 0 0 1 40265318400 16384 4986011648 MPIIO 0
Finished: Wed Oct 24 11:06:49 2018
+ set +x

46
output_v2/COUNT:1#NN:16#PPN:6#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 96 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12,isc17-c13,isc17-c14,isc17-c15,isc17-c18,isc17-c22,isc17-c01,isc17-c02,isc17-c03 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
+ tee -a ./output_v2/COUNT:1#NN:16#PPN:6#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:59:36 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:59:36 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread16/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 96 (6 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 25 GiB
aggregate filesize = 2400 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 35509145600.
read 1069.00 26214400 100.00 0.349301 31.33 0.001172 31.68 0
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 35492556800.
read 1080.03 26214400 100.00 0.003220 31.34 0.001232 31.34 1
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 35425382400.
read 1078.08 26214400 100.00 0.004028 31.33 0.001231 31.34 2
Max Read: 1080.03 MiB/sec (1132.49 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1080.03 1069.00 1075.70 4.81 31.45199 0 96 6 3 0 0 1 0 0 1 26843545600 102400 35509145600 MPIIO 0
Finished: Wed Oct 24 11:01:10 2018
+ set +x

46
output_v2/COUNT:1#NN:16#PPN:6#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 96 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12,isc17-c13,isc17-c14,isc17-c15,isc17-c18,isc17-c22,isc17-c01,isc17-c02,isc17-c03 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
+ tee -a ./output_v2/COUNT:1#NN:16#PPN:6#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:51:06 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:51:06 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread16/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 96 (6 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 25 GiB
aggregate filesize = 2400 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 191937642496.
read 5999 26214400 1024.00 0.356762 30.17 0.012815 30.52 0
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 193187545088.
read 6106 26214400 1024.00 0.016179 30.16 0.012551 30.17 1
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 192852000768.
read 6091 26214400 1024.00 0.015134 30.19 0.012823 30.20 2
Max Read: 6106.30 MiB/sec (6402.92 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 6106.30 5998.54 6065.22 47.57 30.29426 0 96 6 3 0 0 1 0 0 1 26843545600 1048576 191937642496 MPIIO 0
Finished: Wed Oct 24 10:52:36 2018
+ set +x

46
output_v2/COUNT:1#NN:16#PPN:6#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 96 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12,isc17-c13,isc17-c14,isc17-c15,isc17-c18,isc17-c22,isc17-c01,isc17-c02,isc17-c03 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
+ tee -a ./output_v2/COUNT:1#NN:16#PPN:6#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:42:19 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:42:19 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread16/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 96 (6 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 25 GiB
aggregate filesize = 2400 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 204755435520.
read 6399 26214400 10240 0.339259 30.18 0.000963 30.52 0
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 206433157120.
read 6520 26214400 10240 0.003345 30.19 0.001008 30.19 1
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 207838248960.
read 6568 26214400 10240 0.003837 30.17 0.001033 30.18 2
Max Read: 6567.83 MiB/sec (6886.87 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 6567.83 6398.69 6495.54 71.20 30.29680 0 96 6 3 0 0 1 0 0 1 26843545600 10485760 204755435520 MPIIO 0
Finished: Wed Oct 24 10:43:50 2018
+ set +x

46
output_v2/COUNT:1#NN:16#PPN:8#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 128 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12,isc17-c13,isc17-c14,isc17-c15,isc17-c18,isc17-c22,isc17-c01,isc17-c02,isc17-c03 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
+ tee -a ./output_v2/COUNT:1#NN:16#PPN:8#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:54:29 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:54:29 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread16/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 128 (8 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 18.75 GiB
aggregate filesize = 2400 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 44640665600.
read 1335.60 19660800 100.00 0.502604 31.38 0.008556 31.88 0
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 44677529600.
read 1359.00 19660800 100.00 0.011048 31.35 0.007899 31.35 1
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 44529561600.
read 1354.94 19660800 100.00 0.011456 31.34 0.008016 31.34 2
Max Read: 1359.00 MiB/sec (1425.01 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1359.00 1335.60 1349.84 10.21 31.52332 0 128 8 3 0 0 1 0 0 1 20132659200 102400 44640665600 MPIIO 0
Finished: Wed Oct 24 10:56:03 2018
+ set +x

46
output_v2/COUNT:1#NN:16#PPN:8#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 128 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12,isc17-c13,isc17-c14,isc17-c15,isc17-c18,isc17-c22,isc17-c01,isc17-c02,isc17-c03 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
+ tee -a ./output_v2/COUNT:1#NN:16#PPN:8#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:45:46 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:45:46 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread16/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 128 (8 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 18.75 GiB
aggregate filesize = 2400 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 213719711744.
read 6639 19660800 1024.00 0.501391 30.20 0.000836 30.70 0
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 216062230528.
read 6823 19660800 1024.00 0.003893 30.20 0.001191 30.20 1
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 218766508032.
read 6911 19660800 1024.00 0.004452 30.18 0.001408 30.19 2
Max Read: 6911.29 MiB/sec (7247.01 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 6911.29 6639.35 6791.08 113.24 30.36242 0 128 8 3 0 0 1 0 0 1 20132659200 1048576 213719711744 MPIIO 0
Finished: Wed Oct 24 10:47:17 2018
+ set +x

46
output_v2/COUNT:1#NN:16#PPN:8#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ tee -a ./output_v2/COUNT:1#NN:16#PPN:8#API:MPIIO#T:10485760#TYPE:read.txt
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 128 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12,isc17-c13,isc17-c14,isc17-c15,isc17-c18,isc17-c22,isc17-c01,isc17-c02,isc17-c03 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:37:00 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:37:00 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread16/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 128 (8 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 18.75 GiB
aggregate filesize = 2400 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 232259584000.
read 7215 19660800 10240 0.501931 30.20 0.000943 30.70 0
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 241046650880.
read 7610 19660800 10240 0.003793 30.20 0.000909 30.21 1
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 242483200000.
read 7651 19660800 10240 0.004120 30.22 0.001248 30.23 2
Max Read: 7650.62 MiB/sec (8022.26 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 7650.62 7214.60 7491.69 196.64 30.37872 0 128 8 3 0 0 1 0 0 1 20132659200 10485760 232259584000 MPIIO 0
Finished: Wed Oct 24 10:38:31 2018
+ set +x

46
output_v2/COUNT:1#NN:16#PPN:8#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ tee -a ./output_v2/COUNT:1#NN:16#PPN:8#API:MPIIO#T:16384#TYPE:read.txt
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 128 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12,isc17-c13,isc17-c14,isc17-c15,isc17-c18,isc17-c22,isc17-c01,isc17-c02,isc17-c03 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 11:02:53 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread16/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 11:02:53 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread16/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 128 (8 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 18.75 GiB
aggregate filesize = 2400 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 9196896256.
read 226.48 19660800 16.00 0.491865 38.24 0.001028 38.73 0
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 9200140288.
read 228.46 19660800 16.00 0.003531 38.40 0.000871 38.41 1
WARNING: Expected aggregate file size = 2576980377600.
WARNING: Stat() of aggregate file size = 2576980377600.
WARNING: Using actual aggregate bytes moved = 9175023616.
read 228.56 19660800 16.00 0.004523 38.28 0.000903 38.28 2
Max Read: 228.56 MiB/sec (239.66 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 228.56 226.48 227.83 0.96 38.47220 0 128 8 3 0 0 1 0 0 1 20132659200 16384 9196896256 MPIIO 0
Finished: Wed Oct 24 11:04:49 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:1#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:1#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:15:02 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:15:02 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (1 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 150 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 3736166400.
read 117.86 157286400 100.00 0.004737 30.23 0.003383 30.23 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 3763097600.
read 118.70 157286400 100.00 0.003687 30.23 0.003310 30.23 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 3785728000.
read 119.42 157286400 100.00 0.003661 30.23 0.003287 30.23 2
Max Read: 119.42 MiB/sec (125.22 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 119.42 117.86 118.66 0.63 30.23216 0 2 1 3 0 0 1 0 0 1 161061273600 102400 3736166400 MPIIO 0
Finished: Wed Oct 24 09:16:32 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:1#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:1#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:06:31 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:06:31 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (1 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 150 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 16617832448.
read 527.49 157286400 1024.00 0.006135 30.04 0.000685 30.04 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 17189306368.
read 545.97 157286400 1024.00 0.000973 30.02 0.001011 30.03 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 16532897792.
read 524.90 157286400 1024.00 0.001371 30.04 0.001267 30.04 2
Max Read: 545.97 MiB/sec (572.49 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 545.97 524.90 532.78 9.38 30.03600 0 2 1 3 0 0 1 0 0 1 161061273600 1048576 16617832448 MPIIO 0
Finished: Wed Oct 24 09:08:01 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:1#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:1#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:58:01 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:58:01 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (1 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 150 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 9384755200.
read 297.45 157286400 10240 0.007981 30.08 0.000265 30.09 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 9458155520.
read 299.89 157286400 10240 0.000582 30.08 0.000223 30.08 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 9531555840.
read 301.25 157286400 10240 0.000577 30.17 0.000200 30.17 2
Max Read: 301.25 MiB/sec (315.88 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 301.25 297.45 299.53 1.57 30.11378 0 2 1 3 0 0 1 0 0 1 161061273600 10485760 9384755200 MPIIO 0
Finished: Wed Oct 24 08:59:31 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:1#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:1#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:23:29 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:23:29 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (1 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 150 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 788152320.
read 23.70 157286400 16.00 0.001992 31.72 0.000294 31.72 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 792936448.
read 23.84 157286400 16.00 0.000641 31.72 0.000290 31.72 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 773160960.
read 23.25 157286400 16.00 0.000638 31.71 0.000318 31.71 2
Max Read: 23.84 MiB/sec (25.00 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 23.84 23.25 23.60 0.25 31.71745 0 2 1 3 0 0 1 0 0 1 161061273600 16384 788152320 MPIIO 0
Finished: Wed Oct 24 09:25:04 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:2#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:2#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:18:26 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:18:26 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (2 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 75 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 8820633600.
read 278.48 78643200 100.00 0.007858 30.20 0.003777 30.21 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 8893747200.
read 280.79 78643200 100.00 0.004179 30.21 0.003814 30.21 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 8919961600.
read 281.67 78643200 100.00 0.004208 30.20 0.003868 30.20 2
Max Read: 281.67 MiB/sec (295.35 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 281.67 278.48 280.31 1.34 30.20485 0 4 2 3 0 0 1 0 0 1 80530636800 102400 8820633600 MPIIO 0
Finished: Wed Oct 24 09:19:57 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:2#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:2#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:09:57 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:09:57 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (2 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 75 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 44287655936.
read 1405.74 78643200 1024.00 0.005991 30.04 0.000742 30.05 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 44343230464.
read 1408.13 78643200 1024.00 0.001121 30.03 0.000697 30.03 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 46253735936.
read 1468.87 78643200 1024.00 0.001093 30.03 0.000691 30.03 2
Max Read: 1468.87 MiB/sec (1540.22 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1468.87 1405.74 1427.58 29.21 30.03596 0 4 2 3 0 0 1 0 0 1 80530636800 1048576 44287655936 MPIIO 0
Finished: Wed Oct 24 09:11:28 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:2#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:2#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:01:26 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:01:26 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (2 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 75 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 24714936320.
read 783.79 78643200 10240 0.006850 30.06 0.001080 30.07 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 26203914240.
read 829.49 78643200 10240 0.001117 30.13 0.000680 30.13 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 26036142080.
read 825.66 78643200 10240 0.001120 30.07 0.000665 30.07 2
Max Read: 829.49 MiB/sec (869.79 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 829.49 783.79 812.98 20.70 30.09047 0 4 2 3 0 0 1 0 0 1 80530636800 10485760 24714936320 MPIIO 0
Finished: Wed Oct 24 09:02:57 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:2#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:2#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:26:54 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:26:54 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (2 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 75 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 1972912128.
read 60.03 78643200 16.00 0.013065 31.33 0.004391 31.34 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 1941422080.
read 59.10 78643200 16.00 0.004769 31.32 0.004360 31.33 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 1941667840.
read 59.10 78643200 16.00 0.004769 31.33 0.004385 31.33 2
Max Read: 60.03 MiB/sec (62.95 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 60.03 59.10 59.41 0.44 31.33426 0 4 2 3 0 0 1 0 0 1 80530636800 16384 1972912128 MPIIO 0
Finished: Wed Oct 24 09:28:28 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:4#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:4#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:13:22 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:13:22 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (4 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 37.50 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 19975884800.
read 630.99 39321600 100.00 0.006868 30.19 0.004319 30.19 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 21042995200.
read 664.70 39321600 100.00 0.004874 30.19 0.004276 30.19 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 20975411200.
read 662.64 39321600 100.00 0.004819 30.19 0.004244 30.19 2
Max Read: 664.70 MiB/sec (696.99 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 664.70 630.99 652.78 15.43 30.19026 0 8 4 3 0 0 1 0 0 1 40265318400 102400 19975884800 MPIIO 0
Finished: Wed Oct 24 09:14:53 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:4#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:4#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:04:51 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:04:51 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (4 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 37.50 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 62974328832.
read 1999.37 39321600 1024.00 0.003182 30.03 0.000304 30.04 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 63116935168.
read 2002.30 39321600 1024.00 0.000825 30.06 0.000291 30.06 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 65784512512.
read 2089.55 39321600 1024.00 0.000887 30.02 0.000333 30.02 2
Max Read: 2089.55 MiB/sec (2191.06 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 2089.55 1999.37 2030.41 41.84 30.04134 0 8 4 3 0 0 1 0 0 1 40265318400 1048576 62974328832 MPIIO 0
Finished: Wed Oct 24 09:06:21 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:4#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:4#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:56:20 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:56:20 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (4 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 37.50 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 37098618880.
read 1175.08 39321600 10240 0.008422 30.11 0.005494 30.11 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 38986055680.
read 1235.66 39321600 10240 0.006070 30.08 0.005867 30.09 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 41523609600.
read 1314.71 39321600 10240 0.006389 30.11 0.005482 30.12 2
Max Read: 1314.71 MiB/sec (1378.57 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1314.71 1175.08 1241.82 57.17 30.10616 0 8 4 3 0 0 1 0 0 1 40265318400 10485760 37098618880 MPIIO 0
Finished: Wed Oct 24 08:57:51 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:4#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:4#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:21:51 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:21:51 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (4 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 37.50 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 4629479424.
read 141.59 39321600 16.00 0.005694 31.18 0.000630 31.18 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 4752850944.
read 145.38 39321600 16.00 0.001193 31.18 0.000570 31.18 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 4432265216.
read 135.51 39321600 16.00 0.001126 31.19 0.000546 31.19 2
Max Read: 145.38 MiB/sec (152.45 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 145.38 135.51 140.83 4.06 31.18351 0 8 4 3 0 0 1 0 0 1 40265318400 16384 4629479424 MPIIO 0
Finished: Wed Oct 24 09:23:24 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:6#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 12 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:6#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:16:47 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:16:47 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 12 (6 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 25 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 30751744000.
read 970.73 26214400 100.00 0.010923 30.20 0.000444 30.21 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 33000448000.
read 1042.75 26214400 100.00 0.001276 30.18 0.000518 30.18 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 33717862400.
read 1065.32 26214400 100.00 0.001257 30.18 0.000485 30.18 2
Max Read: 1065.32 MiB/sec (1117.07 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1065.32 970.73 1026.27 40.34 30.19233 0 12 6 3 0 0 1 0 0 1 26843545600 102400 30751744000 MPIIO 0
Finished: Wed Oct 24 09:18:18 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:6#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 12 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:6#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:08:18 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:08:18 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 12 (6 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 25 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 106556293120.
read 3383.01 26214400 1024.00 0.009576 30.03 0.004379 30.04 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 106884497408.
read 3392.60 26214400 1024.00 0.005004 30.04 0.004395 30.05 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 112770154496.
read 3580.77 26214400 1024.00 0.004971 30.03 0.004420 30.03 2
Max Read: 3580.77 MiB/sec (3754.71 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 3580.77 3383.01 3452.12 91.05 30.03947 0 12 6 3 0 0 1 0 0 1 26843545600 1048576 106556293120 MPIIO 0
Finished: Wed Oct 24 09:09:48 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:6#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 12 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:6#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:59:46 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:59:46 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 12 (6 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 25 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 63816335360.
read 2015.31 26214400 10240 0.010481 30.19 0.000536 30.20 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 65682800640.
read 2083.36 26214400 10240 0.001148 30.07 0.000409 30.07 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 66773319680.
read 2104.90 26214400 10240 0.001112 30.25 0.000364 30.25 2
Max Read: 2104.90 MiB/sec (2207.15 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 2104.90 2015.31 2067.86 38.19 30.17293 0 12 6 3 0 0 1 0 0 1 26843545600 10485760 63816335360 MPIIO 0
Finished: Wed Oct 24 09:01:17 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:6#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 12 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:6#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:25:15 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:25:15 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 12 (6 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 25 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 7125254144.
read 218.31 26214400 16.00 0.005018 31.12 0.001130 31.13 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 7243743232.
read 221.99 26214400 16.00 0.001889 31.12 0.001101 31.12 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 7352680448.
read 225.31 26214400 16.00 0.001959 31.12 0.001072 31.12 2
Max Read: 225.31 MiB/sec (236.26 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 225.31 218.31 221.87 2.86 31.12249 0 12 6 3 0 0 1 0 0 1 26843545600 16384 7125254144 MPIIO 0
Finished: Wed Oct 24 09:26:48 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:8#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 16 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:8#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:11:38 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:11:38 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 16 (8 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 18.75 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 39655936000.
read 1252.91 19660800 100.00 0.005301 30.18 0.000551 30.18 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 37454438400.
read 1183.32 19660800 100.00 0.001506 30.18 0.000921 30.19 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 38789734400.
read 1225.73 19660800 100.00 0.001948 30.18 0.000534 30.18 2
Max Read: 1252.91 MiB/sec (1313.77 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1252.91 1183.32 1220.65 28.63 30.18358 0 16 8 3 0 0 1 0 0 1 20132659200 102400 39655936000 MPIIO 0
Finished: Wed Oct 24 09:13:09 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:8#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 16 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:8#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:03:07 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:03:07 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 16 (8 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 18.75 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 87024467968.
read 2763.51 19660800 1024.00 0.005419 30.03 0.000360 30.03 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 91385495552.
read 2901.74 19660800 1024.00 0.001273 30.03 0.000329 30.03 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 97308901376.
read 3089.54 19660800 1024.00 0.001410 30.04 0.000653 30.04 2
Max Read: 3089.54 MiB/sec (3239.61 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 3089.54 2763.51 2918.26 133.61 30.03441 0 16 8 3 0 0 1 0 0 1 20132659200 1048576 87024467968 MPIIO 0
Finished: Wed Oct 24 09:04:37 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:8#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 16 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:8#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 08:54:35 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 08:54:35 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 16 (8 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 18.75 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 43620761600.
read 1380.95 19660800 10240 0.005614 30.11 0.004382 30.12 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 49325015040.
read 1561.35 19660800 10240 0.001563 30.13 0.000657 30.13 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 57032048640.
read 1805.43 19660800 10240 0.001589 30.12 0.001276 30.13 2
Max Read: 1805.43 MiB/sec (1893.13 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1805.43 1380.95 1582.58 173.94 30.12592 0 16 8 3 0 0 1 0 0 1 20132659200 10485760 43620761600 MPIIO 0
Finished: Wed Oct 24 08:56:06 2018
+ set +x

46
output_v2/COUNT:1#NN:2#PPN:8#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 16 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
+ tee -a ./output_v2/COUNT:1#NN:2#PPN:8#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:20:05 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread2/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:20:05 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread2/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 16 (8 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 18.75 GiB
aggregate filesize = 300 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 9059352576.
read 277.66 19660800 16.00 0.014082 31.10 0.003656 31.12 0
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 9123512320.
read 279.73 19660800 16.00 0.001241 31.10 0.005504 31.10 1
WARNING: Expected aggregate file size = 322122547200.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 10053664768.
read 308.32 19660800 16.00 0.001237 31.10 0.000314 31.10 2
Max Read: 308.32 MiB/sec (323.30 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 308.32 277.66 288.57 13.99 31.10578 0 16 8 3 0 0 1 0 0 1 20132659200 16384 9059352576 MPIIO 0
Finished: Wed Oct 24 09:21:39 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:1#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:1#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:48:58 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:48:58 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (1 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 150 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 1891942400.
read 59.30 157286400 100.00 0.008840 30.42 0.002395 30.42 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 1891737600.
read 59.36 157286400 100.00 0.002586 30.39 0.002236 30.39 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 1912832000.
read 59.98 157286400 100.00 0.002620 30.41 0.002246 30.41 2
Max Read: 59.98 MiB/sec (62.90 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 59.98 59.30 59.55 0.31 30.41032 0 4 1 3 0 0 1 0 0 1 161061273600 102400 1891942400 MPIIO 0
Finished: Wed Oct 24 09:50:30 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:1#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:1#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:40:31 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:40:31 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (1 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 150 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 13345226752.
read 422.87 157286400 1024.00 0.007052 30.09 0.000558 30.10 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 13321109504.
read 422.80 157286400 1024.00 0.000829 30.05 0.000458 30.05 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 13317963776.
read 422.60 157286400 1024.00 0.000798 30.05 0.000464 30.05 2
Max Read: 422.87 MiB/sec (443.42 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 422.87 422.60 422.76 0.12 30.06602 0 4 1 3 0 0 1 0 0 1 161061273600 1048576 13345226752 MPIIO 0
Finished: Wed Oct 24 09:42:01 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:1#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:1#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:31:58 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:31:58 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (1 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 150 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 12960399360.
read 410.71 157286400 10240 0.007499 30.09 0.005312 30.09 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 13107200000.
read 415.35 157286400 10240 0.005589 30.09 0.005223 30.10 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 12761169920.
read 403.96 157286400 10240 0.005578 30.13 0.005207 30.13 2
Max Read: 415.35 MiB/sec (435.53 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 415.35 403.96 410.01 4.68 30.10537 0 4 1 3 0 0 1 0 0 1 161061273600 10485760 12960399360 MPIIO 0
Finished: Wed Oct 24 09:33:28 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:1#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:1#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:57:12 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:57:12 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (1 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 150 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 358842368.
read 10.46 157286400 16.00 0.008650 32.71 0.000527 32.71 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 357810176.
read 10.43 157286400 16.00 0.001052 32.70 0.000514 32.71 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 365543424.
read 10.66 157286400 16.00 0.000846 32.71 0.000534 32.71 2
Max Read: 10.66 MiB/sec (11.18 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 10.66 10.43 10.52 0.10 32.70968 0 4 1 3 0 0 1 0 0 1 161061273600 16384 358842368 MPIIO 0
Finished: Wed Oct 24 09:58:50 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:2#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:2#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:52:14 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:52:14 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (2 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 75 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 4687974400.
read 147.18 78643200 100.00 0.004683 30.37 0.000468 30.38 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 4677632000.
read 146.87 78643200 100.00 0.000999 30.37 0.000304 30.37 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 4708659200.
read 147.87 78643200 100.00 0.000762 30.37 0.000425 30.37 2
Max Read: 147.87 MiB/sec (155.05 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 147.87 146.87 147.31 0.42 30.37284 0 8 2 3 0 0 1 0 0 1 80530636800 102400 4687974400 MPIIO 0
Finished: Wed Oct 24 09:53:45 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:2#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:2#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:43:56 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:43:56 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (2 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 75 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 34132197376.
read 1082.36 78643200 1024.00 0.009768 30.06 0.000606 30.07 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 34183577600.
read 1084.85 78643200 1024.00 0.000973 30.05 0.000544 30.05 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 34254880768.
read 1087.31 78643200 1024.00 0.000921 30.04 0.000585 30.04 2
Max Read: 1087.31 MiB/sec (1140.13 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1087.31 1082.36 1084.84 2.02 30.05641 0 8 2 3 0 0 1 0 0 1 80530636800 1048576 34132197376 MPIIO 0
Finished: Wed Oct 24 09:45:26 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:2#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:2#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:35:22 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:35:22 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (2 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 75 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 32317112320.
read 1023.64 78643200 10240 0.007175 30.10 0.000662 30.11 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 32652656640.
read 1033.55 78643200 10240 0.001082 30.13 0.000640 30.13 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 32799457280.
read 1039.43 78643200 10240 0.001013 30.09 0.000613 30.09 2
Max Read: 1039.43 MiB/sec (1089.92 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1039.43 1023.64 1032.21 6.52 30.11027 0 8 2 3 0 0 1 0 0 1 80530636800 10485760 32317112320 MPIIO 0
Finished: Wed Oct 24 09:36:53 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:2#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:2#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:00:34 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:00:34 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (2 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 75 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 889995264.
read 26.26 78643200 16.00 0.005569 32.32 0.000616 32.33 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 890454016.
read 26.27 78643200 16.00 0.001238 32.33 0.000591 32.33 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 887750656.
read 26.19 78643200 16.00 0.001045 32.33 0.000619 32.33 2
Max Read: 26.27 MiB/sec (27.54 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 26.27 26.19 26.24 0.03 32.32704 0 8 2 3 0 0 1 0 0 1 80530636800 16384 889995264 MPIIO 0
Finished: Wed Oct 24 10:02:11 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:4#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 16 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:4#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:47:22 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:47:22 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 16 (4 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 37.50 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 10861875200.
read 341.08 39321600 100.00 0.015253 30.36 0.003466 30.37 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 10775449600.
read 338.49 39321600 100.00 0.004275 30.36 0.003649 30.36 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 10833715200.
read 340.30 39321600 100.00 0.004053 30.36 0.003438 30.36 2
Max Read: 341.08 MiB/sec (357.65 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 341.08 338.49 339.96 1.09 30.36335 0 16 4 3 0 0 1 0 0 1 40265318400 102400 10861875200 MPIIO 0
Finished: Wed Oct 24 09:48:54 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:4#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 16 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:4#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:38:50 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:38:50 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 16 (4 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 37.50 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 59221475328.
read 1875.45 39321600 1024.00 0.015676 30.10 0.000402 30.11 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 59553873920.
read 1889.75 39321600 1024.00 0.001022 30.05 0.000718 30.05 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 59897806848.
read 1898.25 39321600 1024.00 0.000989 30.09 0.000725 30.09 2
Max Read: 1898.25 MiB/sec (1990.46 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1898.25 1875.45 1887.82 9.41 30.08701 0 16 4 3 0 0 1 0 0 1 40265318400 1048576 59221475328 MPIIO 0
Finished: Wed Oct 24 09:40:20 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:4#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 16 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:4#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:30:17 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:30:17 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 16 (4 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 37.50 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 60429434880.
read 1912.33 39321600 10240 0.007836 30.13 0.000965 30.14 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 59999518720.
read 1888.60 39321600 10240 0.001354 30.30 0.000571 30.30 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 57839452160.
read 1831.39 39321600 10240 0.001126 30.12 0.000848 30.12 2
Max Read: 1912.33 MiB/sec (2005.22 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1912.33 1831.39 1877.44 33.97 30.18426 0 16 4 3 0 0 1 0 0 1 40265318400 10485760 60429434880 MPIIO 0
Finished: Wed Oct 24 09:31:48 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:4#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 16 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:4#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:55:33 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:55:33 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 16 (4 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 37.50 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 2153725952.
read 63.79 39321600 16.00 0.007476 32.19 0.000673 32.20 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 2157674496.
read 63.94 39321600 16.00 0.001299 32.18 0.000614 32.18 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 2132443136.
read 63.19 39321600 16.00 0.001262 32.18 0.000657 32.19 2
Max Read: 63.94 MiB/sec (67.04 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 63.94 63.19 63.64 0.33 32.18851 0 16 4 3 0 0 1 0 0 1 40265318400 16384 2153725952 MPIIO 0
Finished: Wed Oct 24 09:57:09 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:6#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 24 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:6#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:50:38 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:50:38 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 24 (6 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 25 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 16948326400.
read 532.36 26214400 100.00 0.012398 30.35 0.000755 30.36 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 16879411200.
read 530.26 26214400 100.00 0.001619 30.36 0.000658 30.36 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 16921088000.
read 531.62 26214400 100.00 0.001564 30.35 0.000741 30.35 2
Max Read: 532.36 MiB/sec (558.22 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 532.36 530.26 531.41 0.87 30.35805 0 24 6 3 0 0 1 0 0 1 26843545600 102400 16948326400 MPIIO 0
Finished: Wed Oct 24 09:52:09 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:6#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 24 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:6#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:42:16 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:42:16 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 24 (6 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 25 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 96783564800.
read 3070.13 26214400 1024.00 0.008936 30.05 0.000853 30.06 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 98746499072.
read 3133.15 26214400 1024.00 0.001995 30.05 0.004786 30.06 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 99211018240.
read 3148.83 26214400 1024.00 0.001698 30.05 0.001106 30.05 2
Max Read: 3148.83 MiB/sec (3301.79 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 3148.83 3070.13 3117.37 34.01 30.05605 0 24 6 3 0 0 1 0 0 1 26843545600 1048576 96783564800 MPIIO 0
Finished: Wed Oct 24 09:43:46 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:6#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 24 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:6#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:33:42 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:33:42 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 24 (6 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 25 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 89076531200.
read 2819.16 26214400 10240 0.014407 30.12 0.004539 30.13 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 90020249600.
read 2848.86 26214400 10240 0.005390 30.13 0.004397 30.13 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 90764738560.
read 2872.22 26214400 10240 0.005360 30.14 0.004504 30.14 2
Max Read: 2872.22 MiB/sec (3011.75 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 2872.22 2819.16 2846.75 21.72 30.13496 0 24 6 3 0 0 1 0 0 1 26843545600 10485760 89076531200 MPIIO 0
Finished: Wed Oct 24 09:35:12 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:6#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 24 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:6#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:58:55 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:58:55 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 24 (6 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 25 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 3352395776.
read 99.45 26214400 16.00 0.008545 32.14 0.000664 32.15 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 3360833536.
read 99.73 26214400 16.00 0.001813 32.14 0.000684 32.14 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 3330605056.
read 98.84 26214400 16.00 0.001569 32.13 0.000663 32.13 2
Max Read: 99.73 MiB/sec (104.58 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 99.73 98.84 99.34 0.37 32.13982 0 24 6 3 0 0 1 0 0 1 26843545600 16384 3352395776 MPIIO 0
Finished: Wed Oct 24 10:00:32 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:8#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 32 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:8#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:45:38 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:45:38 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 32 (8 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 18.75 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 22090342400.
read 693.91 19660800 100.00 0.014762 30.35 0.006049 30.36 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 22098227200.
read 694.20 19660800 100.00 0.007519 30.36 0.005887 30.36 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 22085017600.
read 693.81 19660800 100.00 0.007168 30.35 0.006292 30.36 2
Max Read: 694.20 MiB/sec (727.92 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 694.20 693.81 693.97 0.16 30.35828 0 32 8 3 0 0 1 0 0 1 20132659200 102400 22090342400 MPIIO 0
Finished: Wed Oct 24 09:47:09 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:8#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 32 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:8#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:37:05 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:37:05 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 32 (8 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 18.75 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 101707677696.
read 3221.33 19660800 1024.00 0.005896 30.10 0.008057 30.11 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 99137617920.
read 3144.60 19660800 1024.00 0.003158 30.06 0.001679 30.07 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 99635691520.
read 3156.91 19660800 1024.00 0.003120 30.10 0.001581 30.10 2
Max Read: 3221.33 MiB/sec (3377.81 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 3221.33 3144.60 3174.28 33.64 30.09181 0 32 8 3 0 0 1 0 0 1 20132659200 1048576 101707677696 MPIIO 0
Finished: Wed Oct 24 09:38:35 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:8#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 32 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:8#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:28:34 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:28:34 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 32 (8 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 18.75 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 88510300160.
read 2801.80 19660800 10240 0.005035 30.12 0.000976 30.13 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 99625205760.
read 3152.42 19660800 10240 0.002645 30.14 0.001326 30.14 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 108265472000.
read 3427.61 19660800 10240 0.002664 30.12 0.000947 30.12 2
Max Read: 3427.61 MiB/sec (3594.11 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 3427.61 2801.80 3127.28 256.11 30.12962 0 32 8 3 0 0 1 0 0 1 20132659200 10485760 88510300160 MPIIO 0
Finished: Wed Oct 24 09:30:04 2018
+ set +x

46
output_v2/COUNT:1#NN:4#PPN:8#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 32 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
+ tee -a ./output_v2/COUNT:1#NN:4#PPN:8#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 09:53:50 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread4/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 09:53:50 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread4/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 32 (8 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 18.75 GiB
aggregate filesize = 600 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 4484628480.
read 133.12 19660800 16.00 0.008587 32.12 0.005908 32.13 0
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 4516380672.
read 134.09 19660800 16.00 0.003454 32.12 0.001760 32.12 1
WARNING: Expected aggregate file size = 644245094400.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 4513972224.
read 134.02 19660800 16.00 0.003422 32.12 0.005695 32.12 2
Max Read: 134.09 MiB/sec (140.60 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 134.09 133.12 133.74 0.44 32.12342 0 32 8 3 0 0 1 0 0 1 20132659200 16384 4484628480 MPIIO 0
Finished: Wed Oct 24 09:55:27 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:1#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:1#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:23:12 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:23:12 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (1 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 150 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 3188940800.
read 98.96 157286400 100.00 0.012591 30.72 0.005406 30.73 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 3220684800.
read 99.97 157286400 100.00 0.006170 30.72 0.005356 30.72 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 3232153600.
read 100.29 157286400 100.00 0.005746 30.73 0.005384 30.73 2
Max Read: 100.29 MiB/sec (105.17 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 100.29 98.96 99.74 0.57 30.72944 0 8 1 3 0 0 1 0 0 1 161061273600 102400 3188940800 MPIIO 0
Finished: Wed Oct 24 10:24:44 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:1#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:1#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:14:37 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:14:37 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (1 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 150 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 22439526400.
read 711.20 157286400 1024.00 0.010341 30.08 0.004471 30.09 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 22701670400.
read 719.06 157286400 1024.00 0.004756 30.10 0.004372 30.11 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 22588424192.
read 714.70 157286400 1024.00 0.004719 30.14 0.004368 30.14 2
Max Read: 719.06 MiB/sec (753.99 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 719.06 711.20 714.99 3.22 30.11334 0 8 1 3 0 0 1 0 0 1 161061273600 1048576 22439526400 MPIIO 0
Finished: Wed Oct 24 10:16:08 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:1#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:1#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:05:49 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:05:49 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (1 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 150 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 23592960000.
read 746.80 157286400 10240 0.007054 30.12 0.000606 30.13 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 23771217920.
read 747.94 157286400 10240 0.000879 30.31 0.000536 30.31 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 23509073920.
read 744.50 157286400 10240 0.000881 30.11 0.000563 30.11 2
Max Read: 747.94 MiB/sec (784.27 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 747.94 744.50 746.41 1.43 30.18426 0 8 1 3 0 0 1 0 0 1 161061273600 10485760 23592960000 MPIIO 0
Finished: Wed Oct 24 10:07:19 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:1#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:1#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:31:38 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 161061273600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:31:38 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (1 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 150 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 620904448.
read 17.05 157286400 16.00 0.003433 34.71 0.006394 34.72 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 618266624.
read 16.99 157286400 16.00 0.001303 34.71 0.000673 34.71 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 617676800.
read 16.97 157286400 16.00 0.001036 34.71 0.000661 34.71 2
Max Read: 17.05 MiB/sec (17.88 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 17.05 16.97 17.00 0.04 34.71322 0 8 1 3 0 0 1 0 0 1 161061273600 16384 620904448 MPIIO 0
Finished: Wed Oct 24 10:33:23 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:2#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 16 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:2#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:26:29 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:26:29 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 16 (2 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 75 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 7339315200.
read 228.00 78643200 100.00 0.012054 30.69 0.000909 30.70 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 7373619200.
read 229.07 78643200 100.00 0.001101 30.70 0.000659 30.70 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 7356928000.
read 228.55 78643200 100.00 0.001068 30.70 0.000674 30.70 2
Max Read: 229.07 MiB/sec (240.20 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 229.07 228.00 228.54 0.44 30.69825 0 16 2 3 0 0 1 0 0 1 80530636800 102400 7339315200 MPIIO 0
Finished: Wed Oct 24 10:28:01 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:2#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 16 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:2#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:18:09 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:18:09 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 16 (2 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 75 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 48044703744.
read 1522.35 78643200 1024.00 0.014171 30.08 0.001997 30.10 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 47299166208.
read 1497.97 78643200 1024.00 0.002417 30.11 0.001978 30.11 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 46742372352.
read 1480.92 78643200 1024.00 0.002369 30.10 0.001928 30.10 2
Max Read: 1522.35 MiB/sec (1596.29 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1522.35 1480.92 1500.41 17.00 30.10371 0 16 2 3 0 0 1 0 0 1 80530636800 1048576 48044703744 MPIIO 0
Finished: Wed Oct 24 10:19:39 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:2#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 16 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:2#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:09:20 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:09:20 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 16 (2 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 75 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 51443138560.
read 1627.32 78643200 10240 0.013815 30.14 0.002239 30.15 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 50520391680.
read 1599.58 78643200 10240 0.002663 30.12 0.002243 30.12 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 50614763520.
read 1585.93 78643200 10240 0.002691 30.44 0.002227 30.44 2
Max Read: 1627.32 MiB/sec (1706.37 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 1627.32 1585.93 1604.28 17.22 30.23479 0 16 2 3 0 0 1 0 0 1 80530636800 10485760 51443138560 MPIIO 0
Finished: Wed Oct 24 10:10:51 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:2#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 16 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:2#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:35:13 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 80530636800 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:35:13 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 16 (2 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 75 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 1445986304.
read 40.13 78643200 16.00 0.008986 34.35 0.006151 34.36 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 1441120256.
read 40.01 78643200 16.00 0.001408 34.35 0.000734 34.35 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 1434337280.
read 39.82 78643200 16.00 0.001161 34.35 0.000753 34.35 2
Max Read: 40.13 MiB/sec (42.08 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 40.13 39.82 39.99 0.13 34.35515 0 16 2 3 0 0 1 0 0 1 80530636800 16384 1445986304 MPIIO 0
Finished: Wed Oct 24 10:36:56 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:4#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 32 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:4#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:21:36 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:21:36 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 32 (4 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 37.50 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 14949785600.
read 464.69 39321600 100.00 0.005945 30.68 0.001547 30.68 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 14908006400.
read 463.21 39321600 100.00 0.002401 30.69 0.001461 30.69 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 14860902400.
read 461.95 39321600 100.00 0.002719 30.68 0.001489 30.68 2
Max Read: 464.69 MiB/sec (487.26 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 464.69 461.95 463.28 1.12 30.68467 0 32 4 3 0 0 1 0 0 1 40265318400 102400 14949785600 MPIIO 0
Finished: Wed Oct 24 10:23:08 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:4#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 32 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:4#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:12:56 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:12:56 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 32 (4 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 37.50 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 85126545408.
read 2694.02 39321600 1024.00 0.005121 30.13 0.000938 30.13 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 84732280832.
read 2682.92 39321600 1024.00 0.001794 30.12 0.000910 30.12 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 84818264064.
read 2688.52 39321600 1024.00 0.002177 30.08 0.000910 30.09 2
Max Read: 2694.02 MiB/sec (2824.88 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 2694.02 2682.92 2688.49 4.53 30.11347 0 32 4 3 0 0 1 0 0 1 40265318400 1048576 85126545408 MPIIO 0
Finished: Wed Oct 24 10:14:26 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:4#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 32 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:4#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:04:05 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:04:05 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 32 (4 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 37.50 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 89139445760.
read 2790.96 39321600 10240 0.010346 30.45 0.001084 30.46 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 88992645120.
read 2797.92 39321600 10240 0.002011 30.33 0.000991 30.33 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 89066045440.
read 2806.03 39321600 10240 0.002157 30.27 0.001029 30.27 2
Max Read: 2806.03 MiB/sec (2942.33 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 2806.03 2790.96 2798.30 6.16 30.35431 0 32 4 3 0 0 1 0 0 1 40265318400 10485760 89139445760 MPIIO 0
Finished: Wed Oct 24 10:05:36 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:4#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 32 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:4#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:29:53 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 40265318400 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:29:53 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 32 (4 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 37.50 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 2995519488.
read 83.46 39321600 16.00 0.008958 34.22 0.000828 34.23 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 2973417472.
read 82.88 39321600 16.00 0.001794 34.21 0.000810 34.21 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 2989047808.
read 83.32 39321600 16.00 0.002414 34.21 0.000858 34.21 2
Max Read: 83.46 MiB/sec (87.52 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 83.46 82.88 83.22 0.25 34.21797 0 32 4 3 0 0 1 0 0 1 40265318400 16384 2995519488 MPIIO 0
Finished: Wed Oct 24 10:31:36 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:6#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 48 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:6#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:24:52 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:24:52 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 48 (6 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 25 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 22201344000.
read 689.98 26214400 100.00 0.007294 30.68 0.001072 30.69 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 22282752000.
read 692.77 26214400 100.00 0.002422 30.67 0.001062 30.67 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 22207180800.
read 690.35 26214400 100.00 0.002722 30.68 0.001080 30.68 2
Max Read: 692.77 MiB/sec (726.42 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 692.77 689.98 691.03 1.24 30.67954 0 48 6 3 0 0 1 0 0 1 26843545600 102400 22201344000 MPIIO 0
Finished: Wed Oct 24 10:26:24 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:6#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 48 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:6#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:16:24 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:16:24 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 48 (6 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 25 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 127278252032.
read 4031 26214400 1024.00 0.015680 30.10 0.005699 30.11 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 129564147712.
read 4105 26214400 1024.00 0.007033 30.10 0.005623 30.10 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 130157641728.
read 4124 26214400 1024.00 0.007446 30.10 0.005590 30.10 2
Max Read: 4123.51 MiB/sec (4323.81 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 4123.51 4031.34 4086.51 39.76 30.10492 0 48 6 3 0 0 1 0 0 1 26843545600 1048576 127278252032 MPIIO 0
Finished: Wed Oct 24 10:17:54 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:6#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 48 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:6#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:07:33 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:07:33 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 48 (6 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 25 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 131826974720.
read 4166 26214400 10240 0.011798 30.16 0.000780 30.18 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 134762987520.
read 4260 26214400 10240 0.002110 30.17 0.000749 30.17 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 136356823040.
read 4311 26214400 10240 0.002454 30.16 0.000730 30.16 2
Max Read: 4311.39 MiB/sec (4520.82 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 4311.39 4166.13 4245.79 60.13 30.16955 0 48 6 3 0 0 1 0 0 1 26843545600 10485760 131826974720 MPIIO 0
Finished: Wed Oct 24 10:09:03 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:6#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 48 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:6#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:33:28 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 26843545600 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:33:28 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 48 (6 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 25 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 4455464960.
read 124.31 26214400 16.00 0.012877 34.17 0.003357 34.18 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 4437147648.
read 123.80 26214400 16.00 0.004842 34.18 0.003343 34.18 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 4468097024.
read 124.70 26214400 16.00 0.005238 34.17 0.003359 34.17 2
Max Read: 124.70 MiB/sec (130.75 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 124.70 123.80 124.27 0.37 34.17775 0 48 6 3 0 0 1 0 0 1 26843545600 16384 4455464960 MPIIO 0
Finished: Wed Oct 24 10:35:10 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:8#API:MPIIO#T:102400#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 64 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:8#API:MPIIO#T:102400#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:19:49 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:19:49 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 64 (8 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 18.75 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 28118937600.
read 873.36 19660800 100.00 0.014698 30.69 0.001084 30.70 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 28091904000.
read 872.67 19660800 100.00 0.002898 30.69 0.004032 30.70 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 28033433600.
read 871.60 19660800 100.00 0.003107 30.67 0.001110 30.67 2
Max Read: 873.36 MiB/sec (915.78 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 873.36 871.60 872.54 0.72 30.69262 0 64 8 3 0 0 1 0 0 1 20132659200 102400 28118937600 MPIIO 0
Finished: Wed Oct 24 10:21:21 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:8#API:MPIIO#T:1048576#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 64 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:8#API:MPIIO#T:1048576#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:11:02 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 1048576 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:11:02 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 64 (8 per node)
repetitions = 3
xfersize = 1 MiB
blocksize = 18.75 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 139806638080.
read 4423 19660800 1024.00 0.007468 30.14 0.001688 30.14 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 140645498880.
read 4453 19660800 1024.00 0.003404 30.12 0.001768 30.12 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 141918470144.
read 4494 19660800 1024.00 0.004081 30.11 0.002147 30.12 2
Max Read: 4494.02 MiB/sec (4712.32 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 4494.02 4423.30 4456.61 29.02 30.12788 0 64 8 3 0 0 1 0 0 1 20132659200 1048576 139806638080 MPIIO 0
Finished: Wed Oct 24 10:12:33 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:8#API:MPIIO#T:10485760#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 64 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:8#API:MPIIO#T:10485760#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:02:16 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 10485760 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:02:16 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 64 (8 per node)
repetitions = 3
xfersize = 10 MiB
blocksize = 18.75 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 142994309120.
read 4520 19660800 10240 0.016658 30.16 0.005406 30.17 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 156866969600.
read 4957 19660800 10240 0.007096 30.18 0.005671 30.18 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 157674373120.
read 4985 19660800 10240 0.007500 30.16 0.005318 30.16 2
Max Read: 4985.43 MiB/sec (5227.60 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 4985.43 4520.08 4820.92 213.03 30.16993 0 64 8 3 0 0 1 0 0 1 20132659200 10485760 142994309120 MPIIO 0
Finished: Wed Oct 24 10:03:46 2018
+ set +x

46
output_v2/COUNT:1#NN:8#PPN:8#API:MPIIO#T:16384#TYPE:read.txt Normal file
View File

@ -0,0 +1,46 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 64 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04,isc17-c05,isc17-c06,isc17-c07,isc17-c08,isc17-c09,isc17-c11,isc17-c12 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
+ tee -a ./output_v2/COUNT:1#NN:8#PPN:8#API:MPIIO#T:16384#TYPE:read.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 10:28:06 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 16384 -b 20132659200 -D 30 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/sharedread8/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 10:28:06 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/sharedread8/file
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 64 (8 per node)
repetitions = 3
xfersize = 16384 bytes
blocksize = 18.75 GiB
aggregate filesize = 1200 GiB
Using stonewalling = 30 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 5843533824.
read 163.05 19660800 16.00 0.023175 34.16 0.014680 34.18 0
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 5826117632.
read 162.57 19660800 16.00 0.012998 34.16 0.021043 34.18 1
WARNING: Expected aggregate file size = 1288490188800.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 5835735040.
read 162.88 19660800 16.00 0.013554 34.17 0.011210 34.17 2
Max Read: 163.05 MiB/sec (170.97 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 163.05 162.57 162.83 0.20 34.17469 0 64 8 3 0 0 1 0 0 1 20132659200 16384 5843533824 MPIIO 0
Finished: Wed Oct 24 10:29:48 2018
+ set +x