julian.kunkel
/
ddn-ime-evaluation
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

NN:1 finished

This commit is contained in:
Eugen Betke 2018-10-24 01:56:35 +02:00
parent cc46ac406e
commit a01de6b5e3
10 changed files with 1190 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

104
output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:102400.txt Normal file
View File

@ -0,0 +1,104 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 01:23:25 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:23:25 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 150 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 14564761600.
write 226.59 157286400 100.00 0.001550 61.30 0.000260 61.30 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 14794547200.
write 234.39 157286400 100.00 0.001500 60.19 0.000187 60.20 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161055641600.
WARNING: Using actual aggregate bytes moved = 15000166400.
write 237.98 157286400 100.00 0.017489 60.09 0.000163 60.11 2
Max Write: 237.98 MiB/sec (249.54 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 237.98 226.59 232.98 4.76 60.53637 0 1 1 3 0 0 1 0 0 1 161061273600 102400 14564761600 MPIIO 0
Finished: Wed Oct 24 01:26:37 2018
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:MPIIO#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 01:26:41 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:26:41 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 150 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 827084800.
read 13.12 157286400 100.00 0.001573 60.10 0.000181 60.10 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 836710400.
read 13.28 157286400 100.00 0.000471 60.10 0.000155 60.10 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 855961600.
read 13.58 157286400 100.00 0.000498 60.10 0.000212 60.10 2
Max Read: 13.58 MiB/sec (14.24 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 13.58 13.12 13.33 0.19 60.09874 0 1 1 3 0 0 1 0 0 1 161061273600 102400 827084800 MPIIO 0
Finished: Wed Oct 24 01:29:41 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 7
obdidx objid objid group
7 12463344 0xbe2cf0 0
1 12644630 0xc0f116 0

102
output/COUNT:1#NN:1#PPN:1#API:POSIX#T:102400.txt Normal file
View File

@ -0,0 +1,102 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:POSIX#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 01:17:05 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:17:05 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 150 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161059430400.
WARNING: Using actual aggregate bytes moved = 14742425600.
write 222.75 157286400 100.00 0.000200 63.12 0.000128 63.12 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161058508800.
WARNING: Using actual aggregate bytes moved = 14849945600.
write 224.83 157286400 100.00 0.000409 62.99 0.000118 62.99 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161059840000.
WARNING: Using actual aggregate bytes moved = 14929920000.
write 226.41 157286400 100.00 0.000409 62.89 0.000124 62.89 2
Max Write: 226.41 MiB/sec (237.41 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 226.41 222.75 224.66 1.50 62.99806 0 1 1 3 1 0 1 0 0 1 161061273600 102400 14742425600 POSIX 0
Finished: Wed Oct 24 01:20:19 2018
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 1 -np 1 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:1#API:POSIX#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 01:20:25 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 161061273600 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:20:25 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 1 (1 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 150 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 540057600.
read 8.58 157286400 100.00 0.000167 60.05 0.000121 60.05 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 535040000.
read 8.50 157286400 100.00 0.000140 60.04 0.000117 60.04 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 550707200.
read 8.75 157286400 100.00 0.000152 60.04 0.000120 60.04 2
Max Read: 8.75 MiB/sec (9.17 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 8.75 8.50 8.61 0.10 60.04260 0 1 1 3 1 0 1 0 0 1 161061273600 102400 540057600 POSIX 0
Finished: Wed Oct 24 01:23:25 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 7
obdidx objid objid group
7 12463343 0xbe2cef 0
1 12644629 0xc0f115 0

104
output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:102400.txt Normal file
View File

@ -0,0 +1,104 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 01:48:53 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:48:53 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060556800.
WARNING: Using actual aggregate bytes moved = 15162880000.
write 239.86 78643200 100.00 0.003220 60.28 0.000273 60.29 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161059123200.
WARNING: Using actual aggregate bytes moved = 14554009600.
write 228.51 78643200 100.00 0.016505 60.72 0.000201 60.74 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161057792000.
WARNING: Using actual aggregate bytes moved = 15849881600.
write 251.13 78643200 100.00 0.030138 60.16 0.000190 60.19 2
Max Write: 251.13 MiB/sec (263.33 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 251.13 228.51 239.83 9.23 60.40618 0 2 2 3 0 0 1 0 0 1 80530636800 102400 15162880000 MPIIO 0
Finished: Wed Oct 24 01:52:04 2018
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:MPIIO#T:102400.txt
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 01:52:11 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:52:11 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 2116505600.
read 33.59 78643200 100.00 0.001503 60.10 0.000510 60.10 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 2126131200.
read 33.74 78643200 100.00 0.000598 60.10 0.000234 60.10 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 2150195200.
read 34.12 78643200 100.00 0.000571 60.09 0.000161 60.09 2
Max Read: 34.12 MiB/sec (35.78 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 34.12 33.59 33.82 0.23 60.09716 0 2 2 3 0 0 1 0 0 1 80530636800 102400 2116505600 MPIIO 0
Finished: Wed Oct 24 01:55:12 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12514730 0xbef5aa 0
7 12463352 0xbe2cf8 0

112
output/COUNT:1#NN:1#PPN:2#API:POSIX#T:102400.txt Normal file
View File

@ -0,0 +1,112 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:POSIX#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 01:42:29 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:42:29 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 30632038400.
write 474.39 78643200 100.00 0.000420 61.58 0.000147 61.58 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061068800.
WARNING: Using actual aggregate bytes moved = 30516838400.
write 460.34 78643200 100.00 0.000706 63.22 0.000131 63.22 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161059430400.
WARNING: Using actual aggregate bytes moved = 30322176000.
write 454.71 78643200 100.00 0.000663 63.59 0.000250 63.59 2
Max Write: 474.39 MiB/sec (497.43 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 474.39 454.71 463.15 8.27 62.79877 0 2 2 3 1 0 1 0 0 1 80530636800 102400 30632038400 POSIX 0
Finished: Wed Oct 24 01:45:44 2018
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ tee -a ./output/COUNT:1#NN:1#PPN:2#API:POSIX#T:102400.txt
+ /opt/ddn/mvapich/bin/mpiexec -ppn 2 -np 2 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 01:45:52 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 80530636800 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:45:52 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 2 (2 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 1250201600.
read 19.86 78643200 100.00 0.000162 60.02 0.000138 60.02 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 1249177600.
read 19.84 78643200 100.00 0.000168 60.03 0.000139 60.03 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 322122547200.
WARNING: Using actual aggregate bytes moved = 1258393600.
read 19.99 78643200 100.00 0.000163 60.02 0.000138 60.02 2
Max Read: 19.99 MiB/sec (20.97 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 19.99 19.84 19.90 0.07 60.02582 0 2 2 3 1 0 1 0 0 1 80530636800 102400 1250201600 POSIX 0
Finished: Wed Oct 24 01:48:52 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 0
obdidx objid objid group
0 12426653 0xbd9d9d 0
2 12572991 0xbfd93f 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12514729 0xbef5a9 0
7 12463351 0xbe2cf7 0

104
output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:102400.txt Normal file
View File

@ -0,0 +1,104 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 01:10:41 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:10:41 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 37.50 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161059737600.
WARNING: Using actual aggregate bytes moved = 14886502400.
write 235.82 39321600 100.00 0.001613 60.20 0.000283 60.20 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061068800.
WARNING: Using actual aggregate bytes moved = 13940326400.
write 218.90 39321600 100.00 0.026797 60.71 0.000167 60.73 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060147200.
WARNING: Using actual aggregate bytes moved = 14323404800.
write 220.98 39321600 100.00 0.001549 61.81 0.000175 61.81 2
Max Write: 235.82 MiB/sec (247.27 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 235.82 218.90 225.23 7.53 60.91658 0 4 4 3 0 0 1 0 0 1 40265318400 102400 14886502400 MPIIO 0
Finished: Wed Oct 24 01:13:55 2018
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:MPIIO#T:102400.txt
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 01:14:04 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:14:04 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 37.50 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 3567923200.
read 56.62 39321600 100.00 0.004228 60.09 0.000179 60.10 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 3673702400.
read 58.31 39321600 100.00 0.000730 60.09 0.000251 60.09 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 3749273600.
read 59.51 39321600 100.00 0.000752 60.08 0.000169 60.08 2
Max Read: 59.51 MiB/sec (62.40 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 59.51 56.62 58.15 1.19 60.08803 0 4 4 3 0 0 1 0 0 1 40265318400 102400 3567923200 MPIIO 0
Finished: Wed Oct 24 01:17:04 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12514721 0xbef5a1 0
7 12463342 0xbe2cee 0

132
output/COUNT:1#NN:1#PPN:4#API:POSIX#T:102400.txt Normal file
View File

@ -0,0 +1,132 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:POSIX#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 01:04:12 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:04:12 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 37.50 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060454400.
WARNING: Using actual aggregate bytes moved = 49498112000.
write 741.94 39321600 100.00 0.000807 63.62 0.000151 63.62 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161057792000.
WARNING: Using actual aggregate bytes moved = 48220979200.
write 723.09 39321600 100.00 0.001075 63.60 0.000144 63.60 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060044800.
WARNING: Using actual aggregate bytes moved = 48337817600.
write 725.81 39321600 100.00 0.001092 63.51 0.000154 63.51 2
Max Write: 741.94 MiB/sec (777.98 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 741.94 723.09 730.28 8.32 63.57836 0 4 4 3 1 0 1 0 0 1 40265318400 102400 49498112000 POSIX 0
Finished: Wed Oct 24 01:07:27 2018
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 4 -np 4 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:4#API:POSIX#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 01:07:40 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 40265318400 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:07:40 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 4 (4 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 37.50 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 2536550400.
read 40.31 39321600 100.00 0.000199 60.02 0.000147 60.02 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 2612326400.
read 41.51 39321600 100.00 0.000182 60.02 0.000137 60.02 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 644245094400.
WARNING: Using actual aggregate bytes moved = 2664652800.
read 42.34 39321600 100.00 0.000166 60.02 0.000136 60.02 2
Max Read: 42.34 MiB/sec (44.40 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 42.34 40.31 41.38 0.84 60.01977 0 4 4 3 1 0 1 0 0 1 40265318400 102400 2536550400 POSIX 0
Finished: Wed Oct 24 01:10:40 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000002
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12514720 0xbef5a0 0
7 12463341 0xbe2ced 0
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 0
obdidx objid objid group
0 12426644 0xbd9d94 0
2 12572981 0xbfd935 0
/esfs/jtacquaviva/ioperf/file_write.00000003
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 7
obdidx objid objid group
7 12463340 0xbe2cec 0
1 12644626 0xc0f112 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12384983 0xbcfad7 0
6 12598239 0xc03bdf 0

104
output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:102400.txt Normal file
View File

@ -0,0 +1,104 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 01:36:09 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:36:09 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 25 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060147200.
WARNING: Using actual aggregate bytes moved = 13878067200.
write 217.53 26214400 100.00 0.006332 60.84 0.000235 60.84 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161056563200.
WARNING: Using actual aggregate bytes moved = 14127308800.
write 224.14 26214400 100.00 0.001595 60.11 0.000205 60.11 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060966400.
WARNING: Using actual aggregate bytes moved = 14639411200.
write 227.50 26214400 100.00 0.018975 61.35 0.000240 61.37 2
Max Write: 227.50 MiB/sec (238.56 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 227.50 217.53 223.06 4.15 60.77317 0 6 6 3 0 0 1 0 0 1 26843545600 102400 13878067200 MPIIO 0
Finished: Wed Oct 24 01:39:20 2018
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:MPIIO#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 01:39:28 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:39:28 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 25 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 5692006400.
read 90.34 26214400 100.00 0.007037 60.08 0.000263 60.09 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 5929369600.
read 94.12 26214400 100.00 0.000932 60.08 0.000185 60.08 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 6173798400.
read 98.00 26214400 100.00 0.000894 60.08 0.000180 60.08 2
Max Read: 98.00 MiB/sec (102.76 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 98.00 90.34 94.15 3.13 60.08164 0 6 6 3 0 0 1 0 0 1 26843545600 102400 5692006400 MPIIO 0
Finished: Wed Oct 24 01:42:29 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 1
obdidx objid objid group
1 12644635 0xc0f11b 0
3 12492930 0xbea082 0

152
output/COUNT:1#NN:1#PPN:6#API:POSIX#T:102400.txt Normal file
View File

@ -0,0 +1,152 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:POSIX#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 01:29:43 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:29:43 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 25 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060864000.
WARNING: Using actual aggregate bytes moved = 60960972800.
write 916.90 26214400 100.00 0.001193 63.40 0.000175 63.41 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161059430400.
WARNING: Using actual aggregate bytes moved = 50419200000.
write 754.87 26214400 100.00 0.001385 63.70 0.000164 63.70 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161061273600.
WARNING: Using actual aggregate bytes moved = 58768588800.
write 879.53 26214400 100.00 0.001391 63.72 0.000157 63.72 2
Max Write: 916.90 MiB/sec (961.44 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 916.90 754.87 850.43 69.27 63.60897 0 6 6 3 1 0 1 0 0 1 26843545600 102400 60960972800 POSIX 0
Finished: Wed Oct 24 01:32:58 2018
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 6 -np 6 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:6#API:POSIX#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 01:33:07 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 26843545600 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:33:07 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 6 (6 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 25 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 966367641600.
WARNING: Using actual aggregate bytes moved = 4031488000.
read 64.04 26214400 100.00 0.000204 60.03 0.000173 60.03 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 966367641600.
WARNING: Using actual aggregate bytes moved = 4278784000.
read 67.99 26214400 100.00 0.000208 60.02 0.000152 60.02 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 966367641600.
WARNING: Using actual aggregate bytes moved = 4422758400.
read 70.27 26214400 100.00 0.000217 60.02 0.000169 60.02 2
Max Read: 70.27 MiB/sec (73.68 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 70.27 64.04 67.43 2.57 60.02534 0 6 6 3 1 0 1 0 0 1 26843545600 102400 4031488000 POSIX 0
Finished: Wed Oct 24 01:36:07 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000002
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12384991 0xbcfadf 0
6 12598246 0xc03be6 0
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 1
obdidx objid objid group
1 12644634 0xc0f11a 0
3 12492928 0xbea080 0
/esfs/jtacquaviva/ioperf/file_write.00000004
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 2
obdidx objid objid group
2 12572987 0xbfd93b 0
4 12514725 0xbef5a5 0
/esfs/jtacquaviva/ioperf/file_write.00000003
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 3
obdidx objid objid group
3 12492929 0xbea081 0
5 12384992 0xbcfae0 0
/esfs/jtacquaviva/ioperf/file_write.00000005
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 0
obdidx objid objid group
0 12426650 0xbd9d9a 0
2 12572988 0xbfd93c 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12514726 0xbef5a6 0
7 12463348 0xbe2cf4 0

104
output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:102400.txt Normal file
View File

@ -0,0 +1,104 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 00:57:49 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 00:57:49 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/ioperf/file_write
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 18.75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060147200.
WARNING: Using actual aggregate bytes moved = 14386278400.
write 223.36 19660800 100.00 0.008652 61.42 0.000296 61.42 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060147200.
WARNING: Using actual aggregate bytes moved = 14757171200.
write 231.38 19660800 100.00 0.020601 60.80 0.000238 60.82 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161060966400.
WARNING: Using actual aggregate bytes moved = 14609510400.
write 227.67 19660800 100.00 0.010475 61.19 0.000243 61.20 2
Max Write: 231.38 MiB/sec (242.62 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 231.38 223.36 227.47 3.28 61.14912 0 8 8 3 0 0 1 0 0 1 20132659200 102400 14386278400 MPIIO 0
Finished: Wed Oct 24 01:00:59 2018
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:MPIIO#T:102400.txt
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
ior WARNING: fsync() only available in POSIX. Using value of 0.
Began: Wed Oct 24 01:01:10 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 60 -a MPIIO -e -g -z -k -o /esfs/jtacquaviva/file_read -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 01:01:10 2018
Summary:
api = MPIIO (version=3, subversion=0)
test filename = /esfs/jtacquaviva/file_read
access = single-shared-file
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 18.75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 6008320000.
read 95.36 19660800 100.00 0.006084 60.08 0.000243 60.09 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 6281113600.
read 99.70 19660800 100.00 0.001106 60.08 0.000289 60.08 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 4517768724480.
WARNING: Using actual aggregate bytes moved = 6569676800.
read 104.29 19660800 100.00 0.001119 60.07 0.000213 60.08 2
Max Read: 104.29 MiB/sec (109.36 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 104.29 95.36 99.79 3.65 60.08071 0 8 8 3 0 0 1 0 0 1 20132659200 102400 6008320000 MPIIO 0
Finished: Wed Oct 24 01:04:11 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12384980 0xbcfad4 0
6 12598236 0xc03bdc 0

172
output/COUNT:1#NN:1#PPN:8#API:POSIX#T:102400.txt Normal file
View File

@ -0,0 +1,172 @@
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:POSIX#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 00:51:19 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/ioperf/file_write -w
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 00:51:19 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/ioperf/file_write
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 18.75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161059020800.
WARNING: Using actual aggregate bytes moved = 72529510400.
write 1090.36 19660800 100.00 0.001503 63.44 0.000231 63.44 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161059635200.
WARNING: Using actual aggregate bytes moved = 59135385600.
write 890.22 19660800 100.00 0.003580 63.34 0.000244 63.35 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 161059430400.
WARNING: Using actual aggregate bytes moved = 60045619200.
write 903.90 19660800 100.00 0.004637 63.35 0.000216 63.35 2
Max Write: 1090.36 MiB/sec (1143.32 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
write 1090.36 890.22 961.49 91.29 63.38006 0 8 8 3 1 0 1 0 0 1 20132659200 102400 72529510400 POSIX 0
Finished: Wed Oct 24 00:54:34 2018
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/git/ime-evaluation/drop_caches.sh
+ /opt/ddn/mvapich/bin/mpiexec -ppn 8 -np 8 -genv MV2_NUM_HCAS 1 -genv MV2_CPU_BINDING_LEVEL core -genv MV2_CPU_BINDING_POLICY scatter --hosts isc17-c04 /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
+ tee -a ./output/COUNT:1#NN:1#PPN:8#API:POSIX#T:102400.txt
IOR-3.0.1: MPI Coordinated Test of Parallel I/O
Began: Wed Oct 24 00:54:46 2018
Command line used: /esfs/jtacquaviva/software/install/ior/git-ddn/bin/ior -i 3 -s 1 -t 102400 -b 20132659200 -D 60 -a POSIX -F -e -g -z -k -o /esfs/jtacquaviva/indread1/file -r
Machine: Linux isc17-c04
Test 0 started: Wed Oct 24 00:54:46 2018
Summary:
api = POSIX
test filename = /esfs/jtacquaviva/indread1/file
access = file-per-process
ordering in a file = random offsets
ordering inter file= no tasks offsets
clients = 8 (8 per node)
repetitions = 3
xfersize = 102400 bytes
blocksize = 18.75 GiB
aggregate filesize = 150 GiB
Using stonewalling = 60 second(s)
access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 5145702400.
read 81.77 19660800 100.00 0.001214 60.01 0.000247 60.02 0
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 5171200000.
read 82.17 19660800 100.00 0.000245 60.02 0.000207 60.02 1
WARNING: Expected aggregate file size = 161061273600.
WARNING: Stat() of aggregate file size = 1288490188800.
WARNING: Using actual aggregate bytes moved = 5682585600.
read 90.29 19660800 100.00 0.000298 60.02 0.000214 60.02 2
Max Read: 90.29 MiB/sec (94.68 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum
read 90.29 81.77 84.74 3.93 60.01693 0 8 8 3 1 0 1 0 0 1 20132659200 102400 5145702400 POSIX 0
Finished: Wed Oct 24 00:57:46 2018
+ set +x
/esfs/jtacquaviva/ioperf
stripe_count: 2 stripe_size: 1048576 stripe_offset: -1
/esfs/jtacquaviva/ioperf/file_write.00000006
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 1
obdidx objid objid group
1 12644623 0xc0f10f 0
3 12492918 0xbea076 0
/esfs/jtacquaviva/ioperf/file_write.00000002
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12384979 0xbcfad3 0
6 12598235 0xc03bdb 0
/esfs/jtacquaviva/ioperf/file_write.00000000
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 2
obdidx objid objid group
2 12572977 0xbfd931 0
4 12514714 0xbef59a 0
/esfs/jtacquaviva/ioperf/file_write.00000004
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 4
obdidx objid objid group
4 12514715 0xbef59b 0
7 12463337 0xbe2ce9 0
/esfs/jtacquaviva/ioperf/file_write.00000007
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 6
obdidx objid objid group
6 12598234 0xc03bda 0
0 12426639 0xbd9d8f 0
/esfs/jtacquaviva/ioperf/file_write.00000003
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 7
obdidx objid objid group
7 12463336 0xbe2ce8 0
1 12644622 0xc0f10e 0
/esfs/jtacquaviva/ioperf/file_write.00000005
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 3
obdidx objid objid group
3 12492917 0xbea075 0
5 12384978 0xbcfad2 0
/esfs/jtacquaviva/ioperf/file_write.00000001
lmm_stripe_count: 2
lmm_stripe_size: 1048576
lmm_pattern: 1
lmm_layout_gen: 0
lmm_stripe_offset: 5
obdidx objid objid group
5 12384977 0xbcfad1 0
6 12598233 0xc03bd9 0