Lustre performance + LLNCS template update

This commit is contained in:
Eugen Betke 2018-10-25 14:40:49 +02:00
parent 3af9993a66
commit ef29801f64
19 changed files with 118 additions and 8547 deletions

View File

@ -43,6 +43,12 @@ names(ppn_lab) <- unique(dbdata$ppn)
breaks <- c(unique(dbdata$blocksize))
dbdata$lab_access <- dbdata$accesstype
dbdata$lab_access[dbdata$lab_access == "write"] = "Write"
dbdata$lab_access[dbdata$lab_access == "read"] = "Read"
fig_w = 4
fig_h = 4
@ -83,7 +89,7 @@ print(iotype)
p = ggplot(data=data, aes(x=nn, y=perf, colour=as.factor(blocksize/1024), group=blocksize), ymin=0) +
#ggtitle("Write") +
facet_grid(ppn ~ api + accesstype, labeller = labeller(nn = as_labeller(nn_lab), ppn = as_labeller(ppn_lab))) +
facet_grid(ppn ~ api + lab_access, labeller = labeller(nn = as_labeller(nn_lab), ppn = as_labeller(ppn_lab))) +
xlab("Nodes") +
ylab("Performance in MiB/s") +
theme(axis.text.x=element_text(angle=90, hjust=0.95, vjust=0.5)) +
@ -102,8 +108,8 @@ print(iotype)
filename_eps = sprintf("%s/performance_%s_%s_%s_%s_%s.eps", folder_out, app, fs, iotype, "write", scale)
filename_png = sprintf("%s/performance_%s_%s_%s_%s_%s.png", folder_out, app, fs, iotype, "write", scale)
ggsave(filename_png, width = 10, height = 6)
ggsave(filename_eps, width = 10, height = 6)
ggsave(filename_png, width = 10, height = 8)
ggsave(filename_eps, width = 10, height = 8)
#system(sprintf("epstopdf %s", filename_eps))
system(sprintf("rm %s", filename_eps))

View File

@ -1,88 +0,0 @@
%%
%% This is file `aliascnt.sty',
%% generated with the docstrip utility.
%%
%% The original source files were:
%%
%% aliascnt.dtx (with options: `package')
%%
%% This is a generated file.
%%
%% Project: aliascnt
%% Version: 2009/09/08 v1.3
%%
%% Copyright (C) 2006, 2009 by
%% Heiko Oberdiek <heiko.oberdiek at googlemail.com>
%%
%% This work may be distributed and/or modified under the
%% conditions of the LaTeX Project Public License, either
%% version 1.3c of this license or (at your option) any later
%% version. This version of this license is in
%% http://www.latex-project.org/lppl/lppl-1-3c.txt
%% and the latest version of this license is in
%% http://www.latex-project.org/lppl.txt
%% and version 1.3 or later is part of all distributions of
%% LaTeX version 2005/12/01 or later.
%%
%% This work has the LPPL maintenance status "maintained".
%%
%% This Current Maintainer of this work is Heiko Oberdiek.
%%
%% This work consists of the main source file aliascnt.dtx
%% and the derived files
%% aliascnt.sty, aliascnt.pdf, aliascnt.ins, aliascnt.drv.
%%
\NeedsTeXFormat{LaTeX2e}
\ProvidesPackage{aliascnt}%
[2009/09/08 v1.3 Alias counter (HO)]%
\newcommand*{\newaliascnt}[2]{%
\begingroup
\def\AC@glet##1{%
\global\expandafter\let\csname##1#1\expandafter\endcsname
\csname##1#2\endcsname
}%
\@ifundefined{c@#2}{%
\@nocounterr{#2}%
}{%
\expandafter\@ifdefinable\csname c@#1\endcsname{%
\AC@glet{c@}%
\AC@glet{the}%
\AC@glet{theH}%
\AC@glet{p@}%
\expandafter\gdef\csname AC@cnt@#1\endcsname{#2}%
\expandafter\gdef\csname cl@#1\expandafter\endcsname
\expandafter{\csname cl@#2\endcsname}%
}%
}%
\endgroup
}
\newcommand*{\aliascntresetthe}[1]{%
\@ifundefined{AC@cnt@#1}{%
\PackageError{aliascnt}{%
`#1' is not an alias counter%
}\@ehc
}{%
\expandafter\let\csname the#1\expandafter\endcsname
\csname the\csname AC@cnt@#1\endcsname\endcsname
}%
}
\newcommand*{\AC@findrootcnt}[1]{%
\@ifundefined{AC@cnt@#1}{%
#1%
}{%
\expandafter\AC@findrootcnt\csname AC@cnt@#1\endcsname
}%
}
\def\AC@patch#1{%
\expandafter\let\csname AC@org@#1reset\expandafter\endcsname
\csname @#1reset\endcsname
\expandafter\def\csname @#1reset\endcsname##1##2{%
\csname AC@org@#1reset\endcsname{##1}{\AC@findrootcnt{##2}}%
}%
}
\RequirePackage{remreset}
\AC@patch{addto}
\AC@patch{removefrom}
\endinput
%%
%% End of file `aliascnt.sty'.

View File

@ -88,7 +88,7 @@ Version history for the LLNCS LaTeX2e class
Saverio Cittadini, Istituto Tecnico
Industriale "Tito Sarrocchi" - Siena
28.01.02 llncs.cls 2.12 fixed footnote fix ; error reported by
28.01.02 llncs.cls 2.12 fixed footnote fix; error reported by
Chris Mesterharm, CS Dept. Rutgers - NJ
28.01.02 llncs.cls 2.13 fixed the fix (programmer needs vacation)
@ -127,3 +127,13 @@ Version history for the LLNCS LaTeX2e class
by Bastian Pfleging, University of Stuttgart
04.09.17 llncs.cls 2.19 introduced \orcidID command
10.03.18 llncs.cls 2.20 adjusted \doi according to CrossRef requirements;
TOC: removed affiliation numbers
splncs04.bst added doi field;
bold journal numbers
samplepaper.tex new sample paper
llncsdoc.pdf new LaTeX class documentation

View File

@ -1,4 +1,4 @@
% LLNCS DOCUMENT CLASS -- version 2.19 (04-Sep-2017)
% LLNCS DOCUMENT CLASS -- version 2.20 (10-Mar-2018)
% Springer Verlag LaTeX2e support for Lecture Notes in Computer Science
%
%%
@ -19,7 +19,7 @@
%% Right brace \} Tilde \~}
%%
\NeedsTeXFormat{LaTeX2e}[1995/12/01]
\ProvidesClass{llncs}[2017/09/04 v2.19
\ProvidesClass{llncs}[2018/03/10 v2.20
^^J LaTeX document class for Lecture Notes in Computer Science]
% Options
\let\if@envcntreset\iffalse
@ -875,9 +875,10 @@ to0pt{\kern0.55\wd0\vrule height0.45\ht0\hss}\box0}}}}
\or \ddagger\ddagger \else\@ctrerr\fi}}
\def\inst#1{\unskip$^{#1}$}
\def\orcidID#1{\unskip$^{[#1]}$}
\def\orcidID#1{\unskip$^{[#1]}$} % added MR 2018-03-10
\def\fnmsep{\unskip$^,$}
\def\email#1{{\tt#1}}
\AtBeginDocument{\@ifundefined{url}{\def\url#1{#1}}{}%
\@ifpackageloaded{babel}{%
\@ifundefined{extrasenglish}{}{\addto\extrasenglish{\switcht@albion}}%
@ -885,8 +886,12 @@ to0pt{\kern0.55\wd0\vrule height0.45\ht0\hss}\box0}}}}
\@ifundefined{extrasgerman}{}{\addto\extrasgerman{\switcht@deutsch}}%
\@ifundefined{extrasngerman}{}{\addto\extrasngerman{\switcht@deutsch}}%
}{\switcht@@therlang}%
\providecommand{\keywords}[1]{\par\addvspace\baselineskip
\providecommand{\keywords}[1]{\def\and{{\textperiodcentered} }%
\par\addvspace\baselineskip
\noindent\keywordname\enspace\ignorespaces#1}%
\@ifpackageloaded{hyperref}{%
\def\doi#1{\href{https://doi.org/#1}{https://doi.org/#1}}}{
\def\doi#1{https://doi.org/#1}}
}
\def\homedir{\~{ }}
@ -947,6 +952,8 @@ to0pt{\kern0.55\wd0\vrule height0.45\ht0\hss}\box0}}}}
%
\if!\the\tocauthor!\relax
{\def\and{\noexpand\protect\noexpand\and}%
\def\inst##1{}% added MR 2017-09-20 to remove inst numbers from the TOC
\def\orcidID##1{}% added MR 2017-09-20 to remove ORCID ids from the TOC
\protected@xdef\toc@uthor{\@author}}%
\else
\def\\{\noexpand\protect\noexpand\newline}%
@ -962,7 +969,9 @@ to0pt{\kern0.55\wd0\vrule height0.45\ht0\hss}\box0}}}}
\else
\edef\@author{\the\authorrunning}%
\fi
\global\setbox\authrun=\hbox{\small\unboldmath\@author\unskip}%
\global\setbox\authrun=\hbox{\def\inst##1{}% added MR 2017-09-20 to remove inst numbers from the runninghead
\def\orcidID##1{}% added MR 2017-09-20 to remove ORCID ids from the runninghead
\small\unboldmath\@author\unskip}%
\ifdim\wd\authrun>\instindent
\typeout{Names of authors too long for running head. Please supply}%
\typeout{a shorter form with \string\authorrunning\space prior to

File diff suppressed because it is too large Load Diff

File diff suppressed because it is too large Load Diff

Binary file not shown.

View File

@ -1,349 +0,0 @@
% This is LLNCS.IND the handmade demonstration
% file for an author index from Springer-Verlag
% for Lecture Notes in Computer Science,
% version 2.2 for LaTeX2e
%
\begin{theindex}
\item Abt~I. \idxquad{7}
\item Ahmed~T. \idxquad{3}
\item Andreev~V. \idxquad{24}
\item Andrieu~B. \idxquad{27}
\item Arpagaus~M. \idxquad{34}
\indexspace
\item Babaev~A. \idxquad{25}
\item B\"arwolff~A. \idxquad{33}
\item B\'an~J. \idxquad{17}
\item Baranov~P. \idxquad{24}
\item Barrelet~E. \idxquad{28}
\item Bartel~W. \idxquad{11}
\item Bassler~U. \idxquad{28}
\item Beck~H.P. \idxquad{35}
\item Behrend~H.-J. \idxquad{11}
\item Berger~Ch. \idxquad{1}
\item Bergstein~H. \idxquad{1}
\item Bernardi~G. \idxquad{28}
\item Bernet~R. \idxquad{34}
\item Besan\c con~M. \idxquad{9}
\item Biddulph~P. \idxquad{22}
\item Binder~E. \idxquad{11}
\item Bischoff~A. \idxquad{33}
\item Blobel~V. \idxquad{13}
\item Borras~K. \idxquad{8}
\item Bosetti~P.C. \idxquad{2}
\item Boudry~V. \idxquad{27}
\item Brasse~F. \idxquad{11}
\item Braun~U. \idxquad{2}
\item Braunschweig~A. \idxquad{1}
\item Brisson~V. \idxquad{26}
\item B\"ungener~L. \idxquad{13}
\item B\"urger~J. \idxquad{11}
\item B\"usser~F.W. \idxquad{13}
\item Buniatian~A. \idxquad{11,37}
\item Buschhorn~G. \idxquad{25}
\indexspace
\item Campbell~A.J. \idxquad{1}
\item Carli~T. \idxquad{25}
\item Charles~F. \idxquad{28}
\item Clarke~D. \idxquad{5}
\item Clegg~A.B. \idxquad{18}
\item Colombo~M. \idxquad{8}
\item Courau~A. \idxquad{26}
\item Coutures~Ch. \idxquad{9}
\item Cozzika~G. \idxquad{9}
\item Criegee~L. \idxquad{11}
\item Cvach~J. \idxquad{27}
\indexspace
\item Dagoret~S. \idxquad{28}
\item Dainton~J.B. \idxquad{19}
\item Dann~A.W.E. \idxquad{22}
\item Dau~W.D. \idxquad{16}
\item Deffur~E. \idxquad{11}
\item Delcourt~B. \idxquad{26}
\item Buono~Del~A. \idxquad{28}
\item Devel~M. \idxquad{26}
\item De Roeck~A. \idxquad{11}
\item Dingus~P. \idxquad{27}
\item Dollfus~C. \idxquad{35}
\item Dreis~H.B. \idxquad{2}
\item Drescher~A. \idxquad{8}
\item D\"ullmann~D. \idxquad{13}
\item D\"unger~O. \idxquad{13}
\item Duhm~H. \idxquad{12}
\indexspace
\item Ebbinghaus~R. \idxquad{8}
\item Eberle~M. \idxquad{12}
\item Ebert~J. \idxquad{32}
\item Ebert~T.R. \idxquad{19}
\item Efremenko~V. \idxquad{23}
\item Egli~S. \idxquad{35}
\item Eichenberger~S. \idxquad{35}
\item Eichler~R. \idxquad{34}
\item Eisenhandler~E. \idxquad{20}
\item Ellis~N.N. \idxquad{3}
\item Ellison~R.J. \idxquad{22}
\item Elsen~E. \idxquad{11}
\item Evrard~E. \idxquad{4}
\indexspace
\item Favart~L. \idxquad{4}
\item Feeken~D. \idxquad{13}
\item Felst~R. \idxquad{11}
\item Feltesse~A. \idxquad{9}
\item Fensome~I.F. \idxquad{3}
\item Ferrarotto~F. \idxquad{31}
\item Flamm~K. \idxquad{11}
\item Flauger~W. \idxquad{11}
\item Flieser~M. \idxquad{25}
\item Fl\"ugge~G. \idxquad{2}
\item Fomenko~A. \idxquad{24}
\item Fominykh~B. \idxquad{23}
\item Form\'anek~J. \idxquad{30}
\item Foster~J.M. \idxquad{22}
\item Franke~G. \idxquad{11}
\item Fretwurst~E. \idxquad{12}
\indexspace
\item Gabathuler~E. \idxquad{19}
\item Gamerdinger~K. \idxquad{25}
\item Garvey~J. \idxquad{3}
\item Gayler~J. \idxquad{11}
\item Gellrich~A. \idxquad{13}
\item Gennis~M. \idxquad{11}
\item Genzel~H. \idxquad{1}
\item Godfrey~L. \idxquad{7}
\item Goerlach~U. \idxquad{11}
\item Goerlich~L. \idxquad{6}
\item Gogitidze~N. \idxquad{24}
\item Goodall~A.M. \idxquad{19}
\item Gorelov~I. \idxquad{23}
\item Goritchev~P. \idxquad{23}
\item Grab~C. \idxquad{34}
\item Gr\"assler~R. \idxquad{2}
\item Greenshaw~T. \idxquad{19}
\item Greif~H. \idxquad{25}
\item Grindhammer~G. \idxquad{25}
\indexspace
\item Haack~J. \idxquad{33}
\item Haidt~D. \idxquad{11}
\item Hamon~O. \idxquad{28}
\item Handschuh~D. \idxquad{11}
\item Hanlon~E.M. \idxquad{18}
\item Hapke~M. \idxquad{11}
\item Harjes~J. \idxquad{11}
\item Haydar~R. \idxquad{26}
\item Haynes~W.J. \idxquad{5}
\item Hedberg~V. \idxquad{21}
\item Heinzelmann~G. \idxquad{13}
\item Henderson~R.C.W. \idxquad{18}
\item Henschel~H. \idxquad{33}
\item Herynek~I. \idxquad{29}
\item Hildesheim~W. \idxquad{11}
\item Hill~P. \idxquad{11}
\item Hilton~C.D. \idxquad{22}
\item Hoeger~K.C. \idxquad{22}
\item Huet~Ph. \idxquad{4}
\item Hufnagel~H. \idxquad{14}
\item Huot~N. \idxquad{28}
\indexspace
\item Itterbeck~H. \idxquad{1}
\indexspace
\item Jabiol~M.-A. \idxquad{9}
\item Jacholkowska~A. \idxquad{26}
\item Jacobsson~C. \idxquad{21}
\item Jansen~T. \idxquad{11}
\item J\"onsson~L. \idxquad{21}
\item Johannsen~A. \idxquad{13}
\item Johnson~D.P. \idxquad{4}
\item Jung~H. \idxquad{2}
\indexspace
\item Kalmus~P.I.P. \idxquad{20}
\item Kasarian~S. \idxquad{11}
\item Kaschowitz~R. \idxquad{2}
\item Kathage~U. \idxquad{16}
\item Kaufmann~H. \idxquad{33}
\item Kenyon~I.R. \idxquad{3}
\item Kermiche~S. \idxquad{26}
\item Kiesling~C. \idxquad{25}
\item Klein~M. \idxquad{33}
\item Kleinwort~C. \idxquad{13}
\item Knies~G. \idxquad{11}
\item Ko~W. \idxquad{7}
\item K\"ohler~T. \idxquad{1}
\item Kolanoski~H. \idxquad{8}
\item Kole~F. \idxquad{7}
\item Kolya~S.D. \idxquad{22}
\item Korbel~V. \idxquad{11}
\item Korn~M. \idxquad{8}
\item Kostka~P. \idxquad{33}
\item Kotelnikov~S.K. \idxquad{24}
\item Krehbiel~H. \idxquad{11}
\item Kr\"ucker~D. \idxquad{2}
\item Kr\"uger~U. \idxquad{11}
\item Kubenka~J.P. \idxquad{25}
\item Kuhlen~M. \idxquad{25}
\item Kur\v{c}a~T. \idxquad{17}
\item Kurzh\"ofer~J. \idxquad{8}
\item Kuznik~B. \idxquad{32}
\indexspace
\item Lamarche~F. \idxquad{27}
\item Lander~R. \idxquad{7}
\item Landon~M.P.J. \idxquad{20}
\item Lange~W. \idxquad{33}
\item Lanius~P. \idxquad{25}
\item Laporte~J.F. \idxquad{9}
\item Lebedev~A. \idxquad{24}
\item Leuschner~A. \idxquad{11}
\item Levonian~S. \idxquad{11,24}
\item Lewin~D. \idxquad{11}
\item Ley~Ch. \idxquad{2}
\item Lindner~A. \idxquad{8}
\item Lindstr\"om~G. \idxquad{12}
\item Linsel~F. \idxquad{11}
\item Lipinski~J. \idxquad{13}
\item Loch~P. \idxquad{11}
\item Lohmander~H. \idxquad{21}
\item Lopez~G.C. \idxquad{20}
\indexspace
\item Magnussen~N. \idxquad{32}
\item Mani~S. \idxquad{7}
\item Marage~P. \idxquad{4}
\item Marshall~R. \idxquad{22}
\item Martens~J. \idxquad{32}
\item Martin~A.@ \idxquad{19}
\item Martyn~H.-U. \idxquad{1}
\item Martyniak~J. \idxquad{6}
\item Masson~S. \idxquad{2}
\item Mavroidis~A. \idxquad{20}
\item McMahon~S.J. \idxquad{19}
\item Mehta~A. \idxquad{22}
\item Meier~K. \idxquad{15}
\item Mercer~D. \idxquad{22}
\item Merz~T. \idxquad{11}
\item Meyer~C.A. \idxquad{35}
\item Meyer~H. \idxquad{32}
\item Meyer~J. \idxquad{11}
\item Mikocki~S. \idxquad{6,26}
\item Milone~V. \idxquad{31}
\item Moreau~F. \idxquad{27}
\item Moreels~J. \idxquad{4}
\item Morris~J.V. \idxquad{5}
\item M\"uller~K. \idxquad{35}
\item Murray~S.A. \idxquad{22}
\indexspace
\item Nagovizin~V. \idxquad{23}
\item Naroska~B. \idxquad{13}
\item Naumann~Th. \idxquad{33}
\item Newton~D. \idxquad{18}
\item Neyret~D. \idxquad{28}
\item Nguyen~A. \idxquad{28}
\item Niebergall~F. \idxquad{13}
\item Nisius~R. \idxquad{1}
\item Nowak~G. \idxquad{6}
\item Nyberg~M. \idxquad{21}
\indexspace
\item Oberlack~H. \idxquad{25}
\item Obrock~U. \idxquad{8}
\item Olsson~J.E. \idxquad{11}
\item Ould-Saada~F. \idxquad{13}
\indexspace
\item Pascaud~C. \idxquad{26}
\item Patel~G.D. \idxquad{19}
\item Peppel~E. \idxquad{11}
\item Phillips~H.T. \idxquad{3}
\item Phillips~J.P. \idxquad{22}
\item Pichler~Ch. \idxquad{12}
\item Pilgram~W. \idxquad{2}
\item Pitzl~D. \idxquad{34}
\item Prell~S. \idxquad{11}
\item Prosi~R. \idxquad{11}
\indexspace
\item R\"adel~G. \idxquad{11}
\item Raupach~F. \idxquad{1}
\item Rauschnabel~K. \idxquad{8}
\item Reinshagen~S. \idxquad{11}
\item Ribarics~P. \idxquad{25}
\item Riech~V. \idxquad{12}
\item Riedlberger~J. \idxquad{34}
\item Rietz~M. \idxquad{2}
\item Robertson~S.M. \idxquad{3}
\item Robmann~P. \idxquad{35}
\item Roosen~R. \idxquad{4}
\item Royon~C. \idxquad{9}
\item Rudowicz~M. \idxquad{25}
\item Rusakov~S. \idxquad{24}
\item Rybicki~K. \idxquad{6}
\indexspace
\item Sahlmann~N. \idxquad{2}
\item Sanchez~E. \idxquad{25}
\item Savitsky~M. \idxquad{11}
\item Schacht~P. \idxquad{25}
\item Schleper~P. \idxquad{14}
\item von Schlippe~W. \idxquad{20}
\item Schmidt~D. \idxquad{32}
\item Schmitz~W. \idxquad{2}
\item Sch\"oning~A. \idxquad{11}
\item Schr\"oder~V. \idxquad{11}
\item Schulz~M. \idxquad{11}
\item Schwab~B. \idxquad{14}
\item Schwind~A. \idxquad{33}
\item Seehausen~U. \idxquad{13}
\item Sell~R. \idxquad{11}
\item Semenov~A. \idxquad{23}
\item Shekelyan~V. \idxquad{23}
\item Shooshtari~H. \idxquad{25}
\item Shtarkov~L.N. \idxquad{24}
\item Siegmon~G. \idxquad{16}
\item Siewert~U. \idxquad{16}
\item Skillicorn~I.O. \idxquad{10}
\item Smirnov~P. \idxquad{24}
\item Smith~J.R. \idxquad{7}
\item Smolik~L. \idxquad{11}
\item Spitzer~H. \idxquad{13}
\item Staroba~P. \idxquad{29}
\item Steenbock~M. \idxquad{13}
\item Steffen~P. \idxquad{11}
\item Stella~B. \idxquad{31}
\item Stephens~K. \idxquad{22}
\item St\"osslein~U. \idxquad{33}
\item Strachota~J. \idxquad{11}
\item Straumann~U. \idxquad{35}
\item Struczinski~W. \idxquad{2}
\indexspace
\item Taylor~R.E. \idxquad{36,26}
\item Tchernyshov~V. \idxquad{23}
\item Thiebaux~C. \idxquad{27}
\item Thompson~G. \idxquad{20}
\item Tru\"ol~P. \idxquad{35}
\item Turnau~J. \idxquad{6}
\indexspace
\item Urban~L. \idxquad{25}
\item Usik~A. \idxquad{24}
\indexspace
\item Valkarova~A. \idxquad{30}
\item Vall\'ee~C. \idxquad{28}
\item Van Esch~P. \idxquad{4}
\item Vartapetian~A. \idxquad{11}
\item Vazdik~Y. \idxquad{24}
\item Verrecchia~P. \idxquad{9}
\item Vick~R. \idxquad{13}
\item Vogel~E. \idxquad{1}
\indexspace
\item Wacker~K. \idxquad{8}
\item Walther~A. \idxquad{8}
\item Weber~G. \idxquad{13}
\item Wegner~A. \idxquad{11}
\item Wellisch~H.P. \idxquad{25}
\item West~L.R. \idxquad{3}
\item Willard~S. \idxquad{7}
\item Winde~M. \idxquad{33}
\item Winter~G.-G. \idxquad{11}
\item Wolff~Th. \idxquad{34}
\item Wright~A.E. \idxquad{22}
\item Wulff~N. \idxquad{11}
\indexspace
\item Yiou~T.P. \idxquad{28}
\indexspace
\item \v{Z}\'a\v{c}ek~J. \idxquad{30}
\item Zeitnitz~C. \idxquad{12}
\item Ziaeepour~H. \idxquad{26}
\item Zimmer~M. \idxquad{11}
\item Zimmermann~W. \idxquad{11}
\end{theindex}

Binary file not shown.

View File

@ -1,42 +0,0 @@
% This is LLNCSDOC.STY the modification of the
% LLNCS class file for the documentation of
% the class itself.
%
\def\AmS{{\protect\usefont{OMS}{cmsy}{m}{n}%
A\kern-.1667em\lower.5ex\hbox{M}\kern-.125emS}}
\def\AmSTeX{{\protect\AmS-\protect\TeX}}
%
\def\ps@myheadings{\let\@mkboth\@gobbletwo
\def\@oddhead{\hbox{}\hfil\small\rm\rightmark
\qquad\thepage}%
\def\@oddfoot{}\def\@evenhead{\small\rm\thepage\qquad
\leftmark\hfil}%
\def\@evenfoot{}\def\sectionmark##1{}\def\subsectionmark##1{}}
\ps@myheadings
%
\setcounter{tocdepth}{2}
%
\renewcommand{\labelitemi}{--}
\newenvironment{alpherate}%
{\renewcommand{\labelenumi}{\alph{enumi})}\begin{enumerate}}%
{\end{enumerate}\renewcommand{\labelenumi}{enumi}}
%
\def\bibauthoryear{\begingroup
\def\thebibliography##1{\section*{References}%
\small\list{}{\settowidth\labelwidth{}\leftmargin\parindent
\itemindent=-\parindent
\labelsep=\z@
\usecounter{enumi}}%
\def\newblock{\hskip .11em plus .33em minus -.07em}%
\sloppy
\sfcode`\.=1000\relax}%
\def\@cite##1{##1}%
\def\@lbibitem[##1]##2{\item[]\if@filesw
{\def\protect####1{\string ####1\space}\immediate
\write\@auxout{\string\bibcite{##2}{##1}}}\fi\ignorespaces}%
\begin{thebibliography}{}
\bibitem[1982]{clar:eke3} Clarke, F., Ekeland, I.: Nonlinear
oscillations and boundary-value problems for Hamiltonian systems.
Arch. Rat. Mech. Anal. 78, 315--333 (1982)
\end{thebibliography}
\endgroup}

View File

@ -11,24 +11,9 @@ It consists of the following files:
llncs.cls the LaTeX2e document class
llncs.dem the sample input file
samplepaper.tex a sample paper
fig1.eps a figure used in the sample paper
llncs.doc the documentation of the class (LaTeX source)
llncsdoc.pdf the documentation of the class (PDF version)
llncsdoc.sty the modification of the class for the documentation
llncs.ind an external (faked) author index file
subjidx.ind subject index demo from the Springer book package
llncs.dvi the resulting DVI file (remember to use binary transfer!)
sprmindx.sty supplementary style file for MakeIndex
(usage: makeindex -s sprmindx.sty <yourfile.idx>)
splncs.bst old BibTeX style for use with llncs.cls
splncs_srt.bst ditto with alphabetic sorting
splncs03.bst current LNCS BibTeX style with alphabetic sorting
aliascnt.sty part of the Oberdiek bundle; allows more control over
the counters associated to any numbered item
remreset.sty by David Carlisle
splncs04.bst current LNCS BibTeX style with alphabetic sorting

View File

@ -1,39 +0,0 @@
% remreset package
%%%%%%%%%%%%%%%%%%
% Copyright 1997 David carlisle
% This file may be distributed under the terms of the LPPL.
% See 00readme.txt for details.
% 1997/09/28 David Carlisle
% LaTeX includes a command \@addtoreset that is used to declare that
% a counter should be reset every time a second counter is incremented.
% For example the book class has a line
% \@addtoreset{footnote}{chapter}
% So that the footnote counter is reset each chapter.
% If you wish to bas a new class on book, but without this counter
% being reset, then standard LaTeX gives no simple mechanism to do
% this.
% This package defines |\@removefromreset| which just undoes the effect
% of \@addtorest. So for example a class file may be defined by
% \LoadClass{book}
% \@removefromreset{footnote}{chapter}
\def\@removefromreset#1#2{{%
\expandafter\let\csname c@#1\endcsname\@removefromreset
\def\@elt##1{%
\expandafter\ifx\csname c@##1\endcsname\@removefromreset
\else
\noexpand\@elt{##1}%
\fi}%
\expandafter\xdef\csname cl@#2\endcsname{%
\csname cl@#2\endcsname}}}

File diff suppressed because it is too large Load Diff

File diff suppressed because it is too large Load Diff

File diff suppressed because it is too large Load Diff

View File

@ -1,4 +0,0 @@
delim_0 "\\idxquad "
delim_1 "\\idxquad "
delim_2 "\\idxquad "
delim_n ",\\,"

View File

@ -1,70 +0,0 @@
% clmomu01.ind
%-----------------------------------------------------------------------
% CLMoMu01 1.0: LaTeX style files for books
% Sample index file for User's guide
% (c) Springer-Verlag HD
%-----------------------------------------------------------------------
\begin{theindex}
\item Absorption\idxquad 327
\item Absorption of radiation \idxquad 289--292,\, 299,\,300
\item Actinides \idxquad 244
\item Aharonov-Bohm effect\idxquad 142--146
\item Angular momentum\idxquad 101--112
\subitem algebraic treatment\idxquad 391--396
\item Angular momentum addition\idxquad 185--193
\item Angular momentum commutation relations\idxquad 101
\item Angular momentum quantization\idxquad 9--10,\,104--106
\item Angular momentum states\idxquad 107,\,321,\,391--396
\item Antiquark\idxquad 83
\item $\alpha$-rays\idxquad 101--103
\item Atomic theory\idxquad 8--10,\,219--249,\,327
\item Average value\newline ({\it see also\/} Expectation value)
15--16,\,25,\,34,\,37,\,357
\indexspace
\item Baker-Hausdorff formula\idxquad 23
\item Balmer formula\idxquad 8
\item Balmer series\idxquad 125
\item Baryon\idxquad 220,\,224
\item Basis\idxquad 98
\item Basis system\idxquad 164,\,376
\item Bell inequality\idxquad 379--381,\,382
\item Bessel functions\idxquad 201,\,313,\,337
\subitem spherical\idxquad 304--306,\, 309,\, 313--314,\,322
\item Bound state\idxquad 73--74,\,78--79,\,116--118,\,202,\, 267,\,
273,\,306,\,348,\,351
\item Boundary conditions\idxquad 59,\, 70
\item Bra\idxquad 159
\item Breit-Wigner formula\idxquad 80,\,84,\,332
\item Brillouin-Wigner perturbation theory\idxquad 203
\indexspace
\item Cathode rays\idxquad 8
\item Causality\idxquad 357--359
\item Center-of-mass frame\idxquad 232,\,274,\,338
\item Central potential\idxquad 113--135,\,303--314
\item Centrifugal potential\idxquad 115--116,\,323
\item Characteristic function\idxquad 33
\item Clebsch-Gordan coefficients\idxquad 191--193
\item Cold emission\idxquad 88
\item Combination principle, Ritz's\idxquad 124
\item Commutation relations\idxquad 27,\,44,\,353,\,391
\item Commutator\idxquad 21--22,\,27,\,44,\,344
\item Compatibility of measurements\idxquad 99
\item Complete orthonormal set\idxquad 31,\,40,\,160,\,360
\item Complete orthonormal system, {\it see}\newline
Complete orthonormal set
\item Complete set of observables, {\it see\/} Complete
set of operators
\indexspace
\item Eigenfunction\idxquad 34,\,46,\,344--346
\subitem radial\idxquad 321
\subsubitem calculation\idxquad 322--324
\item EPR argument\idxquad 377--378
\item Exchange term\idxquad 228,\,231,\,237,\,241,\,268,\,272
\indexspace
\item $f$-sum rule\idxquad 302
\item Fermi energy\idxquad 223
\indexspace
\item H$^+_2$ molecule\idxquad 26
\item Half-life\idxquad 65
\item Holzwarth energies\idxquad 68
\end{theindex}

View File

@ -1,4 +1,5 @@
\documentclass{./llncs2e/llncs}
%\documentclass{article}
\usepackage{silence}
\WarningFilter{latex}{Text page}
@ -6,15 +7,20 @@
\WarningFilter{amsmath}{Unable}
\usepackage{color}
\usepackage{soul}
\usepackage{todonotes}
\newcommand{\jk}[1]{\todo[inline]{JK: #1}}
%\usepackage{silence}
\newcommand{\eb}[1]{\todo[inline]{EB: #1}}
\usepackage{silence}
\WarningFilter{latex}{Float}
\WarningFilter{llncs}{The remreset package is obsolete}
%\WarningFilter{latex}{Marginpar}
%\WarningFilter{latexfont}{Font shape}
%\WarningFilter{latexfont}{Some font}
%\usepackage{changes}
\usepackage{lmodern}
\usepackage{booktabs}
%\usepackage{booktabs}
%\usepackage{caption}
\usepackage{subcaption}
@ -29,47 +35,17 @@
\usepackage{xcolor}
\usepackage{float}
\graphicspath{
{./fig/}
%{/home/joobog/git/bull-io/mpio/ddnime-benchmark/ime_eval/}
%{/home/joobog/git/bull-io/mpio/ddnime-benchmark/ime_eval/info/}
{./fig/}
{../benchmark/eval_analysis_output/}
}
%
%\usepackage{makeidx} % allows for indexgeneration
%
\newcolumntype{P}[1]{>{\raggedright\let\newline\\\arraybackslash\hspace{0pt}}m{#1\textwidth}}
%\newcolumntype{P}[1]{>{\raggedright\let\newline\\\arraybackslash\hspace{0pt}}m{#1\textwidth}}
\begin{document}
%
%\frontmatter % for the preliminaries
%
\pagestyle{headings} % switches on printing of running heads
%\addtocmark{Hamiltonian Mechanics} % additional mark in the TOC
%
%\tableofcontents
%
%\mainmatter % start of the contributions
%
%\title{An MPI-IO In-Memory Driver for Non-Volatile Pooled Memory of the Kove XPD} % -- TODO page limit 18 pages
%\title{Burst Buffer for climate applications}
\title{Benefit of DDN's IME-FUSE for I/O intensive HPC applications.}
%
%\titlerunning{Hamiltonian Mechanics} % abbreviated title (for running head)
% also used for the TOC unless
% \toctitle is used
%
%\author{Double blind}
\author{Eugen Betke\inst{1} \and Julian Kunkel\inst{2}}
%
%\authorrunning{Ivar Ekeland et al.} % abbreviated author list (for running head)
%\institute{Double blind}
%\institute{Deutsches Klimarechenzentrum, Hamburg HH 20146, Germany,\\
%\email{betke@dkrz.de},\\ Home page:
%\texttt{http://dkrz.de}
%\and
%University of Reading, Whiteknights, PO Box 217, Reading, Berkshire, RG6 6AH, United Kingdom,\\
%\email{j.m.kunkel@reading.ac.uk},\\ Home page:
%\texttt{https://www.reading.ac.uk}}
\institute{Deutsches Klimarechenzentrum, Hamburg, Germany,\\
\email{betke@dkrz.de}
@ -89,7 +65,6 @@ The evaluation enables data centers choosing the right products and system archi
This paper investigates the native performance of DDN-IME, a flash-based burst buffer solution.
Then, it takes a closer look at the IME-FUSE file systems, which uses IMEs as burst buffer and a Lustre file system as back-end.
%\jk{Aber nicht nur IME-FUSE, oder? Hinten sind ja andere auch untersucht.}
Finally, by utilizing a NetCDF benchmark, it estimates the performance benefit for climate applications.
\end{abstract}
@ -98,7 +73,6 @@ Finally, by utilizing a NetCDF benchmark, it estimates the performance benefit f
\section{Introduction}
%Since we understand that, the architecture of the next generation HPC shall consider that fact.
The dilemma of conventional high-performance storage systems based on HDDs is that they must maximize the throughput to reduce application run times and at the same time they shall minimize the provided bandwidth to reduce costs.
The first requirement is often prioritized to the detriment of the second one, which typically ends up in the oversizing and in a low average usage of the bandwidth procured.
The prioritization is motivated by the requirement to process large performance peaks particular due to checkpoint/restart workloads, that often occur in large-scale applications.
@ -223,6 +197,7 @@ Therefore, the performance values include open/close times (see \Cref{eq:ior_ddn
\begin{equation}\label{eq:ior_ddn}
\text{perf}_\text{IME-native} = \frac{\text{filesize}}{t_{\text{total}}} = \frac{\text{filesize}}{t_{\text{open}} + t_{\text{io}} + t_{\text{close}}}
\end{equation}
\eb{Fixing IOR to make it report open, close, connection and I/O times}
Since the IOR benchmarks does not support NetCDF, and HDF5 is only supported with limited configuration of the pattern,
additionally, the NetCDF-Bench has been used\footnote{\url{https://github.com/joobog/netcdf-bench}}.
@ -241,9 +216,9 @@ On the DDN cluster, we use NetCDF-Bench, IOR, and IME-IOR to measure the IME's t
Each test configuration is repeated 10 times.
All experiments are conducted with block sizes 16, 100, 1024, and 10240~KiB.
To find the performance limits of the test system we use the IOR benchmarks.
For that purpose, we conduct a series of experiments with various parameters, where we measure the performance for \{read, write\} $\times$ \{random, sequential\} $\times$ \{POSIX, MPIIO\} $\times$ \{Lustre, IME-FUSE, IME-native\} $\times$ \{collective, independent\}.
The stripe count on Lustre is twice as large as the number of nodes.
\hl{To find the performance limits of the test system we use the IOR benchmarks.
For that purpose, we conduct a series of experiments with various parameters, where we measure the performance for \{read, write\} $\times$ \{POSIX, MPIIO\} $\times$ \{Lustre, IME-FUSE, IME-native\} $\times$ \{shared file, independent files\}.
The stripe count on Lustre is twice as large as the number of nodes, but is limited by at most 8 stripes, since Lustre has only 8 OSTs.}
The purpose of NetCDF-Bench is to investigate the I/O behaviour of typical scientific application, that access large variable through NetCDF4.
In the experiment, we varied the following parameters: \{Lustre, IME-FUSE\} $\times$ \{read, write\} $\times$ \{chunked, contiguous\} $\times$ \{collective, independent\}.
@ -274,35 +249,35 @@ But the measured read performance is significantly lower than expected.
This indicates, that the bottleneck here are the IMEs.
The same considerations apply to sequential performance.
\begin{figure}[b!]
\centering
\includegraphics[width=0.8\textwidth]{performance_overview_rnd_ime.png}
\caption{Random access performance depending on blocksize and PPN}
\label{fig:read_write_ime}
\centering
\includegraphics[width=0.8\textwidth]{performance_overview_rnd_ime.png}
\caption{Random access performance depending on blocksize and PPN}
\label{fig:read_write_ime}
\end{figure}
\section{Evaluation}
\begin{table}[b!]
\centering
\begin{tabular}{r|r|r|r|r|r|l|r}
& & \multicolumn{2}{c|}{Best} & \multicolumn{2}{c|}{Mean} & & \\
NN & PPN & \multicolumn{2}{c|}{Performance} & \multicolumn{2}{c|}{Performance} & I/O type & File size \\
& & \multicolumn{2}{c|}{in [MiB/s]} & \multicolumn{2}{c|}{in [MiB/s]} & & in [MiB] \\
& & read & write & read & write & & \\
\hline
1 &1 &2,560 &1,240 &2,400 &1,180 & rnd & 1000 \\
1 &1 &2,290 &1,230 &2,000 &870 & seq & 1000 \\
\hline
1 &8 &8,500 &6,390 &8,100 &6,120 & rnd & 8000 \\
1 &8 &8,700 &6,380 &7,100 &4,530 & seq & 8000 \\
\hline
10 &1 &22,300 &10,700 &21,200 &10,000 & rnd & 10000 \\
10 &1 &23,200 &10,800 &22,200 &8,430 & seq & 10000 \\
\hline
10 &8 &67,500 &60,200 &65,300 &58,400 & rnd & 80000 \\
10 &8 &67,500 &62,900 &61,700 &54,300 & seq & 80000 \\
\end{tabular}
\caption{The best and mean performance measured with IME-IOR (blocksize: 10MiB) (NN: number of nodes; PPN: processes per node).}
\label{tab:bestperf_nn10}
\centering
\begin{tabular}{r|r|r|r|r|r|l|r}
& & \multicolumn{2}{c|}{Best} & \multicolumn{2}{c|}{Mean} & & \\
NN & PPN & \multicolumn{2}{c|}{Performance} & \multicolumn{2}{c|}{Performance} & I/O type & File size \\
& & \multicolumn{2}{c|}{in [MiB/s]} & \multicolumn{2}{c|}{in [MiB/s]} & & in [MiB] \\
& & read & write & read & write & & \\
\hline
1 & 1 & 2,560 & 1,240 & 2,400 & 1,180 & rnd & 1000 \\
1 & 1 & 2,290 & 1,230 & 2,000 & 870 & seq & 1000 \\
\hline
1 & 8 & 8,500 & 6,390 & 8,100 & 6,120 & rnd & 8000 \\
1 & 8 & 8,700 & 6,380 & 7,100 & 4,530 & seq & 8000 \\
\hline
10 & 1 & 22,300 & 10,700 & 21,200 & 10,000 & rnd & 10000 \\
10 & 1 & 23,200 & 10,800 & 22,200 & 8,430 & seq & 10000 \\
\hline
10 & 8 & 67,500 & 60,200 & 65,300 & 58,400 & rnd & 80000 \\
10 & 8 & 67,500 & 62,900 & 61,700 & 54,300 & seq & 80000 \\
\end{tabular}
\caption{The best and mean performance measured with IME-IOR (blocksize: 10MiB) (NN: number of nodes; PPN: processes per node).}
\label{tab:bestperf_nn10}
\end{table}
%\subsubsection{IME}
@ -328,46 +303,37 @@ Hence, the I/O path involves relevant latencies.
%\jk{Im Bild braucht es als TEXT PPN, versteht man sonst nicht}
\begin{figure}[t]
\centering
\includegraphics[height=\hperf]{performance_ior_ime_ind_CHUNK:notset_FILL:notset_LIM:notset_legend:yes_size:6x8.png}
\caption{IME-native random I/O performance (lines go through max. values)}
\label{fig:overview_ime}
\centering
\includegraphics[height=\hperf]{performance_ior_ime_ind_CHUNK:notset_FILL:notset_LIM:notset_legend:yes_size:6x8.png}
\caption{IME-native random I/O performance (lines go through max. values)}
\label{fig:overview_ime}
\end{figure}
%+ sqlite3 results_random.db 'select nn, ppn, t*x*y*z*4/1024/1024, max(read)/1024 from p where app="ior" and iface="posix" and fs="lustre" and nn!=1 '
%10 8 100.0 17.40234375
%+ sqlite3 results_random.db 'select nn, ppn, t*x*y*z*4/1024/1024, max(write)/1024 from p where app="ior" and iface="posix" and fs="lustre" and nn!=1 '
%4 6 1000.0 11.865234375
%+ sqlite3 results_random.db 'select nn, ppn, t*x*y*z*4/1024/1024, max(read)/1024 from p where app="ior" and iface="mpio" and fs="lustre" and nn!=1 '
%10 8 1000.0 16.853515625
%+ sqlite3 results_random.db 'select nn, ppn, t*x*y*z*4/1024/1024, max(write)/1024 from p where app="ior" and iface="mpio" and fs="lustre" and nn!=1 '
%10 8 100.0 3.763671875
%\subsubsection{Lustre}
\textbf{Lustre (\Cref{fig:overview_lustre}):}
Firstly, a single node can profit from caching, when reading data.
In this case observable performance can rise up to 37~GiB/s (not shown in the figure).
The caching effects disappear for $\text{NN}>1$, hence we ignore them in further discussion.
\begin{figure}[p!]
\centering
\begin{subfigure}{\textwidth}
\subcaption{Lustre}
\includegraphics[height=\hperf]{performance_ior_lustre_ind_CHUNK:notset_FILL:notset_LIM:notset_legend:yes_size:12x8.png}
\label{fig:overview_lustre}
\end{subfigure}
\centering
\begin{subfigure}{\textwidth}
\subcaption{Lustre}
%\includegraphics[height=\hperf]{performance_ior_lustre_ind_CHUNK:notset_FILL:notset_LIM:notset_legend:yes_size:12x8.png}
\includegraphics[height=\hperf]{performance_ior-default_lustre_random_write_linear.png}
\label{fig:overview_lustre}
\end{subfigure}
\medskip
\medskip
\begin{subfigure}{\textwidth}
\subcaption{IME-FUSE}
\includegraphics[height=\hperf]{performance_ior_fuse_ind_CHUNK:notset_FILL:notset_LIM:notset_legend:yes_size:12x8.png}
\label{fig:overview_fuse}
\end{subfigure}
\caption{Random I/O performance (lines go through max. values)}
\begin{subfigure}{\textwidth}
\subcaption{IME-FUSE}
\includegraphics[height=\hperf]{performance_ior_fuse_ind_CHUNK:notset_FILL:notset_LIM:notset_legend:yes_size:12x8.png}
\label{fig:overview_fuse}
\end{subfigure}
\caption{Random I/O performance (lines go through max. values)}
\end{figure}
\eb{Rerun experiments with large files for IME.}
Secondly, the read performance don't exceed 17.4~GiB/s, and is achieved with NN=10, PPN=8, BS=100~KiB.
This is a contra-intuitive, because usually large block size show better performance.
The best write performance is 11.8~GiB/s, and is achieved with NN=4, PPN=6, BS=1000~KiB.
@ -386,57 +352,26 @@ The file system shows a linear scalability, similar to the IME-native, but provi
This is probably caused by the FUSE overhead, which includes moving I/O requests from user space to kernel space, and then from kernel space to IME-FUSE.
%\subsection{Opening/Closing of Files}
%\label{sec:open-close}
%\begin{figure}[ht]
% \begin{subfigure}{.49\textwidth}
% \centering
% \includegraphics[width=\textwidth]{performance_ior_lustre_mpio_writeopen}
% \subcaption{Lustre}
% \label{fig:open_lustre}
% \end{subfigure}
% \begin{subfigure}{.49\textwidth}
% \centering
% \includegraphics[width=\textwidth]{performance_ior_fuse_mpio_writeopen}
% \subcaption{IME-FUSE}
% \label{fig:open_fuse}
% \end{subfigure}
% \caption{Open times}
% \label{fig:open}
%\end{figure}
%As already mentioned, IME-IOR doesn't provide open/close times.
%Therefore, we skip this investigation and take a look at IME-FUSE and Lustre (\Cref{fig:open}).
%Opening files for writing is one of the most costly metadata operations.
%The small number of nodes doesn't allow to create a reliable model to describe the open/close behaviour.
%The opening times on FUSE are significantly higher than on Lustre.
%The reason is that a metadata request can not be sent directly to the metadata server, but has to go through the whole FUSE stack.
%The time need on FUSE can be higher than 4 seconds whereby on Lustre it is less than 0.20 seconds.
%Due the limited size of the test cluster it is not possible to proof that, but we assume that on larger runs the open times will converge to the same value.
%Because FUSE overhead is constant and metadata server of the file system will be the most significant bottleneck.
\subsection{Application Kernel Using HDF5}
\eb{Rerun NetCDF with larger files. NetCDF-Bench requires a stonewalling feature, like IOR. This would make benchmark runtime more predictable.}
In this experiment, the HDF5 VOL development branch (date 2016-05-09), NetCDF~4.4.1 and NetCDF-bench is used.
%Several values for the 4D data geometry (($100$:$16$:$64$:$4$) $\approx$ 3.1MiB, ($100$:$16$:$64$:$25$) $\approx$ 19.5iB, ($100$:$16$:$64$:$256$) $\approx$ 200MiB, ($100$:$16$:$64$:$2560$) $\approx$ 2000MiB) of raw integer data have been explored.
Several values for the 4D data geometry of raw integer data have been explored.
For each block size we did 100 measurements.
The configuration parameters are summarized in \Cref{tab:netcdf_conf}.
\begin{table}
\centering
\begin{tabular}{l|r|r}
Parameter (-d) & Data size & Block size \\
($t$:$x$:$y$:$z$) & [in GiB] & [in KiB] \\
\hline
($100$:$16$:$64$:$4$) & 0.5 & 16 \\
($100$:$16$:$64$:$25$) & 3.1 & 100 \\
($100$:$16$:$64$:$256$) & 7.8 & 1024 \\
($100$:$16$:$64$:$2560$) & 78.1 & 10240 \\
\end{tabular}
\caption{NetCDF-Bench configuration used in during the benchmark.}
\label{tab:netcdf_conf}
\centering
\begin{tabular}{l|r|r}
Parameter (-d) & Data size & Block size \\
($t$:$x$:$y$:$z$) & [in GiB] & [in KiB] \\
\hline
($100$:$16$:$64$:$4$) & 0.5 & 16 \\
($100$:$16$:$64$:$25$) & 3.1 & 100 \\
($100$:$16$:$64$:$256$) & 7.8 & 1024 \\
($100$:$16$:$64$:$2560$) & 78.1 & 10240 \\
\end{tabular}
\caption{NetCDF-Bench configuration used in during the benchmark.}
\label{tab:netcdf_conf}
\end{table}
@ -445,28 +380,11 @@ All experiments were conducted with fixed dimension sizes only, since the unlimi
\Cref{fig:netcdf_perf} shows the results.
Generally, as expected, independent chunked I/O was a good configuration.
%\subsubsection{Performance}
%+ sqlite3 results_benchtool.db 'select nn, ppn, type, t*x*y*z*4/1024/1024, max(read)/1024 from p where app="benchtool" and type="coll" and fs="lustre" and unlimited="notset" and nn=10 and ppn=8 '
%10 8 coll 1000.0 23.4844971199307
%+ sqlite3 results_benchtool.db 'select nn, ppn, type, t*x*y*z*4/1024/1024, max(write)/1024 from p where app="benchtool" and type="coll" and fs="lustre" and unlimited="notset" and nn=10 and ppn=8 '
%10 8 coll 1000.0 14.0872631923396
%+ sqlite3 results_benchtool.db 'select nn, ppn, type, t*x*y*z*4/1024/1024, max(read)/1024 from p where app="benchtool" and type="ind" and fs="lustre" and unlimited="notset" and nn=10 and ppn=8 '
%10 8 ind 1000.0 40.7447031422526
%+ sqlite3 results_benchtool.db 'select nn, ppn, type, t*x*y*z*4/1024/1024, max(write)/1024 from p where app="benchtool" and type="ind" and fs="lustre" and unlimited="notset" and nn=10 and ppn=8 '
%10 8 ind 1000.0 18.5541272529369
%+ sqlite3 results_benchtool.db 'select nn, ppn, type, t*x*y*z*4/1024/1024, max(read)/1024 from p where app="benchtool" and type="coll" and fs="fuse" and unlimited="notset" and nn=10 and ppn=8 '
%10 8 coll 1000.0 22.9363088999496
%+ sqlite3 results_benchtool.db 'select nn, ppn, type, t*x*y*z*4/1024/1024, max(write)/1024 from p where app="benchtool" and type="coll" and fs="fuse" and unlimited="notset" and nn=10 and ppn=8 '
%10 8 coll 1000.0 14.1118732992937
%+ sqlite3 results_benchtool.db 'select nn, ppn, type, t*x*y*z*4/1024/1024, max(read)/1024 from p where app="benchtool" and type="ind" and fs="fuse" and unlimited="notset" and nn=10 and ppn=8 '
%10 8 ind 1000.0 38.7201201759216
%+ sqlite3 results_benchtool.db 'select nn, ppn, type, t*x*y*z*4/1024/1024, max(write)/1024 from p where app="benchtool" and type="ind" and fs="fuse" and unlimited="notset" and nn=10 and ppn=8 '
%10 8 ind 1000.0 18.6272447947956
\begin{figure}[tb]
\centering
\includegraphics[width=0.9\textwidth]{performance_benchtool_FS:lustre_IFACE:mpio_FILLED_notset_LIM:notset.png}
\caption{NetCDF performance for Lustre (similar to IME-FUSE)}
\label{fig:netcdf_perf}
\centering
\includegraphics[width=0.9\textwidth]{performance_benchtool_FS:lustre_IFACE:mpio_FILLED_notset_LIM:notset.png}
\caption{NetCDF performance for Lustre (similar to IME-FUSE)}
\label{fig:netcdf_perf}
\end{figure}
\textbf{Lustre vs. IME-FUSE:}
Generally, the performance looks very similar for Lustre and IME-FUSE, that is why we only included the picture for Lustre. There are a few differences:
@ -496,10 +414,10 @@ This experiment is conducted measuring timing of 10,000 or 1,024 individual I/Os
\Cref{fig:variability} shows the qualitative difference between the file systems.
The figure shows the density (like a smoothened histogram) of the individually timed I/Os.
\begin{figure}[bpt!]
\centering
\includegraphics[width=\textwidth]{density.png}
\caption{Density of timing individual I/O operations}
\label{fig:variability}
\centering
\includegraphics[width=\textwidth]{density.png}
\caption{Density of timing individual I/O operations}
\label{fig:variability}
\end{figure}
We observe 1) the read operations on Lustre are faster than using IME-FUSE -- this is presumably due to client-side caching.
2) the random acceleration of IME improves write latencies/throughput for IME.
@ -523,34 +441,10 @@ Further large-scale investigation is necessary.
\section*{Acknowledgment}
{
\small
%Thanks to Jean-Thomas Acquaviva for providing access to the IME test cluster and valuable feedback.
Thanks to DDN for providing access to the IME test cluster and to Jean-Thomas Acquaviva for the support.
%%Thanks to our sponsor William E. Allcock for providing access and feedback.
%%This research used resources of the Argonne Leadership Computing Facility, which is a DOE Office of Science User Facility supported under Contract DE-AC02-06CH11357.
}
%
% ---- Bibliography ---- BibLatex
%
\bibliographystyle{splncs03}
\bibliography{bibliography}{}
%
% ---- Bibliography ----
%
%\begin{thebibliography}{}
%\end{thebibliography}
%\clearpage
%\addtocmark[2]{Author Index} % additional numbered TOC entry
%\renewcommand{\indexname}{Author Index}
%%\printindex
%\clearpage
%\addtocmark[2]{Subject Index} % additional numbered TOC entry
%\markboth{Subject Index}{Subject Index}
%\renewcommand{\indexname}{Subject Index}
%%\input{subjidx.ind}
\end{document}

File diff suppressed because it is too large Load Diff