This commit is contained in:
Julian M. Kunkel 2019-09-05 10:56:25 +01:00
parent 88e3b83489
commit 851924dc4b
1 changed files with 23 additions and 0 deletions

23
high-level.txt Normal file
View File

@ -0,0 +1,23 @@
nc_open("file.nc", ...)
nc_open_reduce("file.nc", "max()")
normally:
writer: produces some data (say 10 MB each)
-> write the data via ESDM
read: I want this data => blocks until data is ready
-> ESDM + X "WP4/WP5 API" we will have the offloading, open (please apply this operator already)
streaming:
- open()
- stream = apply_op("x")
- stream.apply(offset =[0,0,0], size = [100,100,100])
- once data is ready, the stream operators they are applied in any order
- once completed, read completes
- threading is already implemented in ESDM
We should prototype some interfaces in a light-weight fashion.
- WP5 => use-cases to be defined to motivate the work
- Use-case for in-situ
-