Scipediacontent: Scipediacontent moved page Draft Content 161493183 to Samtaney et al 2011a

2021-01-28T16:26:03Z

Scipediacontent moved page Draft Content 161493183 to Samtaney et al 2011a

Scipediacontent: Created page with " == Abstract == We have developed a threaded parallel data streaming approach using Globus to transfer multi-terabyte simulation data from a remote supercomputer to the scien..."

2021-01-28T16:26:00Z

Created page with " == Abstract == We have developed a threaded parallel data streaming approach using Globus to transfer multi-terabyte simulation data from a remote supercomputer to the scien..."

New page

== Abstract ==

We have developed a threaded parallel data streaming approach using Globus to transfer multi-terabyte simulation data from a remote supercomputer to the scientists home analysis/visualization cluster, as the simulation executes, with negligible overhead. Data transfer experiments show that this concurrent data transfer approach is more favorable compared with writing to local disk and then transferring this data to be post-processed. The present approach is conducive to using the grid to pipeline the simulation with post-processing and visualization. We have applied this method to the Gyrokinetic Toroidal Code (GTC), a 3-dimensional particle-in-cell code used to study micro-turbulence in magnetic confinement fusion from first principles plasma theory.

== Original document ==

The different versions of the original document can be found in:

* [http://phoenix.ps.uci.edu/zlin/bib/klasky03.pdf http://phoenix.ps.uci.edu/zlin/bib/klasky03.pdf]

* [http://phoenix.ps.uci.edu/zlin/bib/klasky03.pdf http://phoenix.ps.uci.edu/zlin/bib/klasky03.pdf],
: [https://dblp.uni-trier.de/db/conf/sc/sc2003.html#KlaskyELMMS03 https://dblp.uni-trier.de/db/conf/sc/sc2003.html#KlaskyELMMS03],
: [http://ieeexplore.ieee.org/iel5/10619/33528/01592927.pdf http://ieeexplore.ieee.org/iel5/10619/33528/01592927.pdf],
: [https://core.ac.uk/display/103872142 https://core.ac.uk/display/103872142],
: [https://www.scipedia.com/public/Klasky_et_al_2003a https://www.scipedia.com/public/Klasky_et_al_2003a],
: [https://dl.acm.org/citation.cfm?doid=1048935.1050175 https://dl.acm.org/citation.cfm?doid=1048935.1050175],
: [https://doi.acm.org/10.1145/1048935.1050175 https://doi.acm.org/10.1145/1048935.1050175],
: [http://portal.acm.org/citation.cfm?doid=1048935.1050175 http://portal.acm.org/citation.cfm?doid=1048935.1050175],
: [https://doi.org/10.1145/1048935.1050175 https://doi.org/10.1145/1048935.1050175],
: [https://www.osti.gov/servlets/purl/815093 https://www.osti.gov/servlets/purl/815093],
: [https://academic.microsoft.com/#/detail/2158850657 https://academic.microsoft.com/#/detail/2158850657]

* [http://dl.acm.org/ft_gateway.cfm?id=1050175&ftid=310796&dwn=1 http://dl.acm.org/ft_gateway.cfm?id=1050175&ftid=310796&dwn=1],
: [http://dx.doi.org/10.1145/1048935.1050175 http://dx.doi.org/10.1145/1048935.1050175]

← Older revision	Revision as of 16:26, 28 January 2021
(No difference)

Samtaney et al 2011a - Revision history

Scipediacontent: Scipediacontent moved page Draft Content 161493183 to Samtaney et al 2011a

Scipediacontent: Created page with " == Abstract == We have developed a threaded parallel data streaming approach using Globus to transfer multi-terabyte simulation data from a remote supercomputer to the scien..."