S. Hampton, R. Maciulaitis, J. Okraska, T. Simko, I. Johnson, M. Hildreth, P. Brenner, C. Kankel, K. Anampa, D. Rodriguez
REANA is a reusable and reproducible data analysis platform allowing researchers to structure their analysis pipelines and run them on remote containerised compute clouds. REANA supports several different workflows systems (CWL, Serial, Yadage) and uses Kubernetes' job execution backend. We have designed an abstract job execution component that extends the REANA platform job execution capabilities to support multiple compute backends. We have tested the abstract job execution component with HTCondor and verified the scalability of the designed solution. The results show that the REANA platform would be able to support hybrid scientific workflows where different parts of the analysis pipelines can be executed on multiple computing backends.
Diff selection: Mark the radio boxes of the revisions to compare and hit enter or the button at the bottom.
Legend: (cur) = difference with latest revision, (prev) = difference with preceding revision, m = minor edit.
Published on 01/01/2019
Volume 2019, 2019DOI: 10.1109/escience.2019.00091Licence: CC BY-NC-SA license
Views 0Recommendations 0
Are you one of the authors of this document?