Scipediacontent: Scipediacontent moved page Draft Content 134163998 to Blaiszik et al 2018a

2021-02-02T04:34:28Z

Scipediacontent moved page Draft Content 134163998 to Blaiszik et al 2018a

Scipediacontent: Created page with " == Abstract == While the Machine Learning (ML) landscape is evolving rapidly, there has been a relative lag in the development of the "learning systems" needed to enable bro..."

2021-02-02T04:34:22Z

Created page with " == Abstract == While the Machine Learning (ML) landscape is evolving rapidly, there has been a relative lag in the development of the "learning systems" needed to enable bro..."

New page

== Abstract ==

While the Machine Learning (ML) landscape is evolving rapidly, there has been a relative lag in the development of the "learning systems" needed to enable broad adoption. Furthermore, few such systems are designed to support the specialized requirements of scientific ML. Here we present the Data and Learning Hub for science (DLHub), a multi-tenant system that provides both model repository and serving capabilities with a focus on science applications. DLHub addresses two significant shortcomings in current systems. First, its selfservice model repository allows users to share, publish, verify, reproduce, and reuse models, and addresses concerns related to model reproducibility by packaging and distributing models and all constituent components. Second, it implements scalable and low-latency serving capabilities that can leverage parallel and distributed computing resources to democratize access to published models through a simple web interface. Unlike other model serving frameworks, DLHub can store and serve any Python 3-compatible model or processing function, plus multiple-function pipelines. We show that relative to other model serving systems including TensorFlow Serving, SageMaker, and Clipper, DLHub provides greater capabilities, comparable performance without memoization and batching, and significantly better performance when the latter two techniques can be employed. We also describe early uses of DLHub for scientific applications.

Comment: 10 pages, 8 figures, conference paper

== Original document ==

The different versions of the original document can be found in:

* [http://arxiv.org/abs/1811.11213 http://arxiv.org/abs/1811.11213]

* [http://arxiv.org/pdf/1811.11213 http://arxiv.org/pdf/1811.11213]

* [http://xplorestaging.ieee.org/ielx7/8804711/8820774/08821027.pdf?arnumber=8821027 http://xplorestaging.ieee.org/ielx7/8804711/8820774/08821027.pdf?arnumber=8821027],
: [http://dx.doi.org/10.1109/ipdps.2019.00038 http://dx.doi.org/10.1109/ipdps.2019.00038]

* [https://dblp.uni-trier.de/db/journals/corr/corr1811.html#abs-1811-11213 https://dblp.uni-trier.de/db/journals/corr/corr1811.html#abs-1811-11213],
: [https://academic.microsoft.com/#/detail/2971890617 https://academic.microsoft.com/#/detail/2971890617]

← Older revision	Revision as of 04:34, 2 February 2021
(No difference)

Blaiszik et al 2018a - Revision history

Scipediacontent: Scipediacontent moved page Draft Content 134163998 to Blaiszik et al 2018a

Scipediacontent: Created page with " == Abstract == While the Machine Learning (ML) landscape is evolving rapidly, there has been a relative lag in the development of the "learning systems" needed to enable bro..."