Scipediacontent: Scipediacontent moved page Draft Content 175556697 to Pontika et al 2017a

2021-02-03T19:11:38Z

Scipediacontent moved page Draft Content 175556697 to Pontika et al 2017a

Scipediacontent: Created page with " == Abstract == CORE, a harvesting service offering access to millions of open access research papers from around the world, has shifted its harvesting process from following..."

2021-02-03T19:11:35Z

Created page with " == Abstract == CORE, a harvesting service offering access to millions of open access research papers from around the world, has shifted its harvesting process from following..."

New page

== Abstract ==

CORE, a harvesting service offering access to millions of open access research papers from around the world, has shifted its harvesting process from following a monolithic approach to the adoption of a microservices infrastructure. In this paper, we explain how we rearranged and re-scheduled our old ingestion pipeline, present CORE's move to managing microservices and outline the tools we use in a new and optimised ingestion system. In addition, we discuss the ineffciencies of our old harvesting process, the advantages, and challenges of our new ingestion system and our future plans. We conclude that via the adoption of microservices architecture we managed to achieve a scalable and distributed system that would assist with CORE's future performance\ud and evolution.

== Original document ==

The different versions of the original document can be found in:

* [http://oro.open.ac.uk/51070/1/ingestion-pipelines-microservices-cancellieri-pontika-pearce-anastasiou-knoth-3-MTSR2017.pdf http://oro.open.ac.uk/51070/1/ingestion-pipelines-microservices-cancellieri-pontika-pearce-anastasiou-knoth-3-MTSR2017.pdf]

* [http://link.springer.com/content/pdf/10.1007/978-3-319-70863-8_27 http://link.springer.com/content/pdf/10.1007/978-3-319-70863-8_27],
: [http://dx.doi.org/10.1007/978-3-319-70863-8_27 http://dx.doi.org/10.1007/978-3-319-70863-8_27] under the license http://www.springer.com/tdm

* [https://oro.open.ac.uk/51070 https://oro.open.ac.uk/51070],
: [https://link.springer.com/chapter/10.1007/978-3-319-70863-8_27 https://link.springer.com/chapter/10.1007/978-3-319-70863-8_27],
: [https://core.ac.uk/display/131316998 https://core.ac.uk/display/131316998],
: [https://dblp.uni-trier.de/db/conf/mtsr/mtsr2017.html#CancellieriPPAK17 https://dblp.uni-trier.de/db/conf/mtsr/mtsr2017.html#CancellieriPPAK17],
: [https://doi.org/10.1007/978-3-319-70863-8_27 https://doi.org/10.1007/978-3-319-70863-8_27],
: [https://academic.microsoft.com/#/detail/2760020229 https://academic.microsoft.com/#/detail/2760020229]

* [ ]

← Older revision	Revision as of 19:11, 3 February 2021
(No difference)

Pontika et al 2017a - Revision history

Scipediacontent: Scipediacontent moved page Draft Content 175556697 to Pontika et al 2017a

Scipediacontent: Created page with " == Abstract == CORE, a harvesting service offering access to millions of open access research papers from around the world, has shifted its harvesting process from following..."