Abstract

Emergent wide-area distributed systems like computational grids present opportunities for large scientific applications. On these systems, communication mechanisms have to deal with dynamic resource availability and occurrence of network failures. In this paper, we present the design and implementation of an asynchronous and persistent pipe mechanism, called pi-channels. These communication issues are addressed by combining adaptive caching with data streaming for efficient and fault-tolerant communication. We present the underlying distributed algorithm that implements (a) caching of pipe data segments; (b) asynchronous operation; and (c) re-establishment of connections when a peer leaves and rejoins the computation - part of a communication state transfer mechanism. This makes it possible for different segments (from cache and from writer) of the pipe data to be concurrently streamed to the migrated reader, reducing the retrieval time. Finally, we present some performance results showing the benefits of asynchronous operation.


Original document

The different versions of the original document can be found in:

http://dx.doi.org/10.1109/icpads.2007.4447734
https://espace.library.uq.edu.au/view/UQ:9cf409a,
http://yadda.icm.edu.pl/yadda/element/bwmeta1.element.ieee-000004447734,
https://www.igi-global.com/chapter/persistence-communication-state-transfer-asynchronous/54932,
https://ieeexplore.ieee.org/document/4447734,
https://research.monash.edu/en/publications/persistence-and-communication-state-transfer-in-an-asynchronous-p,
https://www.computer.org/csdl/proceedings/icpads/2007/1889/01/04447734.pdf,
https://academic.microsoft.com/#/detail/2012893996
https://espace.library.uq.edu.au/view/UQ:315505,
https://core.ac.uk/display/18445457,
https://dblp.uni-trier.de/db/journals/ijghpc/ijghpc1.html#ChanA09,
https://research.monash.edu/en/publications/persistence-and-communication-state-transfer-in-an-asynchronous-p-2,
https://academic.microsoft.com/#/detail/2010907591
http://dx.doi.org/10.4018/jghpc.2009070102
http://dx.doi.org/10.4018/978-1-60960-603-9.ch015


DOIS: 10.1109/icpads.2007.4447734 10.4018/978-1-60960-603-9.ch015 10.4018/jghpc.2009070102

Back to Top

Document information

Published on 01/01/2011

Volume 2011, 2011
DOI: 10.1109/icpads.2007.4447734
Licence: CC BY-NC-SA license

Document Score

0

Views 0
Recommendations 0

Share this document

claim authorship

Are you one of the authors of this document?