Emergent wide-area distributed systems like computational grids present opportunities for large scientific applications. On these systems, communication mechanisms have to deal with dynamic resource availability and occurrence of network failures. In this paper, we present the design and implementation of an asynchronous and persistent pipe mechanism, called pi-channels. These communication issues are addressed by combining adaptive caching with data streaming for efficient and fault-tolerant communication. We present the underlying distributed algorithm that implements (a) caching of pipe data segments; (b) asynchronous operation; and (c) re-establishment of connections when a peer leaves and rejoins the computation - part of a communication state transfer mechanism. This makes it possible for different segments (from cache and from writer) of the pipe data to be concurrently streamed to the migrated reader, reducing the retrieval time. Finally, we present some performance results showing the benefits of asynchronous operation.
The different versions of the original document can be found in:
DOIS: 10.1109/icpads.2007.4447734 10.4018/978-1-60960-603-9.ch015 10.4018/jghpc.2009070102
Published on 01/01/2011
Volume 2011, 2011
DOI: 10.1109/icpads.2007.4447734
Licence: CC BY-NC-SA license
Are you one of the authors of this document?