Scipediacontent: Scipediacontent moved page Draft Content 321425902 to Wu et al 2008a

2021-02-03T15:17:01Z

Scipediacontent moved page Draft Content 321425902 to Wu et al 2008a

Scipediacontent: Created page with " == Abstract == Supporting high performance computing pipelines over wide-area networks is critical to enabling large-scale distributed scientific applications that require f..."

2021-02-03T15:16:59Z

Created page with " == Abstract == Supporting high performance computing pipelines over wide-area networks is critical to enabling large-scale distributed scientific applications that require f..."

New page

== Abstract ==

Supporting high performance computing pipelines over wide-area networks is critical to enabling large-scale distributed scientific applications that require fast responses for interactive operations or smooth flows for data streaming. We construct analytical cost models for computing modules, network nodes, and communication links to estimate the computing times on nodes and the data transport times over connections. Based on these time estimates, we present the efficient linear pipeline configuration method based on dynamic programming that partitions the pipeline modules into groups and strategically maps them onto a set of selected computing nodes in a network to achieve minimum end-to-end delay or maximum frame rate. We implemented this method and evaluated its effectiveness with experiments on a large set of simulated application pipelines and computing networks. The experimental results show that the proposed method outperforms the streamline and greedy algorithms. These results, together with polynomial computational complexity, make our method a potential scalable solution for large practical deployments.

== Original document ==

The different versions of the original document can be found in:

* [https://opensiuc.lib.siu.edu/cgi/viewcontent.cgi?article=1006&context=cs_pubs https://opensiuc.lib.siu.edu/cgi/viewcontent.cgi?article=1006&context=cs_pubs]

* [http://xplorestaging.ieee.org/ielx5/4519061/4536075/04536465.pdf?arnumber=4536465 http://xplorestaging.ieee.org/ielx5/4519061/4536075/04536465.pdf?arnumber=4536465],
: [http://dx.doi.org/10.1109/ipdps.2008.4536465 http://dx.doi.org/10.1109/ipdps.2008.4536465]

* [https://dblp.uni-trier.de/db/conf/ipps/ipdps2008.html#WuGZR08 https://dblp.uni-trier.de/db/conf/ipps/ipdps2008.html#WuGZR08],
: [http://opensiuc.lib.siu.edu/cgi/viewcontent.cgi?article=1006&context=cs_pubs http://opensiuc.lib.siu.edu/cgi/viewcontent.cgi?article=1006&context=cs_pubs],
: [https://opensiuc.lib.siu.edu/cs_pubs/7 https://opensiuc.lib.siu.edu/cs_pubs/7],
: [http://yadda.icm.edu.pl/yadda/element/bwmeta1.element.ieee-000004536465 http://yadda.icm.edu.pl/yadda/element/bwmeta1.element.ieee-000004536465],
: [https://www.researchgate.net/profile/Nageswara_Rao8/publication/224316952_Optimizing_network_performance_of_computing_pipelines_in_distributed_environments/links/0c960527d2d3d4e2cd000000.pdf https://www.researchgate.net/profile/Nageswara_Rao8/publication/224316952_Optimizing_network_performance_of_computing_pipelines_in_distributed_environments/links/0c960527d2d3d4e2cd000000.pdf],
: [https://researchwith.montclair.edu/en/publications/optimizing-network-performance-of-computing-pipelines-in-distribu https://researchwith.montclair.edu/en/publications/optimizing-network-performance-of-computing-pipelines-in-distribu],
: [https://academic.microsoft.com/#/detail/2163316030 https://academic.microsoft.com/#/detail/2163316030]

← Older revision	Revision as of 15:17, 3 February 2021
(No difference)

Wu et al 2008a - Revision history

Scipediacontent: Scipediacontent moved page Draft Content 321425902 to Wu et al 2008a

Scipediacontent: Created page with " == Abstract == Supporting high performance computing pipelines over wide-area networks is critical to enabling large-scale distributed scientific applications that require f..."