Can I read Generalizing mapreduce as a unified cloud and HPC runtime on EtoBox?

Generalizing mapreduce as a unified cloud and HPC runtime by Judy Qiu is a scholarly article available to read on EtoBox.

What is Generalizing mapreduce as a unified cloud and HPC runtime about?

Computational simulation and analysis were one of the keys to the future in data-intensive science as a "fourth paradigm" of scientific discovery but facing a major challenge as handling the incredible increases in dataset sizes. This requires attractive powerful programming models that address issues of portability with scaling performance and fault tolerance. Further, one must meet these challenges for both computation and storage. We build on the success of our research on Iterative MapReduce with successful prototypes Twister (on HPC) and Twister4Azure (on clouds). We have designed a novel Map Collective runtime which generalizes previous work in both HPC and MapReduce communities, which we hypothesize can be used as the runtime for data analysis (mining) interoperably between clouds and clusters.

Author

Judy Qiu

Publisher

ACM

Published

2011

Language

EN