About this document
MapReduce Implementation for Indexing by Cristiano Ruschel is a document available to read on EtoBox.
The document describes a MapReduce algorithm for building an inverted index from a set of files, where each token is mapped to the files it appears in along with its positions. The algorithm implements various text processing steps like case folding, punctuation handling, stopword removal, and stemming before writing the output in key-value pairs with the token as key and file/positions list as value. The algorithm aims to improve performance through techniques like in-mapper combining to reduce data shuffl
- Author
- Cristiano Ruschel
- Language
- EN