About this document

HDFS Data Lake Setup Guide by jean is a document available to read on EtoBox.

The document describes the creation of 3 layers of a data lake using HDFS, Hive, and Spark. It details: 1. Creating the first layer directories and loading CSV files. 2. Creating the second layer by copying files to partitioned directories and creating external tables in Hive. 3. Transforming the data by joining tables, creating partitioned and bucketed tables, and saving the results as a Parquet file for analysis in the third layer.

Author

jean

Language

EN