About this document

Apache Spark Overview and RDD Insights by consistent thoughts is a document available to read on EtoBox.

Spark is a fast in-memory data processing engine that allows efficient execution of iterative, parallel data processing jobs across clustered environments. It can run on top of Hadoop YARN, Mesos and Kubernetes. Spark includes APIs for streaming, machine learning and SQL workloads. Compared to Hadoop MapReduce, Spark is 100 times faster for iterative jobs as it caches working datasets in memory. [/SUMMARY]

Author

consistent thoughts

Language

EN