Sankar Krishna. Fast Data Processing with Spark 2

Third Edition. — Packt Publishing, 2016. — 274 p.When people want a way to process big data at speed, Spark is invariably the solution. With its ease of development (in comparison to the relative complexity of Hadoop), it’s unsurprising that it’s becoming popular with data analysts and engineers everywhere.Beginning with the fundamentals, we’ll show you how to get set up with Spark with minimum fuss. You’ll then get to grips with some simple APIs before investigating machine learning and graph processing – throughout we’ll make sure you know exactly how to apply your knowledge.You will also learn how to use the Spark shell, how to load data before finding out how to build and run your own Spark applications. Discover how to manipulate your RDD and get stuck into a range of DataFrame APIs. As if that’s not enough, you’ll also learn some useful Machine Learning algorithms with the help of Spark MLlib and integrating Spark with R. We’ll also make sure you’re confident and prepared for graph processing, as you learn more about the GraphX API.What you will learnInstall and set up Spark in your cluster
Prototype distributed applications with Spark's interactive shell
Perform data wrangling using the new DataFrame APIs
Get to know the different ways to interact with Spark's distributed representation of data (RDDs)
Query Spark with a SQL-like query syntax
See how Spark works with big data
Implement machine learning systems with highly scalable algorithms
Use R, the popular statistical language, to work with Spark
Apply interesting graph algorithms and graph processing with GraphX