Getting ready

To execute this recipe, you need to have a working Spark 2.3 environment. If you do not have one, you might want to go back to Chapter 1, Installing and Configuring Spark, and follow the recipes you find there. 

All the code that you will need for this chapter can be found in the GitHub repository we set up for the book: http://bit.ly/2ArlBck; go to Chapter 3 and open the 3. Abstracting data with DataFrames.ipynb notebook. 

There are no other requirements.