Building a Data Warehouse for Business Analytics using Spark SQL - Spark Summit 2015

Edmunds.com is a car-shopping website that serves more than 19 million visitors each month, and we heavily use data analysis to optimize the experience for each visitor. To accomplish that goal, the engineering team at Edmunds processes terabytes of data, and our business analysts use rich visualizations on traffic, revenue and car leads metrics to get insights on the car shopper journey. When our team was faced with the challenge of increasing the speed of the pipeline and empowering business analysts to be completely self-autonomous in the process of dataset creation, aggregation and visuali