first steps in big data you to explore data from lenders of bank by the end of this you'll have gone through the following stepsload data into hadoopthe most common big data platform transform and clean data with spark store it into big data database called hive interactively visualize this data with qlik sensea visualization tool all this (apart from the visualizationwill be coordinated from within python script the end result is dashboard that allows you to explore the dataas shown in figure figure interactive qlik dashboard bear in mind that we'll only scratch the surface of both practice and theory in this introductory on big data technologies the case study will touch three big data technologies (hadoopsparkand hive)but only for data manipulationnot model building it will be up to you to combine the big data technologies you get to see here with the model-building techniques we touched upon in previous distributing data storage and processing with frameworks new big data technologies such as hadoop and spark make it much easier to work with and control cluster of computers hadoop can scale up to thousands of computerscreating cluster with petabytes of storage this enables businesses to grasp the value of the massive amount of data available