first steps in big data the default user and password are (at the time of writing"rootand "hadoop"respectively you'll need to change this password at the first loginthough once connectedissue the following commandsyum - install python-pip--this installs pipa python package manager pip install git+at the time of writing there was problem with the pywebhdfs library and we fixed that in this fork hopefully you won' require this anymore when you read thisthe problem has been signaled and should be resolved by the maintainers of this package pip install pandas--to install pandas this usually takes awhile because of the dependencies an ipynb file is available for you to open in jupyter or (the olderipython and follow along with the code in this setup instructions for horton sandbox are repeated theremake sure to run the code directly on the horton sandbox nowwith the preparatory business out of the waylet' look at what we'll need to do in this exercisewe'll go through several more of the data science process stepsstep the research goal this consists of two partsproviding our manager with dashboard preparing data for other people to create their own dashboards step data retrieval downloading the data from the lending club website putting the data on the hadoop file system of the horton sandbox step data preparation transforming this data with spark storing the prepared data in hive steps exploration and report creation visualizing the data with qlik sense we have no model building in this case studybut you'll have the infrastructure in place to do this yourself if you want to for instanceyou can use spark machine learning to try to predict when someone will default on his debt it' time to meet the lending club step the research goal the lending club is an organization that connects people in need of loan with people who have money to invest your boss also has money to invest and wants information before throwing substantial sum on the table to achieve thisyou'll create report for him that gives him insight into the average ratingrisksand return for lending money to certain person by going through this processyou make the data