spark streamingspark streaming is library that lets you actually process data in real time data can be flowing into server continuouslysayfrom weblogsand spark streaming can help you process that data in real time as you goforever spark sqlthis lets you actually treat data as sql databaseand actually issue sql queries on itwhich is kind of cool if you're familiar with sql already mllibthis is what we're going to be focusing on in this section it is actually machine learning library that lets you perform common machine learning algorithmswith spark underneath the hood to actually distribute that processing across cluster you can perform machine learning on much larger datasets than you could have otherwise graphxthis is not for making pretty charts and graphs it refers to graph in the network theory sense think about social networkthat' an example of graph graphx just has few functions that let you analyze the properties of graph of information python versus scala for spark do get some flack sometimes about using python when ' teaching people about apache sparkbut there' method to my madness it is true that lot of people use scala when they're writing spark codebecause that' what spark is developed in natively soyou are incurring little bit of overhead by forcing spark to translate your python code into scala and then into java interpreter commands at the end of the day howeverpython' lot easierand you don' need to compile things managing dependencies is also lot easier you can really focus your time on the algorithms and what you're doingand less on the minutiae of actually getting it builtand runningand compilingand all that nonsense plusobviouslythis book has been focused on python so farand it makes sense to keep using what we've learned and stick with python throughout these lectures here' quick summary of the pros and cons of the two languagespython scala  pggfvqeqorkngocpcigfgrgpfgpekgugveaguueqfkpiqxgtjgcf ;qwcntgcf[mpqy [vjqp agvuwuhqewuqpvjgeqpegrvukpuvgcfqh pgy ncpiwcig  ecnckurtqdcdn[ oqtgrqrwnctejqkeg ykvj rctm  rctmkudwknvkp ecncuqeqfkpikp ecncku pcvkxgvq rctm  gyhgcvwtgunkdtctkguvgpfvqdg ecncbtuv