it' scalable how is spark scalablewelllet' get little bit more specific here in how it all works the way it works isyou write driver programwhich is just little script that looks just like any other python script reallyand it uses the spark library to actually write your script with within that libraryyou define what' called spark contextwhich is sort of the root object that you work within when you're developing in spark from therethe spark framework kind of takes over and distributes things for you so if you're running in standalone mode on your own computerlike we're going to be doing in these upcoming sectionsit all just stays there on your computerobviously howeverif you are running on cluster managerspark can figure that out and automatically take advantage of it spark actually has its own built-in cluster manageryou can actually use it on its own without even having hadoop installedbut if you do have hadoop cluster available to youit can use that as well hadoop is more than mapreducethere' actually component of hadoop called yarn that separates out the entire cluster management piece of hadoop spark can interface with yarn to actually use that to optimally distribute the components of your processing amongst the resources available to that hadoop cluster