it' young spark is very hot technologyand is relatively youngso it' still very much emerging and changing quicklybut lot of big people are using it amazonfor examplehas claimed they're using itebaynasa' jet propulsional laboratoriesgroupontripadvisoryahooand manymany others have too ' sure there' lot of companies using it that don' confess up to itbut if you go to the spark apache wiki page at iuuq tqbslbqbdifpsh qpxfsfecziunm there' actually list you can look up of known big companies that are using spark to solve real-world data problems if you are worried that you're getting into the bleeding edge herefear notyou're in very good company with some very big people that are using spark in production for solving real problems it is pretty stable stuff at this point it' not difficult it' also not that hard you have your choice of programming in pythonjavaor scalaand they're all built around the same concept that just described earlierthat isthe resilient distributed datasetrdd for short we'll talk about that in lot more detail in the coming sections of this components of spark spark actually has many different components that it' built up of so there is spark core that lets you do pretty much anything you can dream up just using spark core functions alonebut there are these other things built on top of spark that are also useful