the big data ecosystem and data science apache mapreduce hdfshadoop file system apache pig red hat glusterfs quantcast filesystem jaql distributed filesystem distributed programming ceph filesystem apache hama graphbuilder others mahout weka onyx oozie falcon netflix pigpen apache twill tika giraph apache spark scheduling sparkling water madlib gridmix puma benchmarking machine learning scikit-learn python libraries mesos pybrain pylearn big data ecosystem theano hue ambari spark benchmarking libraries system deployment mongodb document store elasticsearch apache thrift zookeeper service programming reddis memcache sentry ranger key-value store voldemort security nosql hbase apache flume hypertable sqoop scribe column database cassandra data integration chukwa nosql new sql databases neo graph database hive hcatalog sql on hadoop drill impala new sql bayes db sensei new sql drizzle figure big data technologies can be classified into few main components