Can theano work on mapreduce or on spark?
I don't think theano have spark support yet, however there are at least 2 deep learning libraries that are good with that. The first one is mxnet, they have support for spark, R, python and C++. Another option is deeplearning4j, made in Java with direct access to Spark.