How to Scaling Out Artifical Neural Networks?
You might take a look over TensorFrames, a Databricks library which allow running TensorFlow code on top of Apache Spark : 

https://github.com/databricks/tensorframes