Best Julia library for neural networks
MXNet Julia Package - flexible and efficient deep learning in Julia


https://github.com/dmlc/MXNet.jl

Pros


Fast
Scales up to multi GPUs and distributed setting with auto parallelism.
Lightweight, memory efficient and portable to smart devices.
Automatic Differentiation


Cons


Doesn't have yet low level operations for algorithm implementation. But they are working on this issue (https://github.com/dmlc/mxnet/issues/586)