Are there benchmarks for assessing the speed of the forward-pass of neural networks?
https://github.com/jcjohnson/cnn-benchmarks might be a good start. It mostly focuses on GPUs, but there is also one CPU (Dual Xeon E5-2630 v3).