What is the difference between a normal processor and a processor designed for AI?
Parallel processing is very important when computing ANNs. Though they are not designed for AIs, GPUs are widely used in machine learning because of their higher capability of paralel processing and it is due to their higher number of cores comparing CPUs.

All in all, the dedicated hardware should have GPU-like architecture.