What GPU specifications matter when training and using neural networks?
Besides the criteria listed look for


The number of cores
The ability to do low precision arithmetic


In practice you are probably best off just getting the latest generation NVIDIA card (currently 10xx).