What is the dimensionality of the bias term in neural networks?
As per the general case, the bias vector must have the same dimensions as the output vector.

Please, have a look at this excellent presentation:



In this example by M.Görner, there are 10 classes, so is bias dimension. Once inputs are multiplied by weights, the bias is added pointwise (it is 'broadcasted'). And that's pretty much it.