Is it possible to implement a vectorized version of a Maxout activation function?
If you could combine all the weight vectors into a matrix W and all b's into a vector b, then you could do
np.maximum(np.dot(W.T,x)  + b)