What is the smoothness assumption in SVMs?
Smoothness here is the mathematical definition, so as you implied smoothness is ruled out by output data with sharp spikes or discontinuous jumps (and possibly the data of the gradient, the gradient's gradient, ad infinitum, depending on who defines smoothness).
By any definition a lot of activation functions are not smooth, for example RELU. This means neural networks in general are not smooth.