Splines and Gaussians
If you talk about standard splines, piecewise polynomial, without tricks like orthogonalisation, they ought to have finite support. Not the case with Gaussians. As said by @Atul Ingle, derivability is another criterion, but might be more difficult to address on discrete data.