Are non-relu activations better for small/ dense datasets?
There is no reason to to predict tanh would be better if for a smaller, dense dataset.
The effect of activation function varies from dataset to dataset. You could it treat like an empirical question - find the best activation function for a specific data set like any other hyperparameter.