Does fixed hyperparameters perform well regardless the number of training examples?
No. You're asking about model selection. Larger sample sizes will allow you to choose more complex models. Read up on the keywords overfit/underfit, model selection, Structural Risk Minimization, and in particular this article:
https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=705570