What parameters to tweak to improve reliability (machine learning)?
If your question is about supervised learning,  than ten million training points are enough in most of the cases. Besides, I think your question is too broad. There are a lot of  parameters which can influence the accuracy. Like which algorithm you want to use. Which approximator and its topology, the hyperparameters etc.