Evolving Machine Learning
Such a system can and does solve the problem of hyperparameter tuning. Google's AutoML does this. Here is another example that uses a Genetic Algorithm to breed new neural network structures. 
AutoML has been shown to outperform humans in the rate that it improves network designs. It seems to favour Residual Network style topologies.