6883e621_ws___Machine_Learning__Theory___3
[0] Algorithmic complexity [1] Learning is about finding a program which correctly predicts the outputs given the inputs. [2] Any reasonable problem is learnable with a number of samples related to the description length of the program. [3] 
The theory literally suggests solving halting problems to solve machine learning.
All Models of Learning have Flaws « Machine Learning (Theory)
3