Generalisations of the Fundamental Theorem of Statistical Learning to different tasks and losses
Turns out the answer is yes and can be found in Part 3 (eg chapter 19) of Neural Network Learning: Theoretical Foundations, by Anthony and Bartlett.