What is Deep supervision?
Partial answer: Quoting a paper
&quot;The advantage of such deep supervision is evident: (1)for small training data and relatively shallower networks, deep supervision functions as a strong “regularization” for classiﬁcation accuracy and learned features; (2) for large training data and deeper networks deep supervision makes it convenient to exploit the signiﬁcant performance gains that extremely deep networks can bring by improving otherwise problematic convergence behavior&quot;