How can I move in-app downloads (e.g. Coursera videos from Coursera app) onto my SD card without rooting the phone?
It depends on the application in question, typically there should be an option within the app itself along the lines of "Save to External Storage" which should save the videos to your SD Card

I know Udemy has this option as I have it set to Save to External Storage on my Note 3

HTH