Use baked shadows on separate mesh?
I have an idea, that you can use compositing to achieve this task:

I created 2 render layers, one for color (I make them solid using Emission node):



And this for the baked shadows (and objects with real shadows are holdout, to make a transparent on their place):



And multiply shadows with color in compositing nodes this way: