Adding low-poly clothing
I'd still go with the cloth physics approach but instead of using your character model as a base for the cloth simulation I'd create another simplified version of the parts that are going to be covered by clothes. This dummy then would get a simple displacement modifier with a low value so that it always stays over the character model's surface - like a cage.