When memory errors occur with model.fit(), is it due to GPU RAM or normal RAM?
Yes. The error is for GPU memory. You should look at training in batches options if you haven't already. This thread has short explanation on possible benefits and implications.

Quick batch size tutorial