Why does my model learn with Ragged Tensors but not Dense Tensors?
So turns out the answer was that the shape of the dense tensor was different across the training set and validation set. This was because the longest sequence differed in length between the two sets (same with the test set).