Training on skewed dataset
It could be your model or your data. You need to perform the experiment of changing your model (while holding data constant) to isolate the causal reason.

Yes - models can get worse with more data. One of the primary reasons is models often have a limited capacity to learn. Simple models can only successfully model simple relationships. Again - if you fit a more complex model, you'll start to understand the mechanism that could be causing this observation.