Lower Variance vs. Higher Validation Scores
It seems like both models are on par in terms of performance. It will be interesting to see what would happen if you combine predictions from both models via a simple average. In many cases an ensemble of models has shown to yield better performance than any single model.
So maybe it turns out you want to keep the best of both worlds by averaging.