Large variation in cross-validation scores
Based on the description my guess is that any or all of the following problems occur:

the data is not randomized, which could explain why the first fold get a very different performance than the others
perhaps the dataset is very small, causing massive variations in performance and overfitting.
in any case the model is very unstable, possibly due to overfitting caused by the model being too complex and/or dataset too small.