model strangely overfit one image

#6
by Xiang-cd - opened

I tried to finetune the model with pokemon data at https://huggingface.co/datasets/lambdalabs/pokemon-blip-captions, but strangely that when sample or at val step of the train process. this butterfly is very often to appear, even with None prompt(un conditional generate), the example was here
butter.png

My guess is that there were more images of it in the dataset than other Pokemon, since there are 18 different versions of Vivillon.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment