So, I can come up with fairly okay solos and stuff to chords singing/humming, but I can't really do that on the piano. I guess I know which note(s) I want, I can hear it in my head, but I can't find it very quickly on the piano? Is this just a "not enough practice" issue?
yes