Effects of changing majors in undergrad on graduate admission
Finish a degree. Any degree. Then supplement the completed coursework with things that will enhance your grad school applications.  You're almost there -- just get it over with, and then figure out what additional courses you'd like to take or audit.

Note also that many colleges and universities will limit late credit transfers.  I imagine they want a degree from their institution to reflect their institutional identity.