Viability: Physics undergrad to Neuroscience/Psychology PhD?
According to this UC Berkley site physics is an appropriate background as long as you meet some additional requirements. 
http://neuroscience.berkeley.edu/ph-d-program/how-to-apply/