Why I am unable to switch bash to the one installed by homebrew?
Okay, so apparently this was happening because tmux was holding on to the original bash version (even though I had exited tmux and reloaded it's config). tmux kill-server followed by relaunching tmux fixed it for me.