IPSec/L2TP Unable to connect
After much searching I found the answer at http://www.henrywang.org/entry/mavericks-and-cisco-vpn (Warning : Written in Chinese you'll probably need to translate it.).

TL;DR The private key needed to be set to "Allow all applications to access this item" in  Keychain Access.