The band was established in 2003 after Mickenberg was given a song writing session with Shelton as a birthday gift from her boyfriend.
Their eponymous debut album, which included the song "Connecticut's for Fucking", was released later that year.