Despite being released the year after On Leaving, You Follow Me was in fact the first of these two albums to be recorded.
Nastasia later expressed some dissatisfaction with the album, stating that "some of those songs I felt like I really wanted to hear how they would have sounded on record with a full band.