Allmusic considers "That's Not Me" to be "the closest thing to a conventional rocker" on the Pet Sounds album [REF].
Author James E. Perone recalled the song's use of a "sighing" motif present throughout the whole of Pet Sounds.