Selection Behavior and Limit Selection to Visible
As the tutorial explicitly states, you should have Limit Selection to visible unselected. Once it is unselected, you will be able to see (if in perspective view), select and delete the back parts of your mesh.

If using the default theme, a selected button should have a dark background  and an unselected button should have a light one .