Contextual filter using taxonomy alias
I got it to work by adding a relationship to a taxonomy field that exposed the taxonomy name. Then on the Contextual Filter I followed what the links said in regard to Specify validation criteria. But since I still can't find the Filter Value Type option, I just set the Case option to Capitalize each word and in the More section I checked the Transform spaces to dashes in URL option.

This allowed the value in the URL (which was a URL alias) to match my Taxonomy term field.

I don't know if there's an easier way to accomplish this and I'd still like to know why I couldn't find the Filter Value Type option, but at least it's working.