Quotes problem in Mavericks (or TextEdit)
This is not just TextEdit, it's Mavericks.

Under System Preferences > Keyboard, you can change the quotation marks.

Go to the 'Text' sub-menu.  On the right-hand side of the box, uncheck the "Use smart quotes and dashes" checkbox.