How do I make TextEdit remember last Save As location in Mountain Lion?
There is software that can track this folder and augment the standard behavior that you are seeing.

I find Default Folder to be the best of class, and you can try it for free and then decide if it's worth paying once you've had a chance to kick the tires a bit.

http://www.stclairsoft.com/DefaultFolderX/