Safari does not remember my settings
It seems like there is something wrong with your Safari preferences file, try trashing it. (It is located in your ~/Library/Preferences, press Command ⌘+Shift ⇧+G in Finder and paste ~/Library/Preferences in the text box to open that folder, search for 'safari' and trash the .plist file)