Can I delete these past version folders in my user App data
Each of those folders is only required for that specific version of Blender.

You only need to keep the folders for any versions of Blender that you still use. So, for example, if you no longer use version 2.65, you can safely delete that folder, etc.