When I open blender it loads a previous project
It seems like you have inadvertently saved that file as your startup file.   I'd make sure you have a backup of that old project file.    Delete all the objects that you see.   Then select (File, Save Startup file).   Close and re-open Blender and see if that's more to your liking.