Removing a leftover oil-burner safety switch?
You could leave the switch as-is but then install one of various types of switch guards to prevent accidental switch setting changes. Here are a few examples...