Hidden layers appear when I hit undo
Sounds like you somehow added a driver to an object on one of the layers. Simply right click the eye and choose Delete Driver. It is an undoable action so if you undo, it will revert so you might want to save the file and reload it.