Rigol DS1052E Oscilloscope acting wierd
Depending on warranty and who owns this, you may need to consult service@rigol.com. with an explanation of two waves , same probe on calibration terminal

Good luck. Looks like front end is partially blown.

Consult manual for self test thru Utility menu

Try 1x switch