Open loop oscillating
No, an open loop system will not oscillate. Comparators are a good example for this.

The phase margin is determined for the open loop system but is relevant for the closed system only.