Issues with using greedy algorithm (Interval scheduling variant)
It is clear from your edited post that you will need to use dynamic programming. 

Consider solution with the recurrence based on minimum number of time intervals necessary to conflict with all other time intervals, and include a parent pointer so that you can create the set after the algorithm completes.