Skim Coat after Primer?
Absolutely you can skim. (Lots of people deliberately prime in order to see the defects that might not be obvious.)

If you can, use topping mud, which will sand more easily and give a better feathered edge than all purpose mud.