Use swatches and not the color picker widget
Interesting question - You should try the color field module - 


  Color Field is simple field that use a hexadecimal notation (HEX) for
  the combination of Red, Green, and Blue color values (RGB).


This uses the jquery simple color widget



and you can add your colors directly in as hexadecimal codes when you setup the field: