Altium Symbol Wizard only in imperial
Long story short: Don't use metric for schematics. Use the supplied DXP units whereas 1DXP unit = 10mil.
You will encounter lots of problems when using metric symbols.

We're using metric for the PCB and about everything else, but imperial for the schematic.

Do yourself a favor, don't use metric for the schematic.