Can Taq polymerase be stored with PCR primers?
Yes, this is perfectly fine. Many companies sell PCR Master Mixes (granted, without primers):

Thermo Fisher
Sigma-Aldrich
BioRad
Promega
Qiagen

If you choose to make your own, make sure it's stored at -20°C, and be sure to aliquot it so it's not going to be subjected to multiple freeze/thaw cycles. Obviously you should mix it well before aliquoting, but even after thawing I would vortex it to make sure all of the components are well-mixed. Make a 2X master mix, and adjust to a final 1X concentration in the PCR tube with your DNA sample and nuclease-free H2O.