How do I fix a leaky hydrant?
Here is the manual for this hydrant:

Woodford Sanitary Hydrant

Perhaps you're not pulling down on the diverter enough to close it.  If that's not it, then the diverter is either damaged or has foreign material in it that is causing it not to seal.  Either clean it out or replace it.