Sprinkler Anti Siphon valve is leaking from cap
The anti-siphon valve is a one-way valve that should allow air in when there is a lower pressure inside the system but should close when there is water pressure.

It sounds like the valve is not closing, perhaps it has some dirt or other material blocking it.  You might disassemble and clean it and replace any worn or broken pieces.