What is this part of the heating system, and how can I stop it from leaking?
It is an automatic air vent that is supposed to allow air to escape from the heating pipes.  It should not be leaking water.  From the looks of it, it is definitely defective and should be replaced. I recommend a plumber.