How can I stop a board from "leaking" sap?
It's a pitch pocket.

Just give it time - "a few days" is not much time in this case - it might ooze for a year before it gets done. You could try heating it (to make it ooze out faster), but that might have detrimental effects such as checking, a.k.a. cracking; or in this case, cracking more.