Bulging capacitor - already leaked? replace urgently?
is the white goop indeed just glue?


Yes

if it is glue: what is its purpose?


To stop the capacitor from wobbling and breaking its leads off.

does the capacitor need to be removed urgently?


No, but it probably has reduced performance and will fail soon, so replacing it would be a good idea.