Skinny pipe entering toilet siphon flush
I missed it as it was hidden in a decorative metal feature on the toilet.

There is a gasket and a kind of plastic locking plate specifically to tackle this issue.