Relation between group delay, pole frequency and quality factor
Ok, I figured it out! It was a mistake on my part because I assumed that
$$\tau_0=\tau_g(\omega_0)$$
While in fact
$$\tau_0=\tau_g(0)$$
Now it makes sense.