It is never okay to let your cat drink tea. Caffeine in large enough quantities can be fatal for a cat, and since many teas contain caffeine, this is a huge no-no for kitty.t is never okay to let your cat drink tea. Caffeine in large enough quantities can be fatal for a cat, and since many teas contain caffeine, this is a huge no-no for kitty.