Can I write a referee report too fast?
Fast is great! Just be warned that it means editors will like you and send you more requests so you’ll have to learn to say no.  If you also say “no” quickly and suggest alternatives, then you’ll still leave a good impression with the editors.