What to do about referral for student I would not recommend?
Why do you dread his reaction? You have no responsibility of giving anyone a referral. I doubt "this professor did not write me a referral" would stand as an excuse to allege persecution in any tribunal.  Don't get bullied by a student, just plainly refuse to do a referal if you are not up for it.