Can I connect the UPS neutral to my mains neutral permanently?
If the neutral is just a straight wire through the UPS, and it almost certainly is, then this would have no effect. If not, then this would be a very bad idea. I wouldn't connect the neutral at all. (Of course, this may be a bad idea for other reasons, not the least of which is it would certainly violate code.)