Is it safe to apply voltage to buffer output?
What you need is Tri-state buffers.
When one output or one input is not in use, it can be set as high impedance with the EN or -OE pins. And so the input or output is protected up to Vcc or even sometimes above that.