How can I reconnect a compression joint without replacing the olive?
It's important to make sure that the olive fits exactly square on to the fitting and is completely clean. Any trace of dirt and you're likely to prevent a proper seal. 

I'd not advise using PTFE thread-sealing tape over the olive itself, rather over the thread to which the nut is connecting.