How to reverse ReLU activation in deconvolution
It's not reversing the ReLU, but applying normal ReLU activation again after max pooling and max unpooling.  

It is used again 


  "to obtain valid feature reconstructions at each layer (which also should be positive)"