There are plans to have the prison buildings made a World Heritage Site , along with other convict sites around Australia . Its prison buildings have been World Heritage listing one of 11 Australian Convict Sites .