How would Buddhists respond to someone harming the temple?
This is highly subjective, but practically speaking, If you go to a Buddhist country and try to engage in vandalism, the chances are that the people nearby will beat the living daylights out of you until a monk interferes and calms them down. After that you will be arrested by the police.

It would be a big mistake to think that the average lay Buddhist is meek or timid.