What does "/2" in the structure of calcium benzoate mean?
It means half of calcium.

The organic acid is $\rm{COO}^-$, whereas calcium is $\rm{Ca}^{2+}$. For the structure to be fully correct, there are two benzoic acids per one calcium. Other way round this would be $\rm{(C_6H_5COO)_2Ca}$. Full drawing of this will be way to messy, so it is simpler to put half calcium to one acid.