1. An image processing device comprising: a predictive vector generating unit that generates a predictive vector of a current parallax vector of a current block used in prediction using correlation in a parallax direction using a reference parallax vector referred when generating a predictive motion vector, when encoding the current parallax vector; and a difference vector generating unit that generates a difference vector between the current parallax vector and the predictive vector generated by the predictive vector generating unit.