1. A sound reproducing apparatus, comprising: a virtual sound signal generation unit which generates more than one virtual sound signal corresponding to locations and a number of target virtual sound sources on the basis of more than one inputted sound signal; and a virtual sound signal downmix unit which downmixes said more than one virtual sound signal to virtual sound signal outputs corresponding to a predetermined number of output channels, wherein the virtual sound signal generation unit includes: an adder which adds at least two sound signals selected from among said more than one inputted sound signal and generates an added sound signal; a subtracter which subtracts at least two sound signals selected from among said more than one inputted sound signal and generates a subtracted sound signal; and a gain adjustment unit which adjusts said more than one inputted sound signal, the added sound signal and the subtracted sound signal to predetermined optimal gains by corresponding to locations and the number of the target virtual sound sources.