1. A pattern recognition apparatus for creating multiple systems and combining the multiple systems to improve recognition performance, comprising a discriminative training unit for constructing model parameters of a second or subsequent system based on an output tendency of a previously-constructed model so as to be different from the output tendency of the previously-constructed model.