1. An interconnecting neural network system comprising: a neural network unit that includes a plurality of neurons, each of the neurons embodying a weight holding unit, a pointer unit, a duration variable holding unit and an activation time holding unit, each of the neurons outputting an excitation strength according to a similarity between input vectors and centroid vectors based on a kernel function; and a network control unit that constructs an artificial neural network structure by interconnecting the neurons relating to each other among the neurons in the neural network unit via respective weights, wherein each of the neurons in the neural network unit outputs an excitation strength according to the similarity between the input vectors and the centroid vectors based on the kernel function when each neuron is excited by the input vector applied from an outside, and outputs a pseudo excitation strength obtained based on the sum of excitation strength outputs from the other neurons when each neuron is excited in a chain reaction to excitation of the other neuron connected to each neuron, wherein each of the neurons in the neural network unit has a plurality of modalities different from one another, the plurality of modalities of the neurons including auditory modality and visual modality so that a plurality of different input vectors of auditory modality and visual modality are handled simultaneously and independently by the neurons to perform auditory and visual recognition concurrently.