In the Bakumatsu period, Inoue emerged as a leader of the antiforeigner movement in his native Chōshū.
Recognizing Japan's need to learn from the western powers, Inoue joined the Chōshū Five and was smuggled out of Japan to study at University College, London in England in 1863.