He was made attaché to the Embassy of the United States, Berlin, and he was briefly arrested while in Mainz as a possible spy.
Herter hated working for the scandal-ridden administration of President Warren Harding, and returned to Boston, where he was a magazine editor and lecturer on international affairs.