Olshausen was born in Hohenfelde, and studied at Kiel, Berlin and Paris, where he was a student of Silvestre de Sacy (1758-1838).
In 1860, he became a full member of the Prussian Academy of Sciences, and in 1874 was appointed counselor to the Ministry of Education in Berlin.