On 16 March 1883, aboard the screw sloop-of-war off Honolulu, Hawaii, Olsen jumped overboard and saved a fellow sailor from drowning.
Olsen died on 20 February 1886 and is buried in Cypress Hills National Cemetery, Section 6, Grave 12616, in Brooklyn, New York City, New York.