Kelly went with the French Foreign Legion to Mexico.
He was a close associate of John O'Connor Power and, in 1877, he persuaded John Devoy to take a positive approach to the Irish party's policy at Westminster.