After Alexander's death James solely managed the firm until due to health reasons he retired from managing the firm in 1887.
James' son Alexander Brown (1857-1897) died on 9 February 1897, leaving the firm in the hands of John, William & Stephen.