In 1839 he left the Navy, and travelled to Australia, to join his elder brother Frederick William Bigge, who had settled in New South Wales.
About 1852, Bigge had Cleveland House built for him in Cleveland; it may have been intended as a hotel, but was unoccupied for many years and became known as Bigge's Folly.