it probably was painted in the living room of one of his houses here , not sure which one because he had a big house here in town on east bay street that burned down in the great fire of 1863 , and also had plantation houses outside town .