Only Benedict and his sister Hannah survived to adulthood ; his other brothers and sisters died of yellow fever in childhood . Only Benedict and his sister Hannah survived to adulthood ; his other siblings succumbed to yellow fever in childhood .