from the deck of the defiance , at anchor near the river mouth and across the bay from the peninsula , the gunfire seemed to be coming from the direction of the new assembly room , a thatched-roof stone building up the hill beyond the breastwork .