Normally only the noble lords are allowed to fight and the merchant townspeople were the workers , not fighters . Only the noble lords were allowed by custom to fight , and ostensibly the merchant townspeople were workers , not warriors .