British leaders accused American rebels of starting the fire , and most assumed that one side or the other had started it . British leaders accused rebels acting within the city , and many residents assumed that one side or the other had started it .