If I take any body in the shape of a rod and stretch that, after it reaches breaking stress it breaks at one point.

Even though we apply the same the stress on each and every part of the rod it broke at one point. If it's uniform it should break at all points because breaking stress is same for all the parts of body as it's uniform.