In a sample of radioactive substance all the atoms don't disintegrate simultaneously. Why?
The basic concept of radioactive decay kinetics is that every single nucleus has the same probability of decaying at any single given time, regardless of the physical-chemical surroundings (it does not know anything about the other atoms). This of course means that they do not disintegrate all at once, because the probability of all of them "deciding to decay" at the exact same time is infinitesimally small.