Do non-ergodic chemical reactions exist?
The time point of the radioactive decay of a single atom cannot be predicted, even given all experimentally available information, and is not even predictable theoretically by any possible means. 

Just isolate a single atom and observe its radioactive decay, and you have the purely random system you strive for. Could also take more than one atom and observe fluctuations with Geiger counter.