Somebody gives us or we manage to construct a dataset D which consists of a bunch of samples from a distribution P. And for the moment we're going to assume that these samples are what's called iid, which stands for independent, and identically distributed. 