Irregular, random data (or noise) do not permit any wow-effects or learning progress, and thus are "boring" by nature (providing no reward). Already-known and predictable regularities also are boring. Temporarily interesting are only the initially unknown, novel, regular patterns in both actions and observations. This motivates the agent to perform continual, open-ended, active, creative exploration.
Irregular, random data (or noise) do not permit any wow-effects or learning progress, and thus are "boring" by nature (providing no reward). Already-known and predictable regularities also are boring. Temporarily interesting are only the initially unknown, novel, regular patterns in both actions and observations This motivates the agent to perform continual, open-ended, active, creative exploration.