Motivation for Inverse Reinforcement Learning
Often the transition model is not known in advance.  For instance, consider a complex system like flying a helicopter or surfing a surfboard.  It's not easy to characterize in advance what the behavior of the system will be, in response to certain control inputs; the relationship may be highly nonlinear and complex.