 Another is that variance of the returns may be large, which requires many samples to accurately estimate the return of each policy.These problems can be ameliorated if we assume some structure and allow samples generated from one policy to influence the estimates made for others.The two main approaches for achieving this are value function estimation and direct policy search.