 Policy search methods may converge slowly given noisy data.For example, this happens in episodic problems when the trajectories are long and the variance of the returns is large.Value-function based methods that rely on temporal differences might help in this case.