 In recent years, "actor–critic methods" have been proposed and performed well on various problems.Both the asymptotic and finite-sample behavior of most algorithms is well understood.Algorithms with provably good online performance (addressing the exploration issue) are known.