He has developed free software called Hindsight Experience Replay ( HER ) that allows failure of a robot 's artificial intelligence ( AI ) in one task to help it in another . ’s “failures” become successes. HER does not give rewards for getting one step of a task correct , rather it rewards for an entire task being completed correctly . This method slows down training but has the advantage of failures being used for the performance of another job .
He has developed free software called Hindsight Experience Replay ( HER ) that allows failure of a robot 's artificial intelligence ( AI ) in one task to help it in another . HER does not give rewards for getting one step of a task correct , rather it rewards for an entire task being completed correctly . This method slows down training but has the advantage of failures being used for the performance of another job .