title: Library for a Markov Decision Process in C#
body: <p>I'm working on a project to create an AI engine, where a robot is exploring a 2D gridded world and has to decide what square to move to next. Are there existing Markov libraries that could be used (ie. I would just change the parameters), or samples that exist? </p>