(POMDP) an R package providing an interface to Tony Cassandra's POMDP solver. zmdp, a POMDP solver by Trey Smith APPL, a fast point-based POMDP solver pyPOMDP, a (PO)MDP toolbox (simulator, solver, learner, file reader) for Python by Oliver Stollmann and Bastian Migge Finite-state Controllers using Branch-and-Bound An Exact POMDP Solver for Policies of a Bounded Size POMDPs.jl, an interface for defining and solving MDPs and POMDPs in Julia and python with a variety of solvers. Dynamic programming Markov processes Stochastic control