Solving Markov Decision Processes with Partial State Abstractions
Samer B. Nashed Justin Svegliato Matteo Brucato Connor Basich Rod Grupen Shlomo Zilberstein Samer B. Nashed Justin Svegliato Matteo Brucato Connor Basich Rod Grupen Shlomo Zilberstein
Autonomous systems often use approximate planners that exploit state abstractions to solve large MDPs in real-time decision-making problems. However, these planners can eliminate details needed to produce effective behavior in autonomous systems. We therefore propose a novel model, a partially abstract MDP, with a set of abstract states that each compress a set of ground states to condense irrelev...