What makes some POMDP problems easy to approximate?