Planning for Proactive Assistance in Environments with Partial Observability