Language-guided Semantic Mapping and Mobile Manipulation in Partially Observable Environments