Towards Safe Robot Foundation Models