Goto

Collaborating Authors

 robot-assisted feeding system


FEAST: A Flexible Mealtime-Assistance System Towards In-the-Wild Personalization

Jenamani, Rajat Kumar, Silver, Tom, Dodson, Ben, Tong, Shiqin, Song, Anthony, Yang, Yuting, Liu, Ziang, Howe, Benjamin, Whitneck, Aimee, Bhattacharjee, Tapomayukh

arXiv.org Artificial Intelligence

Physical caregiving robots hold promise for improving the quality of life of millions worldwide who require assistance with feeding. However, in-home meal assistance remains challenging due to the diversity of activities (e.g., eating, drinking, mouth wiping), contexts (e.g., socializing, watching TV), food items, and user preferences that arise during deployment. In this work, we propose FEAST, a flexible mealtime-assistance system that can be personalized in-the-wild to meet the unique needs of individual care recipients. Developed in collaboration with two community researchers and informed by a formative study with a diverse group of care recipients, our system is guided by three key tenets for in-the-wild personalization: adaptability, transparency, and safety. FEAST embodies these principles through: (i) modular hardware that enables switching between assisted feeding, drinking, and mouth-wiping, (ii) diverse interaction methods, including a web interface, head gestures, and physical buttons, to accommodate diverse functional abilities and preferences, and (iii) parameterized behavior trees that can be safely and transparently adapted using a large language model. We evaluate our system based on the personalization requirements identified in our formative study, demonstrating that FEAST offers a wide range of transparent and safe adaptations and outperforms a state-of-the-art baseline limited to fixed customizations. To demonstrate real-world applicability, we conduct an in-home user study with two care recipients (who are community researchers), feeding them three meals each across three diverse scenarios. We further assess FEAST's ecological validity by evaluating with an Occupational Therapist previously unfamiliar with the system. In all cases, users successfully personalize FEAST to meet their individual needs and preferences. Website: https://emprise.cs.cornell.edu/feast


An Adaptable, Safe, and Portable Robot-Assisted Feeding System

Gordon, Ethan Kroll, Jenamani, Rajat Kumar, Nanavati, Amal, Liu, Ziang, Bolotski, Haya, Karim, Raida, Stabile, Daniel, Kashyap, Atharva, Zhu, Bernie Hao, Dai, Xilai, Schrenk, Tyler, Ko, Jonathan, Faulkner, Taylor Kessler, Bhattacharjee, Tapomayukh, Srinivasa, Siddhartha

arXiv.org Artificial Intelligence

We demonstrate a robot-assisted feeding system that enables people with mobility impairments to feed themselves. Our system design embodies Safety, Portability, and User Control, with comprehensive full-stack safety checks, the ability to be mounted on and powered by any powered wheelchair, and a custom web-app allowing care-recipients to leverage their own assistive devices for robot control. For bite acquisition, we leverage multi-modal online learning to tractably adapt to unseen food types. For bite transfer, we leverage real-time mouth perception and interaction-aware control. Co-designed with community researchers, our system has been validated through multiple end-user studies.


A framework to optimize the efficiency and comfort of robot-assisted feeding systems

#artificialintelligence

Robots could be invaluable allies for older adults and people with physical disabilities, as they could assist them in their day-to-day life and reduce their reliance on human carers. A type of robotic systems that could be particularly helpful are assisted feeding or bite-transfer robots, which are designed to pick up food from a plate and feed humans who are unable to move their arms or coordinate their movements. While many research teams worldwide have tried to develop robot-assisted feeding systems, most existing solutions do not consider how comfortable a user will feel when receiving a bite of food from the robot. In other words, these systems can be efficient at grasping and transferring foods of different shapes and sizes, but they do not consider how the bite will be received by users, for instance whether the robot will invertedly poke the user's face or mouth with the fork while delivering the bite. Researchers at Stanford University, University of Washington and Cornell University recently developed a new framework that tries to achieve an optimal balance between the efficiency and comfort of robot-assisted feeding systems.