gello
ACE-F: A Cross Embodiment Foldable System with Force Feedback for Dexterous Teleoperation
Yan, Rui, Fu, Jiajian, Yang, Shiqi, Paulsen, Lars, Cheng, Xuxin, Wang, Xiaolong
Teleoperation systems are essential for efficiently collecting diverse and high-quality robot demonstration data, especially for complex, contact-rich tasks. However, current teleoperation platforms typically lack integrated force feedback, cross-embodiment generalization, and portable, user-friendly designs, limiting their practical deployment. To address these limitations, we introduce ACE-F, a cross embodiment foldable teleoperation system with integrated force feedback. Our approach leverages inverse kinematics (IK) combined with a carefully designed human-robot interface (HRI), enabling users to capture precise and high-quality demonstrations effortlessly. We further propose a generalized soft-controller pipeline integrating PD control and inverse dynamics to ensure robot safety and precise motion control across diverse robotic embodiments. Critically, to achieve cross-embodiment generalization of force feedback without additional sensors, we innovatively interpret end-effector positional deviations as virtual force signals, which enhance data collection and enable applications in imitation learning. Extensive teleoperation experiments confirm that ACE-F significantly simplifies the control of various robot embodiments, making dexterous manipulation tasks as intuitive as operating a computer mouse. The system is open-sourced at: https://acefoldable.github.io/
- North America > United States > California > San Diego County > San Diego (0.04)
- Asia > South Korea > Daegu > Daegu (0.04)
Improving Low-Cost Teleoperation: Augmenting GELLO with Force
Sujit, Shivakanth, Nunziante, Luca, Lillrank, Dan Ogawa, Dossa, Rousslan Fernand Julien, Arulkumaran, Kai
-- In this work we extend the low-cost GELLO teleoperation system, initially designed for joint position control, with additional force information. Our first extension is to implement force feedback, allowing users to feel resistance when interacting with the environment. Our second extension is to add force information into the data collection process and training of imitation learning models. We validate our additions by implementing these on a GELLO system with a Franka Panda arm as the follower robot, performing a user study, and comparing the performance of policies trained with and without force information on a range of simulated and real dexterous manipulation tasks. Qualitatively, users with robotics experience preferred our controller, and the addition of force inputs improved task success on the majority of tasks. I. INTRODUCTION In the last few years, there has been a rapid increase in the scope of abilities demonstrated by robots, driven by advances in machine learning (ML). Examples of such abilities include champion-level drone racing [1] and quadruped parkour [2], achieved through reinforcement learning (RL), or wheeled/humanoid loco-manipulation [3], [4], achieved through imitation learning (IL).
- North America > United States (0.14)
- Asia > Japan > Honshū > Kantō > Tokyo Metropolis Prefecture > Tokyo (0.14)
GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulators
Wu, Philipp, Shentu, Yide, Yi, Zhongke, Lin, Xingyu, Abbeel, Pieter
Imitation learning from human demonstrations is a powerful framework to teach robots new skills. However, the performance of the learned policies is bottlenecked by the quality, scale, and variety of the demonstration data. In this paper, we aim to lower the barrier to collecting large and high-quality human demonstration data by proposing GELLO, a general framework for building low-cost and intuitive teleoperation systems for robotic manipulation. Given a target robot arm, we build a GELLO controller that has the same kinematic structure as the target arm, leveraging 3D-printed parts and off-the-shelf motors. GELLO is easy to build and intuitive to use. Through an extensive user study, we show that GELLO enables more reliable and efficient demonstration collection compared to commonly used teleoperation devices in the imitation learning literature such as VR controllers and 3D spacemouses. We further demonstrate the capabilities of GELLO for performing complex bi-manual and contact-rich manipulation tasks. To make GELLO accessible to everyone, we have designed and built GELLO systems for 3 commonly used robotic arms: Franka, UR5, and xArm. All software and hardware are open-sourced and can be found on our website: https://wuphilipp.github.io/gello/.
- South America > Uruguay > Artigas > Artigas (0.04)
- North America > United States > California > Alameda County > Berkeley (0.04)