Researchers Augment Robotic Prosthetics With AI and Computer Vision – IAM Network

The AI in robotic prostheses predicts the type of terrain users will be stepping on, quantifies the uncertainties associated with that prediction, and then incorporates that uncertainty into its decision-making. Researchers at North Carolina State University have integrated computer vision and artificial intelligence into off-the-shelf robotic prosthetics to improve walking on different types of terrain. The team built a device that attaches to the prosthetic limb to track movement and recognize different terrains. The AI is able to recognize six different terrains: downstairs, upstairs, cement, grass, tile, and concrete. "Lower-limb robotic prosthetics need to execute different behaviors based on the terrain users are walking on," said Edgar Lobaton, associate professor of computer engineering at North Carolina State University.