Goto

Collaborating Authors

 Wang, Dongyi


Data-Driven Contact-Aware Control Method for Real-Time Deformable Tool Manipulation: A Case Study in the Environmental Swabbing

arXiv.org Artificial Intelligence

S automation advances, robots are increasingly utilized for complex tasks, reducing manual labor in hazardous environments while improving efficiency, precision, and cost-effectiveness [1]. However, real-world robotic applications require seamless interaction with deformable objects, which presents significant challenges due to material flexibility and unpredictable shape changes [2]. Unlike rigid object manipulation, deformable object manipulation (DOM) requires real-time adaptive control to compensate for continuous state variations and external forces. Traditional physics-based control models, such as mass-spring systems and finite element methods [3], [4], [5], attempt to model deformable object behavior but often fall short in real-world applications due to the sensitvity of control parameters and the difficulty of modeling complex contact dynamics. To address these limitations, recent research has shifted toward machine learning and data-driven approaches, where robots learn from sensor feedback or demonstrations rather than relying on hard-coded models [6]. Predictive learning models [7], [8], [9] have proven effective for latent space learning and object behavior forecasting, improving adaptability across applications such as fabric repositioning [10], crop harvesting [11], [12], medical robotics [13], and deformable linear object manipulation [14], [15]. While significant progress has been made in DOM, little research has focused on deformable tool manipulation (DTM), which introduces additional complexities such as bending dynamics, force regulation, and stability issues.


Efficient Auto-Labeling of Large-Scale Poultry Datasets (ALPD) Using Semi-Supervised Models, Active Learning, and Prompt-then-Detect Approach

arXiv.org Artificial Intelligence

The rapid growth of AI in poultry farming has highlighted the challenge of efficiently labeling large, diverse datasets. Manual annotation is time-consuming, making it impractical for modern systems that continuously generate data. This study explores semi-supervised auto-labeling methods, integrating active learning, and prompt-then-detect paradigm to develop an efficient framework for auto-labeling of large poultry datasets aimed at advancing AI-driven behavior and health monitoring. Viideo data were collected from broilers and laying hens housed at the University of Arkansas and the University of Georgia. The collected videos were converted into images, pre-processed, augmented, and labeled. Various machine learning models, including zero-shot models like Grounding DINO, YOLO-World, and CLIP, and supervised models like YOLO and Faster-RCNN, were utilized for broilers, hens, and behavior detection. The results showed that YOLOv8s-World and YOLOv9s performed better when compared performance metrics for broiler and hen detection under supervised learning, while among the semi-supervised model, YOLOv8s-ALPD achieved the highest precision (96.1%) and recall (99.0%) with an RMSE of 1.9. The hybrid YOLO-World model, incorporating the optimal YOLOv8s backbone, demonstrated the highest overall performance. It achieved a precision of 99.2%, recall of 99.4%, and an F1 score of 98.7% for breed detection, alongside a precision of 88.4%, recall of 83.1%, and an F1 score of 84.5% for individual behavior detection. Additionally, semi-supervised models showed significant improvements in behavior detection, achieving up to 31% improvement in precision and 16% in F1-score. The semi-supervised models with minimal active learning reduced annotation time by over 80% compared to full manual labeling. Moreover, integrating zero-shot models enhanced detection and behavior identification.