Deep Reinforcement Learning-Based Semi-Autonomous Control for Magnetic Micro-robot Navigation with Immersive Manipulation Y udong Mao, Dandan Zhang Abstract -- Magnetic micro-robots have demonstrated immense potential in biomedical applications, such as in vivo drug delivery, non-invasive diagnostics, and cell-based therapies, owing to their precise maneuverability and small size. However, current micromanipulation techniques often rely solely on a two-dimensional (2D) microscopic view as sensory feedback, while traditional control interfaces do not provide an intuitive manner for operators to manipulate micro-robots. These limitations increase the cognitive load on operators, who must interpret limited feedback and translate it into effective control actions. T o address these challenges, we propose a Deep Reinforcement Learning-Based Semi-Autonomous Control (DRL-SC) framework for magnetic micro-robot navigation in a simulated microvascular system. Our framework integrates Mixed Reality (MR) to facilitate immersive manipulation of micro-robots, thereby enhancing situational awareness and control precision. Simulation and experimental results demonstrate that our approach significantly improves navigation efficiency, reduces control errors, and enhances the overall robustness of the system in simulated microvascular environments. I NTRODUCTION Over the past few decades, significant advancements have been made in the manipulation of magnetic micro-robots, facilitating precise drug delivery [1]-[3], non-invasive diagnostics [4], and cell-based therapies [5]-[7]. Magnetic micro-robots are typically small, enabling them to navigate complex and narrow spaces within the human body in a non-contact manner [8].

Soft robotic manipulators are generally slow despite their great adaptability, resilience, and compliance. This limitation also extends to current soft robotic micromanipulators. Here, we introduce FilMBot, a 3-DOF film-based, electromagnetically actuated, soft kinematic robotic micromanipulator achieving speeds up to 2117 $\deg$/s and 2456 $\deg$/s in $\alpha$ and $\beta$ angular motions, with corresponding linear velocities of 1.61 m/s and 1.92 m/s using a 4-cm needle end-effector, and 1.57 m/s along the Z axis. The robot can reach ~1.50 m/s in path-following tasks, operates at frequencies up to 30 Hz, and remains functional up to 50 Hz. It demonstrates high precision (~6.3 $\mu$m, or ~0.05% of its workspace) in small path-following tasks. The novel combination of the low-stiffness soft kinematic film structure and strong electromagnetic actuation in FilMBot opens new avenues for soft robotics. Furthermore, its simple construction and inexpensive, readily accessible components could broaden the application of micromanipulators beyond current academic and professional users.

A compliant parallel micromanipulator is a mechanism in which the moving platform is connected to the base through a number of flexural components. Utilizing parallel-kinematics configurations and flexure joints, the monolithic micromanipulators can achieve extremely high motion resolution and accuracy. In this work, the focus was towards the experimental evaluation of a 3-DOF ($Z{\theta}_{x}{\theta}_{y}$) monolithic flexure-based piezo-driven micromanipulator for precise out-of-plane micro/nano positioning applications. The monolithic structure avoids the deficiencies of non-monolithic designs such as backlash, wear, friction, and improves the performance of micromanipulator in terms of high resolution, accuracy, and repeatability. A computational study was conducted to investigate and obtain the inverse kinematics of the proposed micromanipulator. As a result of computational analysis, the developed prototype of the micromanipulator is capable of executing large motion range of $\pm$238.5$\mu$m $\times$ $\pm$4830.5$\mu$rad $\times$ $\pm$5486.2$\mu$rad. Finally, a sliding mode control strategy with nonlinear disturbance observer (SMC-NDO) was designed and implemented on the proposed micromanipulator to obtain system behaviors during experiments. The obtained results from different experimental tests validated the fine micromanipulator's positioning ability and the efficiency of the control methodology for precise micro/nano manipulation applications. The proposed micromanipulator achieved very fine spatial and rotational resolutions of $\pm$4nm, $\pm$250nrad, and $\pm$230nrad throughout its workspace.