Multitask Reinforcement Learning for Quadcopter Attitude Stabilization and Tracking using Graph Policy
Liu, Yu Tang, Vale, Afonso, Ahmad, Aamir, Ventura, Rodrigo, Basiri, Meysam
–arXiv.org Artificial Intelligence
Quadcopter attitude control involves two tasks: smooth attitude tracking and aggressive stabilization from arbitrary states. Although both can be formulated as tracking problems, their distinct state spaces and control strategies complicate a unified reward function. We propose a multitask deep reinforcement learning framework that leverages parallel simulation with IsaacGym and a Graph Convolutional Network (GCN) policy to address both tasks effectively. Our multitask Soft Actor-Critic (SAC) approach achieves faster, more reliable learning and higher sample efficiency than single-task methods. We validate its real-world applicability by deploying the learned policy - a compact two-layer network with 24 neurons per layer - on a Pixhawk flight controller, achieving 400 Hz control without extra computational resources. We provide our code at https://github.com/robot-perception-group/GraphMTSAC\_UAV/.
arXiv.org Artificial Intelligence
Mar-11-2025
- Country:
- North America > United States
- Nevada > Washoe County > Reno (0.04)
- Europe
- Portugal > Lisbon
- Lisbon (0.04)
- Germany > Baden-Württemberg
- Tübingen Region > Tübingen (0.14)
- Stuttgart Region > Stuttgart (0.05)
- Portugal > Lisbon
- North America > United States
- Genre:
- Research Report (0.82)
- Industry:
- Information Technology (0.68)
- Transportation
- Air (0.49)
- Infrastructure & Services (0.34)
- Technology: