dribbler
ZJUNlict Extended Team Description Paper 2025
Wu, Zifei, Wang, Lijie, Yang, Zhe, Yang, Shijie, Wang, Liang, Fu, Haoran, Cai, Yinliang, Xiong, Rong
This paper presents the ZJUNlict team's work over the past year, covering both hardware and software advancements. In the hardware domain, the integration of an IMU into the v2023 robot was completed to enhance posture accuracy and angular velocity planning. On the software side, key modules were optimized, including the strategy and CUDA modules, with significant improvements in decision-making efficiency, ball pursuit prediction, and ball possession prediction to adapt to high-tempo game dynamics.
Reinforcement Learning for the Soccer Dribbling Task
Carvalho, Arthur, Oliveira, Renato
We propose a reinforcement learning solution to the \emph{soccer dribbling task}, a scenario in which a soccer agent has to go from the beginning to the end of a region keeping possession of the ball, as an adversary attempts to gain possession. While the adversary uses a stationary policy, the dribbler learns the best action to take at each decision point. After defining meaningful variables to represent the state space, and high-level macro-actions to incorporate domain knowledge, we describe our application of the reinforcement learning algorithm \emph{Sarsa} with CMAC for function approximation. Our experiments show that, after the training period, the dribbler is able to accomplish its task against a strong adversary around 58% of the time.