Adaptivity to the difficulties of a problem is a key property in sequential decision-making problems to broaden the applicability of algorithms.

Adaptivity to the difficulties of a problem is a key property in sequential decision-making problems to broaden the applicability of algorithms.

Easily integrated, FamO2O statistically enhances existing algorithms' performance.

In reinforcement learning (RL), agents sequentially interact with a changing environment, aiming to collect as much reward as possible.

Safe reinforcement learning (RL) is a promising approach for many real-world decision-making problems where ensuring safety is a critical necessity.

Section C describes the details of the experimental setup, including network architectures, hyperparameters,andhardwaredetails. Thisoutcomeemphasizes the necessity of feature interaction or feature fusion to tackle intricate situations. Furthermore, an amalgamation of feature fusion and value fusion can offer better performance. This adjustment allows us to evaluate the robustness and adaptability of our approach in handling a larger number of vehicles in the environment. As we increase the number of vehicles on the road, Fig. A2 (a) clearly indicates that HAVE consistently delivers the highest performance. The training and testing curves of HAVE and other comparable methods are given in A4.