Continual lifelong learning is essential to many applications.

However, in many real-world applications, collecting sufficient exploratory interactions is usually impractical, because online datacollection canbecostlyorevendangerous, suchasinhealthcare [4]andautonomous driving [5]. To address this challenge, offline RL [6, 7] develops a new learning paradigm that trains RL agents only with pre-collected offline datasets and thus can abstract away from the cost of online exploration [8-17].

However, in many real-world applications, collecting sufficient exploratory interactions is usually impractical, because online datacollection canbecostlyorevendangerous, suchasinhealthcare [4]andautonomous driving [5]. To address this challenge, offline RL [6, 7] develops a new learning paradigm that trains RL agents only with pre-collected offline datasets and thus can abstract away from the cost of online exploration [8-17].

Disentanglementhasbeen formalized using a symmetry-centric notion for unstructured spaces, however, graphs have eluded a similarly rigorous treatment. We fill this gap with a new notionofconditional symmetryfordisentanglement, andleveragetoolsfromLie algebras toencode graph properties intosubgroups using suitable adaptations of generative models such as Variational Autoencoders.

Moreover, we highlight the benefits of our approach in two practically relevant settings (a) expertcompression,i.e.

Some parts of the work was done while Zhenyu Huang was an internship at Baidu Inc.

In practice, however, such an assumption is extremely expensive even impossible to satisfy. Based on this observation, we reveal and study alatent and challenging direction in cross-modal matching, named noisy correspondence, which could be regarded as a new paradigm of noisylabels.