Lee, Junyong
Enhancing Circuit Trainability with Selective Gate Activation Strategy
Cho, Jeihee, Lee, Junyong, Justice, Daniel, Kim, Shiho
Quantum computing has shown promise in solving complex Techniques such as layerwise training (Skolik et al. problems in domains such as quantum chemistry, optimization, 2021) and parameter initialization schemes based on symmetry and machine learning, leveraging Variational Quantum considerations (Pesah et al. 2021) have been proposed Algorithms (VQAs) such as Quantum Approximate to achieve this. Optimization Algorithms (QAOA) (Farhi, Goldstone, and Local cost functions, selective parameter training, and Gutmann 2014; Pagano et al. 2020), Variational Quantum structured initialization methods have shown promise in mitigating Eigensolvers (VQE) (Kandala et al. 2017; Tilly et al. 2022), trainability challenges without significantly compromising and recently, quantum neural networks (QNNs) (Schuld and circuit expressibility. Moreover, techniques like symmetric Killoran 2019; Killoran et al. 2019) as a hybrid quantumclassical pruning (Wang et al. 2023), which leverage circuit framework in the Noisy Intermediate-Scale Quantum symmetries to reduce the effective parameter space, have (NISQ) era.
Q-MAML: Quantum Model-Agnostic Meta-Learning for Variational Quantum Algorithms
Lee, Junyong, Cho, JeiHee, Kim, Shiho
In the Noisy Intermediate-Scale Quantum (NISQ) era, using variational quantum algorithms (VQAs) to solve optimization problems has become a key application. However, these algorithms face significant challenges, such as choosing an effective initial set of parameters and the limited quantum processing time that restricts the number of optimization iterations. In this study, we introduce a new framework for optimizing parameterized quantum circuits (PQCs) that employs a classical optimizer, inspired by Model-Agnostic Meta-Learning (MAML) technique. This approach aim to achieve better parameter initialization that ensures fast convergence. Our framework features a classical neural network, called Learner}, which interacts with a PQC using the output of Learner as an initial parameter. During the pre-training phase, Learner is trained with a meta-objective based on the quantum circuit cost function. In the adaptation phase, the framework requires only a few PQC updates to converge to a more accurate value, while the learner remains unchanged. This method is highly adaptable and is effectively extended to various Hamiltonian optimization problems. We validate our approach through experiments, including distribution function mapping and optimization of the Heisenberg XYZ Hamiltonian. The result implies that the Learner successfully estimates initial parameters that generalize across the problem space, enabling fast adaptation.
Emotion Recognition Using Transformers with Masked Learning
Min, Seongjae, Yang, Junseok, Lim, Sangjun, Lee, Junyong, Lee, Sangwon, Lim, Sejoon
In recent years, deep learning has achieved innovative advancements in various fields, including the analysis of human emotions and behaviors. Initiatives such as the Affective Behavior Analysis in-the-wild (ABAW) competition have been particularly instrumental in driving research in this area by providing diverse and challenging datasets that enable precise evaluation of complex emotional states. This study leverages the Vision Transformer (ViT) and Transformer models to focus on the estimation of Valence-Arousal (VA), which signifies the positivity and intensity of emotions, recognition of various facial expressions, and detection of Action Units (AU) representing fundamental muscle movements. This approach transcends traditional Convolutional Neural Networks (CNNs) and Long Short-Term Memory (LSTM) based methods, proposing a new Transformer-based framework that maximizes the understanding of temporal and spatial features. The core contributions of this research include the introduction of a learning technique through random frame masking and the application of Focal loss adapted for imbalanced data, enhancing the accuracy and applicability of emotion and behavior analysis in real-world settings. This approach is expected to contribute to the advancement of emotional computing and deep learning methodologies.
Rationale-aware Autonomous Driving Policy utilizing Safety Force Field implemented on CARLA Simulator
Suk, Ho, Kim, Taewoo, Park, Hyungbin, Yadav, Pamul, Lee, Junyong, Kim, Shiho
Despite the rapid improvement of autonomous driving technology in recent years, automotive manufacturers must resolve liability issues to commercialize autonomous passenger car of SAE J3016 Level 3 or higher. To cope with the product liability law, manufacturers develop autonomous driving systems in compliance with international standards for safety such as ISO 26262 and ISO 21448. Concerning the safety of the intended functionality (SOTIF) requirement in ISO 26262, the driving policy recommends providing an explicit rational basis for maneuver decisions. In this case, mathematical models such as Safety Force Field (SFF) and Responsibility-Sensitive Safety (RSS) which have interpretability on decision, may be suitable. In this work, we implement SFF from scratch to substitute the undisclosed NVIDIA's source code and integrate it with CARLA open-source simulator. Using SFF and CARLA, we present a predictor for claimed sets of vehicles, and based on the predictor, propose an integrated driving policy that consistently operates regardless of safety conditions it encounters while passing through dynamic traffic. The policy does not have a separate plan for each condition, but using safety potential, it aims human-like driving blended in with traffic flow.
A Survey on Deep Reinforcement Learning-based Approaches for Adaptation and Generalization
Yadav, Pamul, Mishra, Ashutosh, Lee, Junyong, Kim, Shiho
Deep Reinforcement Learning (DRL) aims to create intelligent agents that can learn to solve complex problems efficiently in a real-world environment. Typically, two learning goals: adaptation and generalization are used for baselining DRL algorithm's performance on different tasks and domains. This paper presents a survey on the recent developments in DRL-based approaches for adaptation and generalization. We begin by formulating these goals in the context of task and domain. Then we review the recent works under those approaches and discuss future research directions through which DRL algorithms' adaptability and generalizability can be enhanced and potentially make them applicable to a broad range of real-world problems.