Park, Kyung-Wha
M2FN: Multi-step Modality Fusion for Advertisement Image Assessment
Park, Kyung-Wha, Ha, Jung-Woo, Lee, JungHoon, Kwon, Sunyoung, Kim, Kyung-Min, Zhang, Byoung-Tak
Assessing advertisements, specifically on the basis of user preferences and ad quality, is crucial to the marketing industry. Although recent studies have attempted to use deep neural networks for this purpose, these studies have not utilized image-related auxiliary attributes, which include embedded text frequently found in ad images. We, therefore, investigated the influence of these attributes on ad image preferences. First, we analyzed large-scale real-world ad log data and, based on our findings, proposed a novel multi-step modality fusion network (M2FN) that determines advertising images likely to appeal to user preferences. Our method utilizes auxiliary attributes through multiple steps in the network, which include conditional batch normalization-based low-level fusion and attention-based high-level fusion. We verified M2FN on the AVA dataset, which is widely used for aesthetic image assessment, and then demonstrated that M2FN can achieve state-of-the-art performance in preference prediction using a real-world ad dataset with rich auxiliary attributes.
Perception-Action-Learning System for Mobile Social-Service Robots Using Deep Learning
Lee, Beom-Jin (Seoul National University) | Choi, Jinyoung (Seoul National University) | Lee, Chung-Yeon (Seoul National University) | Park, Kyung-Wha (Seoul National University) | Choi, Sungjun (Seoul National University) | Han, Cheolho (Seoul National University) | Han, Dong-Sig (Seoul National University) | Baek, Christina (Seoul National University) | Emaase, Patrick Mokodir (Seoul National University) | Zhang, Byoung-Tak (Seoul National University)
We introduce a novel perception-action-learning system for mobile social-service robots. The state-of-the-art deep learning techniques were incorporated into each module which significantly improves the performance in solving social service tasks. The system not only demonstrated fast and robust performance in a homelike environment but also achieved the highest score in the RoboCup2017@Home Social Standard Platform League (SSPL) held in Nagoya, Japan.
Uncovering Response Biases in Recommendation
Park, Kyung-Wha (Seoul National University) | Kim, Byoung-Hee (Seoul National University) | Park, Tae-Suh (Seoul National University) | Zhang, Byoung-Tak (Seoul National University)
An user-specific tendency of biased movie rating is investigated, leading six identified types of rating pattern in a massive movie rating dataset. Based on the observed bias assumption, we propose a rescaling method of preferential scores by considering the rating types. Experimental results show significant enhancement for movie recommendation systems.