Goto

Collaborating Authors

 Park, Kyung-Wha


M2FN: Multi-step Modality Fusion for Advertisement Image Assessment

arXiv.org Artificial Intelligence

Assessing advertisements, specifically on the basis of user preferences and ad quality, is crucial to the marketing industry. Although recent studies have attempted to use deep neural networks for this purpose, these studies have not utilized image-related auxiliary attributes, which include embedded text frequently found in ad images. We, therefore, investigated the influence of these attributes on ad image preferences. First, we analyzed large-scale real-world ad log data and, based on our findings, proposed a novel multi-step modality fusion network (M2FN) that determines advertising images likely to appeal to user preferences. Our method utilizes auxiliary attributes through multiple steps in the network, which include conditional batch normalization-based low-level fusion and attention-based high-level fusion. We verified M2FN on the AVA dataset, which is widely used for aesthetic image assessment, and then demonstrated that M2FN can achieve state-of-the-art performance in preference prediction using a real-world ad dataset with rich auxiliary attributes.


Perception-Action-Learning System for Mobile Social-Service Robots Using Deep Learning

AAAI Conferences

We introduce a novel perception-action-learning system for mobile social-service robots. The state-of-the-art deep learning techniques were incorporated into each module which significantly improves the performance in solving social service tasks. The system not only demonstrated fast and robust performance in a homelike environment but also achieved the highest score in the RoboCup2017@Home Social Standard Platform League (SSPL) held in Nagoya, Japan.


Uncovering Response Biases in Recommendation

AAAI Conferences

An user-specific tendency of biased movie rating is investigated, leading six identified types of rating pattern in a massive movie rating dataset. Based on the observed bias assumption, we propose a rescaling method of preferential scores by considering the rating types.  Experimental results show significant enhancement for movie recommendation systems.