Fang, Gengfa
Millimeter Wave Radar-based Human Activity Recognition for Healthcare Monitoring Robot
Gu, Zhanzhong, He, Xiangjian, Fang, Gengfa, Xu, Chengpei, Xia, Feng, Jia, Wenjing
Healthcare monitoring is crucial, especially for the daily care of elderly individuals living alone. It can detect dangerous occurrences, such as falls, and provide timely alerts to save lives. Non-invasive millimeter wave (mmWave) radar-based healthcare monitoring systems using advanced human activity recognition (HAR) models have recently gained significant attention. However, they encounter challenges in handling sparse point clouds, achieving real-time continuous classification, and coping with limited monitoring ranges when statically mounted. To overcome these limitations, we propose RobHAR, a movable robot-mounted mmWave radar system with lightweight deep neural networks for real-time monitoring of human activities. Specifically, we first propose a sparse point cloud-based global embedding to learn the features of point clouds using the light-PointNet (LPN) backbone. Then, we learn the temporal pattern with a bidirectional lightweight LSTM model (BiLiLSTM). In addition, we implement a transition optimization strategy, integrating the Hidden Markov Model (HMM) with Connectionist Temporal Classification (CTC) to improve the accuracy and robustness of the continuous HAR. Our experiments on three datasets indicate that our method significantly outperforms the previous studies in both discrete and continuous HAR tasks. Finally, we deploy our system on a movable robot-mounted edge computing platform, achieving flexible healthcare monitoring in real-world scenarios.
Feature Selection Approaches for Optimising Music Emotion Recognition Methods
Cai, Le, Ferguson, Sam, Lu, Haiyan, Fang, Gengfa
The high feature dimensionality is a challenge in music emotion recognition. There is no common consensus on a relation between audio features and emotion. The MER system uses all available features to recognize emotion; however, this is not an optimal solution since it contains irrelevant data acting as noise. In this paper, we introduce a feature selection approach to eliminate redundant features for MER. We created a Selected Feature Set (SFS) based on the feature selection algorithm (FSA) and benchmarked it by training with two models, Support Vector Regression (SVR) and Random Forest (RF) and comparing them against with using the Complete Feature Set (CFS). The result indicates that the performance of MER has improved for both Random Forest (RF) and Support Vector Regression (SVR) models by using SFS. We found using FSA can improve performance in all scenarios, and it has potential benefits for model efficiency and stability for MER task. NTRODUCTION Music has become an indispensable part of people's lives. It plays a vital role in our world. We use music in almost every field, such as public places, entertainment, and even therapy. As the technology grows, the widespread adoption of digital audio formats, especially MP3, music distribution has become very efficient and seamless. The primary method of music consumption has shifted from retail stores to online and internet-based distribution channels. Subscription services had now become popular where the consumers now have access to much larger libraries than when albums were purchased individually. Traditional approaches to managing digital music libraries using of embedded metadata are no longer sufficient to deal with such a large database since the text cannot fully convey the expression of the musical content [1] [2], therefore the content-based music retrieval system can be ideal to handle this task more efficiency and opens a new perspective to discover music.