Information Fusion
Augmenting Inertial Motion Capture with SLAM Using EKF and SRUKF Data Fusion Algorithms
Azarbeik, Mohammad Mahdi, Razavi, Hamidreza, Merat, Kaveh, Salarieh, Hassan
Inertial motion capture systems widely use low-cost IMUs to obtain the orientation of human body segments, but these sensors alone are unable to estimate link positions. Therefore, this research used a SLAM method in conjunction with inertial data fusion to estimate link positions. SLAM is a method that tracks a target in a reconstructed map of the environment using a camera. This paper proposes quaternion-based extended and square-root unscented Kalman filters (EKF & SRUKF) algorithms for pose estimation. The Kalman filters use measurements based on SLAM position data, multi-link biomechanical constraints, and vertical referencing to correct errors. In addition to the sensor biases, the fusion algorithm is capable of estimating link geometries, allowing the imposing of biomechanical constraints without a priori knowledge of sensor positions. An optical tracking system is used as a reference of ground-truth to experimentally evaluate the performance of the proposed algorithm in various scenarios of human arm movements. The proposed algorithms achieve up to 5.87 (cm) and 1.1 (deg) accuracy in position and attitude estimation. Compared to the EKF, the SRUKF algorithm presents a smoother and higher convergence rate but is 2.4 times more computationally demanding. After convergence, the SRUKF is up to 17% less and 36% more accurate than the EKF in position and attitude estimation, respectively. Using an absolute position measurement method instead of SLAM produced 80% and 40%, in the case of EKF, and 60% and 6%, in the case of SRUKF, less error in position and attitude estimation, respectively.
Deep Fusion of Multi-Object Densities Using Transformer
Li, Lechi, Dai, Chen, Xia, Yuxuan, Svensson, Lennart
In this paper, we demonstrate that deep learning based method can be used to fuse multi-object densities. Given a scenario with several sensors with possibly different field-of-views, tracking is performed locally in each sensor by a tracker, which produces random finite set multi-object densities. To fuse outputs from different trackers, we adapt a recently proposed transformer-based multi-object tracker, where the fusion result is a global multi-object density, describing the set of all alive objects at the current time. We compare the performance of the transformer-based fusion method with a well-performing model-based Bayesian fusion method in several simulated scenarios with different parameter settings using synthetic data. The simulation results show that the transformer-based fusion method outperforms the model-based Bayesian method in our experimental scenarios.
Evaluation of Fake News Detection with Knowledge-Enhanced Language Models
Whitehouse, Chenxi, Weyde, Tillman, Madhyastha, Pranava, Komninos, Nikos
Recent advances in fake news detection have exploited the success of large-scale pre-trained language models (PLMs). The predominant state-of-the-art approaches are based on fine-tuning PLMs on labelled fake news datasets. However, large-scale PLMs are generally not trained on structured factual data and hence may not possess priors that are grounded in factually accurate knowledge. The use of existing knowledge bases (KBs) with rich human-curated factual information has thus the potential to make fake news detection more effective and robust. In this paper, we investigate the impact of knowledge integration into PLMs for fake news detection. We study several state-of-the-art approaches for knowledge integration, mostly using Wikidata as KB, on two popular fake news datasets - LIAR, a politics-based dataset, and COVID-19, a dataset of messages posted on social media relating to the COVID-19 pandemic. Our experiments show that knowledge-enhanced models can significantly improve fake news detection on LIAR where the KB is relevant and up-to-date. The mixed results on COVID-19 highlight the reliance on stylistic features and the importance of domain-specific and current KBs.
General, Single-shot, Target-less, and Automatic LiDAR-Camera Extrinsic Calibration Toolbox
Koide, Kenji, Oishi, Shuji, Yokozuka, Masashi, Banno, Atsuhiko
Abstract-- This paper presents an open source LiDARcamera calibration toolbox that is general to LiDAR and camera projection models, requires only one pairing of LiDAR and camera data without a calibration target, and is fully automatic. Glue image matching pipeline to find 2D-3D correspondences between LiDAR and camera data and estimate the LiDARcamera transformation via RANSAC. The experimental results show that the proposed toolbox enables calibration of any combination of spinning and non-repetitive scan LiDARs and pinhole and omnidirectional cameras, and shows better calibration accuracy and robustness than those of the state-of-the-art edge-alignment-based calibration method. It is necessary for LiDAR-camera Figure 1: We present a complete LiDAR-camera calibration sensor fusion and is required for many applications, including framework that can handle various LiDAR and camera autonomous vehicle localization, environmental mapping, models and calibrate the transformation between them from and surrounding-object recognition. The pixel-level direct alignment algorithm enables studied over the last decade, the robotics community still high-quality LiDAR-camera data fusion. Target-less: The proposed calibration algorithm does geometry-rich environment carefully [3].
LAPTNet-FPN: Multi-scale LiDAR-aided Projective Transform Network for Real Time Semantic Grid Prediction
Diaz-Zapata, Manuel Alejandro, Gonzรกlez, David Sierra, Erkent, รzgรผr, Dibangoye, Jilles, Laugier, Christian
Semantic grids can be useful representations of the scene around an autonomous system. By having information about the layout of the space around itself, a robot can leverage this type of representation for crucial tasks such as navigation or tracking. By fusing information from multiple sensors, robustness can be increased and the computational load for the task can be lowered, achieving real time performance. Our multi-scale LiDAR-Aided Perspective Transform network uses information available in point clouds to guide the projection of image features to a top-view representation, resulting in a relative improvement in the state of the art for semantic grid generation for human (+8.67%) and movable object (+49.07%) classes in the nuScenes dataset, as well as achieving results close to the state of the art for the vehicle, drivable area and walkway classes, while performing inference at 25 FPS.
InMyFace: Inertial and Mechanomyography-Based Sensor Fusion for Wearable Facial Activity Recognition
Bello, Hymalai, Marin, Luis Alfredo Sanchez, Suh, Sungho, Zhou, Bo, Lukowicz, Paul
Recognizing facial activity is a well-understood (but non-trivial) computer vision problem. However, reliable solutions require a camera with a good view of the face, which is often unavailable in wearable settings. Furthermore, in wearable applications, where systems accompany users throughout their daily activities, a permanently running camera can be problematic for privacy (and legal) reasons. This work presents an alternative solution based on the fusion of wearable inertial sensors, planar pressure sensors, and acoustic mechanomyography (muscle sounds). The sensors were placed unobtrusively in a sports cap to monitor facial muscle activities related to facial expressions. We present our integrated wearable sensor system, describe data fusion and analysis methods, and evaluate the system in an experiment with thirteen subjects from different cultural backgrounds (eight countries) and both sexes (six women and seven men). In a one-model-per-user scheme and using a late fusion approach, the system yielded an average F1 score of 85.00% for the case where all sensing modalities are combined. With a cross-user validation and a one-model-for-all-user scheme, an F1 score of 79.00% was obtained for thirteen participants (six females and seven males). Moreover, in a hybrid fusion (cross-user) approach and six classes, an average F1 score of 82.00% was obtained for eight users. The results are competitive with state-of-the-art non-camera-based solutions for a cross-user study. In addition, our unique set of participants demonstrates the inclusiveness and generalizability of the approach.
A Survey on XAI for Beyond 5G Security: Technical Aspects, Use Cases, Challenges and Research Directions
Senevirathna, Thulitha, La, Vinh Hoa, Marchal, Samuel, Siniarski, Bartlomiej, Liyanage, Madhusanka, Wang, Shen
With the advent of 5G commercialization, the need for more reliable, faster, and intelligent telecommunication systems are envisaged for the next generation beyond 5G (B5G) radio access technologies. Artificial Intelligence (AI) and Machine Learning (ML) are not just immensely popular in the service layer applications but also have been proposed as essential enablers in many aspects of B5G networks, from IoT devices and edge computing to cloud-based infrastructures. However, existing B5G ML-security surveys tend to place more emphasis on AI/ML model performance and accuracy than on the models' accountability and trustworthiness. In contrast, this paper explores the potential of Explainable AI (XAI) methods, which would allow B5G stakeholders to inspect intelligent black-box systems used to secure B5G networks. The goal of using XAI in the security domain of B5G is to allow the decision-making processes of the ML-based security systems to be transparent and comprehensible to B5G stakeholders making the systems accountable for automated actions. In every facet of the forthcoming B5G era, including B5G technologies such as RAN, zero-touch network management, E2E slicing, this survey emphasizes the role of XAI in them and the use cases that the general users would ultimately enjoy. Furthermore, we presented the lessons learned from recent efforts and future research directions on top of the currently conducted projects involving XAI.
Data Integration Specialist at Bosch Group - Timiศoara, Romania
At Bosch, we shape the future by inventing high-quality technologies and services that spark enthusiasm and enrich people's lives. Bosch Service Solutions is part of Bosch Group and a leading global supplier of Business Process Outsourcing for complex business processes and services. Using the latest technology, the opportunities of the Internet of Things and speaking over 18 foreign languages, Bosch Service Solutions Timiศoara operates successfully in two fields: Business Services and Shared Services. The experts offer support in areas such as Finance, Accounting, Controlling, Purchasing and Sales Commercial. The team of professionals, also have expertise in areas such as Technical and IT, Customer Care, Production Support and other services.
Top Transforming [Enterprise] Data Strategies
An enterprise data strategy is a comprehensive vision for an organization's potential to harness data-dependent capabilities. Enterprises need to build a robust architecture seamlessly without hampering the current equilibrium of the business. The primary goal of the data platform is to enable analytics, helping organizations analyze their current state and make better decisions. Having a streamlined, documented workflow that walks through the entire process explaining the renewable layer for data integration and workflow, is crucial. The workflow to build an analytics platform should include how different data sources can be collected, managed, and incorporated into the analytics platform.
Lead ETL Data Engineer at Verisk - Newark, NJ, United States
We help the world see new possibilities and inspire change for better tomorrows. Our analytic solutions bridge content, data, and analytics to help business, people, and society become stronger, more resilient, and sustainable. The Data Engineering and Analytics Lab (DEAL) is a team of technical actuaries responsible for the design and implementation of our core statistical data-systems including data ingestion, data integration, data transformation, data analysis, and analytic dataset construction. We're an innovation group that is charged with visualizing the future of our organization's operations and leveraging our expertise in data, technology, P&C insurance, and process optimization to provide a first-class analytics environment to our data-collection, data-management, actuarial, and data-analytics colleagues. The DEAL team is looking to hire an experienced Lead ETL Data Engineer, ideally having a good combination of an analytical/innovative mindset, technical aptitude, business accumen, communication skills, and a passion for mentoring.