Information Fusion
Enhancing safety in water transport system based on Internet of Things for developing countries
Mohaimenuzzaman, Md, Rahman, SM Monzurur, Alhussein, Musaed, Muhammad, Ghulam, Mamun, Khondaker Abdullah Al
Accidents in inland waterways in developing countries are a regular phenomenon throughout the year causing deaths, injuries, monetary loss, and a significant amount of missing people. In consequence, a lot of families are losing their dear ones leading to much misery. The above context demands an intelligent, safe, and reliable water transport system for the developing countries. The concept of Intelligent Transport System (ITS) can be applied to develop such system; however, there are issues with ITS and Internet of Things (IoT) unlocks a new way of developing it. This paper proposes a model to transform the water transport system into an intelligent system based on IoT. IPv6 based machine-to-machine (M2M) protocol, 3G telecommunication technology, and IEEE 802.15.4 network standard play a significant role in this proposed IoT based system.
Distributed Dynamic Map Fusion via Federated Learning for Intelligent Networked Vehicles
Zhang, Zijian, Wang, Shuai, Hong, Yuncong, Zhou, Liangkai, Hao, Qi
The technology of dynamic map fusion among networked vehicles has been developed to enlarge sensing ranges and improve sensing accuracies for individual vehicles. This paper proposes a federated learning (FL) based dynamic map fusion framework to achieve high map quality despite unknown numbers of objects in fields of view (FoVs), various sensing and model uncertainties, and missing data labels for online learning. The novelty of this work is threefold: (1) developing a three-stage fusion scheme to predict the number of objects effectively and to fuse multiple local maps with fidelity scores; (2) developing an FL algorithm which fine-tunes feature models (i.e., representation learning networks for feature extraction) distributively by aggregating model parameters; (3) developing a knowledge distillation method to generate FL training labels when data labels are unavailable. The proposed framework is implemented in the Car Learning to Act (CARLA) simulation platform. Extensive experimental results are provided to verify the superior performance and robustness of the developed map fusion and FL schemes.
Benefits of Data Integration
Data integration involves combining the organization's data from different sources to create one usable consolidated stream of data. When well-executed, data integration results in one accurate view which can be used for data analysis. With DQLabs, data integration is made seamless by utilizing AI-powered built-in connectors. Traditional extraction, transformation, and loading tools are slow, error-prone, and time-consuming. Data analysts spend a lot of time going through the data, comparing the schemas and formats. Where an organization has a large amount of data, this process can be very expensive and not end up providing the expected quality of consolidated data.
Council Post: Are You Ready To Hire Data Scientists?
George Fraser is the CEO of Fivetran, the leading provider of automated data integration. Leaders in every business are excited about bringing cutting-edge data science to their industry, and data science is the most talked-about career of the last 10 years. But many businesses hire data scientists before they are ready, and these highly paid team members end up spending their time doing basic data integration and reporting. What does it take to be ready to hire data scientists? The base of the pyramid is a solid enterprise data warehouse.
Solving the data integration variety problem at scale, with Gobblin
Editor's Note: Recently, the Apache Software Foundation (ASF) announced Apache Gobblin as a Top-Level Project (TLP). Our big data ecosystem is larger than 1 exabyte and growing, while ingesting and processing upwards of seven trillion Kafka events per day. At this scale, data integration is an incredibly complex problem. This is not only because of the multitude and variety of online and offline systems within the company, but also because of the hundreds of third-party data providers and partners that we work with. Add the plethora of protocols and formats that each brings, and the permutations quickly become untenable.
Data Fusion for Audiovisual Speaker Localization: Extending Dynamic Stream Weights to the Spatial Domain
Wissing, Julio, Boenninghoff, Benedikt, Kolossa, Dorothea, Ochiai, Tsubasa, Delcroix, Marc, Kinoshita, Keisuke, Nakatani, Tomohiro, Araki, Shoko, Schymura, Christopher
Estimating the positions of multiple speakers can be helpful for tasks like automatic speech recognition or speaker diarization. Both applications benefit from a known speaker position when, for instance, applying beamforming or assigning unique speaker identities. Recently, several approaches utilizing acoustic signals augmented with visual data have been proposed for this task. However, both the acoustic and the visual modality may be corrupted in specific spatial regions, for instance due to poor lighting conditions or to the presence of background noise. This paper proposes a novel audiovisual data fusion framework for speaker localization by assigning individual dynamic stream weights to specific regions in the localization space. This fusion is achieved via a neural network, which combines the predictions of individual audio and video trackers based on their time- and location-dependent reliability. A performance evaluation using audiovisual recordings yields promising results, with the proposed fusion approach outperforming all baseline models.
PixSet : An Opportunity for 3D Computer Vision to Go Beyond Point Clouds With a Full-Waveform LiDAR Dataset
Déziel, Jean-Luc, Merriaux, Pierre, Tremblay, Francis, Lessard, Dave, Plourde, Dominique, Stanguennec, Julien, Goulet, Pierre, Olivier, Pierre
Autonomous vehicles (AVs) have the potential to transform how transportation is done for people and merchandise, while improving both safety and efficiency. In order to reach the highest levels of autonomy, one of the main challenges that AVs are currently facing is to leverage the data from multiple types of sensors, each of which has its own strengths and weaknesses. Sensor fusion techniques are widely used to improve the performance and robustness of computer vision algorithms. Nowadays, the best performing computer vision algorithms are neural networks that are optimized using a deep learning approach [1-3], which requires large amount of data. Multiple datasets have been made publicly available in order to boost research and development of such algorithms [4-8].
Multi-Knowledge Fusion for New Feature Generation in Generalized Zero-Shot Learning
Xiang, Hongxin, Xie, Cheng, Zeng, Ting, Yang, Yun
Suffering from the semantic insufficiency and domain-shift problems, most of existing state-of-the-art methods fail to achieve satisfactory results for Zero-Shot Learning (ZSL). In order to alleviate these problems, we propose a novel generative ZSL method to learn more generalized features from multi-knowledge with continuously generated new semantics in semantic-to-visual embedding. In our approach, the proposed Multi-Knowledge Fusion Network (MKFNet) takes different semantic features from multi-knowledge as input, which enables more relevant semantic features to be trained for semantic-to-visual embedding, and finally generates more generalized visual features by adaptively fusing visual features from different knowledge domain. The proposed New Feature Generator (NFG) with adaptive genetic strategy is used to enrich semantic information on the one hand, and on the other hand it greatly improves the intersection of visual feature generated by MKFNet and unseen visual faetures. Empirically, we show that our approach can achieve significantly better performance compared to existing state-of-the-art methods on a large number of benchmarks for several ZSL tasks, including traditional ZSL, generalized ZSL and zero-shot retrieval.
A fusion method for multi-valued data
Papčo, Martin, Rodríguez-Martínez, Iosu, Fumanal-Idocin, Javier, Altalhi, Abdulrahman H., Bustince, Humberto
In this paper we propose an extension of the notion of deviation-based aggregation function tailored to aggregate multidimensional data. Our objective is both to improve the results obtained by other methods that try to select the best aggregation function for a particular set of data, such as penalty functions, and to reduce the temporal complexity required by such approaches. We discuss how this notion can be defined and present three illustrative examples of the applicability of our new proposal in areas where temporal constraints can be strict, such as image processing, deep learning and decision making, obtaining favourable results in the process.
UFA-FUSE: A novel deep supervised and hybrid model for multi-focus image fusion
Zang, Yongsheng, Zhou, Dongming, Wang, Changcheng, Nie, Rencan, Guo, Yanbu
Traditional and deep learning-based fusion methods generated the intermediate decision map to obtain the fusion image through a series of post-processing procedures. However, the fusion results generated by these methods are easy to lose some source image details or results in artifacts. Inspired by the image reconstruction techniques based on deep learning, we propose a multi-focus image fusion network framework without any post-processing to solve these problems in the end-to-end and supervised learning way. To sufficiently train the fusion model, we have generated a large-scale multi-focus image dataset with ground-truth fusion images. What's more, to obtain a more informative fusion image, we further designed a novel fusion strategy based on unity fusion attention, which is composed of a channel attention module and a spatial attention module. Specifically, the proposed fusion approach mainly comprises three key components: feature extraction, feature fusion and image reconstruction. We firstly utilize seven convolutional blocks to extract the image features from source images. Then, the extracted convolutional features are fused by the proposed fusion strategy in the feature fusion layer. Finally, the fused image features are reconstructed by four convolutional blocks. Experimental results demonstrate that the proposed approach for multi-focus image fusion achieves remarkable fusion performance compared to 19 state-of-the-art fusion methods.