Information Fusion
ETL vs ELT: Which One is Right for Your Data Pipeline? - KDnuggets
ETL and ELT are data integration pipelines that transfer data from multiple sources to a single centralized source and perform some transformation and processing steps to it. The difference between these two is ETL transforms the data before loading, and ELT transforms the data after loading. But before diving deeply into them, let's first understand the meaning of E, L, and T. T for Transform - Transforming the data is a process of cleaning and modifying the data in a format so that it can be used for business analysis. L for Loading - It involves loading data to a target system, which may be a data warehouse or a database. ETL is the first standardized data integration method that emerged in the 1970s due to the evolution of disk storage.
A Modular Platform For Collaborative, Distributed Sensor Fusion
Hallyburton, R. Spencer, Zelter, Nate, Hunt, David, Angell, Kristen, Pajic, Miroslav
Leading autonomous vehicle (AV) platforms and testing infrastructures are, unfortunately, proprietary and closed-source. Thus, it is difficult to evaluate how well safety-critical AVs perform and how safe they truly are. Similarly, few platforms exist for much-needed multi-agent analysis. To provide a starting point for analysis of sensor fusion and collaborative & distributed sensing, we design an accessible, modular sensing platform with AVstack. We build collaborative and distributed camera-radar fusion algorithms and demonstrate an evaluation ecosystem of AV datasets, physics-based simulators, and hardware in the physical world. This three-part ecosystem enables testing next-generation configurations that are prohibitively challenging in existing development platforms.
Manager (DB/ETL) at dentsu international - Thane, India
Merkle, a dentsu company, is a leading data-driven customer experience management enterprise specializing in delivering unique, personalized customer experiences across platforms and devices. Its expertise in data, technology, and analytics enables it to gain insights into consumer behavior, driving hyper-personalized marketing strategies. Merkle's consulting, creative, media, analytics, data, identity, CX/commerce, technology, and loyalty & promotions capabilities combine to drive improved marketing results and a competitive edge. With over 14,000 employees, Merkle is headquartered in Columbia, Maryland, with more than 50 additional offices worldwide. Its innovative solutions enable brands to build meaningful customer relationships and enhanced customer experience.
Adaptive Acoustic Flow-Based Navigation with 3D Sonar Sensor Fusion
Jansen, Wouter, Laurijssen, Dennis, Steckel, Jan
Navigating spatially varied and dynamic environments is one of the key tasks for autonomous agents. In this paper we present a novel method of navigating a mobile platform with one or multiple 3D-sonar sensors. Moving a mobile platform and subsequently any 3D-sonar sensor on it, will create signature variations over time of the echoed reflections in the sensor readings. An approach is presented to create a predictive model of these signature variations for any motion type. Furthermore, the model is adaptive and works for any position and orientation of one or multiple sonar sensors on a mobile platform. We propose to use this adaptive model and fuse all sensory readings to create a layered control system allowing a mobile platform to perform a set of primitive motions such as collision avoidance, obstacle avoidance, wall following and corridor following behaviours to navigate an environment with dynamically moving objects within it. This paper describes the underlying theoretical base of the entire navigation model and validates it in a simulated environment with results that shows the system is stable and delivers expected behaviour for several tested spatial configurations of one or multiple sonar sensors that can complete an autonomous navigation task.
Sensor Fusion Explores AI to Prep for ADAS, AV Designs - EE Times
Sensor fusion has been discussed for years for a diverse array of applications. However, it acquires a highly specialized design premise when it comes to automotive applications like advanced driver assistance systems (ADAS) and autonomous vehicles (AVs). Perception and sensor fusion systems are among the highly complex areas in ADAS and AV designs from a computational standpoint as they crunch all the data and determine what a vehicle is seeing. More specifically, sensor fusion provides the ability to merge information from radars, lidar (light detection and ranging) and cameras to produce a single model of the space around a vehicle--a crucial capability for ADAS and AV designs. This model is created as a result of balancing the strengths of the various sensors to formulate a more accurate picture of vehicle surroundings.
Multi-view information fusion using multi-view variational autoencoders to predict proximal femoral strength
Zhao, Chen, Keyak, Joyce H, Cao, Xuewei, Sha, Qiuying, Wu, Li, Luo, Zhe, Zhao, Lanjuan, Tian, Qing, Qiu, Chuan, Su, Ray, Shen, Hui, Deng, Hong-Wen, Zhou, Weihua
The aim of this paper is to design a deep learning-based model to predict proximal femoral strength using multi-view information fusion. Method: We developed new models using multi-view variational autoencoder (MVAE) for feature representation learning and a product of expert (PoE) model for multi-view information fusion. We applied the proposed models to an in-house Louisiana Osteoporosis Study (LOS) cohort with 931 male subjects, including 345 African Americans and 586 Caucasians. With an analytical solution of the product of Gaussian distribution, we adopted variational inference to train the designed MVAE-PoE model to perform common latent feature extraction. We performed genome-wide association studies (GWAS) to select 256 genetic variants with the lowest p-values for each proximal femoral strength and integrated whole genome sequence (WGS) features and DXA-derived imaging features to predict proximal femoral strength. Results: The best prediction model for fall fracture load was acquired by integrating WGS features and DXA-derived imaging features. The designed models achieved the mean absolute percentage error of 18.04%, 6.84% and 7.95% for predicting proximal femoral fracture loads using linear models of fall loading, nonlinear models of fall loading, and nonlinear models of stance loading, respectively. Compared to existing multi-view information fusion methods, the proposed MVAE-PoE achieved the best performance. Conclusion: The proposed models are capable of predicting proximal femoral strength using WGS features and DXA-derived imaging features. Though this tool is not a substitute for FEA using QCT images, it would make improved assessment of hip fracture risk more widely available while avoiding the increased radiation dosage and clinical costs from QCT.
INTERNSHIP: IT Project Manager - Data Integration (M/F/D) at Shippeo - Paris, France
Are you an ambitious person? Are you willing to push yourself beyond your limits? Do you have an international profile? If so, Shippeo is exactly what you are looking for! Founded in 2014, Shippeo is a global leader in real-time multimodal transportation visibility, helping major shippers and logistics service providers operate more collaborative, automated, sustainable, profitable, and customer-centric supply chains.
DB/ETL Tech Lead at dentsu international - Thane, India
Merkle, a dentsu company, is a leading data-driven customer experience management enterprise specializing in delivering unique, personalized customer experiences across platforms and devices. Its expertise in data, technology, and analytics enables it to gain insights into consumer behavior, driving hyper-personalized marketing strategies. Merkle's consulting, creative, media, analytics, data, identity, CX/commerce, technology, and loyalty & promotions capabilities combine to drive improved marketing results and a competitive edge. With over 14,000 employees, Merkle is headquartered in Columbia, Maryland, with more than 50 additional offices worldwide. Its innovative solutions enable brands to build meaningful customer relationships and enhanced customer experience.
DAMS-LIO: A Degeneration-Aware and Modular Sensor-Fusion LiDAR-inertial Odometry
Han, Fuzhang, Zheng, Han, Huang, Wenjun, Xiong, Rong, Wang, Yue, Jiao, Yanmei
With robots being deployed in increasingly complex environments like underground mines and planetary surfaces, the multi-sensor fusion method has gained more and more attention which is a promising solution to state estimation in the such scene. The fusion scheme is a central component of these methods. In this paper, a light-weight iEKF-based LiDAR-inertial odometry system is presented, which utilizes a degeneration-aware and modular sensor-fusion pipeline that takes both LiDAR points and relative pose from another odometry as the measurement in the update process only when degeneration is detected. Both the Cramer-Rao Lower Bound (CRLB) theory and simulation test are used to demonstrate the higher accuracy of our method compared to methods using a single observation. Furthermore, the proposed system is evaluated in perceptually challenging datasets against various state-of-the-art sensor-fusion methods. The results show that the proposed system achieves real-time and high estimation accuracy performance despite the challenging environment and poor observations.
Late Meta-learning Fusion Using Representation Learning for Time Series Forecasting
Meta-learning, decision fusion, hybrid models, and representation learning are topics of investigation with significant traction in time-series forecasting research. Of these two specific areas have shown state-of-the-art results in forecasting: hybrid meta-learning models such as Exponential Smoothing - Recurrent Neural Network (ES-RNN) and Neural Basis Expansion Analysis (N-BEATS) and feature-based stacking ensembles such as Feature-based FORecast Model Averaging (FFORMA). However, a unified taxonomy for model fusion and an empirical comparison of these hybrid and feature-based stacking ensemble approaches is still missing. This study presents a unified taxonomy encompassing these topic areas. Furthermore, the study empirically evaluates several model fusion approaches and a novel combination of hybrid and feature stacking algorithms called Deep-learning FORecast Model Averaging (DeFORMA). The taxonomy contextualises the considered methods. Furthermore, the empirical analysis of the results shows that the proposed model, DeFORMA, can achieve state-of-the-art results in the M4 data set. DeFORMA, increases the mean Overall Weighted Average (OWA) in the daily, weekly and yearly subsets with competitive results in the hourly, monthly and quarterly subsets. The taxonomy and empirical results lead us to argue that significant progress is still to be made by continuing to explore the intersection of these research areas.