Information Fusion
DI Connection: Where Machine Learning Meets Data Integration
Much of the data we manage day-to-day lives in silos and, while the data within each silo can be analyzed on its own, this produces limited value for businesses. The deeper value becomes apparent when the disparate data is connected and transformed to produce patterns, insights, and predictions. This undertaking requires a significant amount of time and labor only to be susceptible to human error. As businesses are faced with analyzing big data from heterogeneous sources as quickly as possible, data integration will increasingly look to automation and machine learning for the heavy lifting. Businesses are pulling data from CRM systems, social media, apps, and a swarm of other possible sources and this data is often unstructured.
SnapLogic Delivers Simplified App and Data Integration with Expanded AI Capabilities - DATAVERSITY
According to a recent press release, "SnapLogic, the leader in self-service application and data integration, today announced updates to its Enterprise Integration Cloud platform. The new release includes enhancements to SnapLogic's Iris AI capabilities, expanded support for Amazon and Reltio, and platform performance upgrades. With these updates, customers relying on SnapLogic accelerate performance, reduce time to value, and achieve self-service integration goals. As organizations turn to AI and machine learning to meet heightened customer demands, SnapLogic has applied a new neural network algorithm to its machine learning-based recommendation engine, Iris Integration Assistant, to provide even greater speed and accuracy in first-Snap and next-Snap suggestions when building integration pipelines. This shortens the pipeline-building learning curve for citizen integrators and allows them to self-drive integration projects without relying on IT."
dock.io : Decentralized Professional Data Exchange
User data is the core value of all consumer facing apps. Centralized platforms mine and productize data for their own agendas, leaving control in the hands of a few companies. At dock.io we believe in this value being shared between users and apps to create a more connected and decentralized internet.
Data Warehouse Concepts, Design, and Data Integration Coursera
About this course: This is the second course in the Data Warehousing for Business Intelligence specialization. Ideally, the courses should be taken in sequence. In this course, you will learn exciting concepts and skills for designing data warehouses and creating data integration workflows. These are fundamental skills for data warehouse developers and administrators. You will have hands-on experience for data warehouse design and use open source products for manipulating pivot tables and creating data integration workflows.You will also gain conceptual background about maturity models, architectures, multidimensional models, and management practices, providing an organizational perspective about data warehouse development.
How do you guys handle 'garbage data' discovered during ETL? โข r/Database
Hopefully my title isn't too poorly worded.. I am currently upgrading a client's old transaction-based DB to something a bit more modern that locks down their flow a bit better so problems like this hopefully don't arise in the future. To give a brief overview, they use this to track hours on tubes and capacitors used in transmitters to calculate average lifespans and perform other calculations. Devices are tied to meters whose readings are updated daily. I've got the old data transformed and loaded into the new system, but running through some basic sanity checks I'm finding there is quite a bit of data that simply doesn't make sense. On a very basic level, there are transactions with IN Dates that are higher values than OUT Dates.
Predicting Depression Severity by Multi-Modal Feature Engineering and Fusion
Samareh, Aven (University of Washington) | Jin, Yan (University of Washington) | Wang, Zhangyang (Texas A&M University) | Chang, Xiangyu (Xi'an Jiaotong University) | Huang, Shuai (University of Washington)
We present our preliminary work to determine if patient's vocal acoustic, linguistic, and facial patterns could predict clinical ratings of depression severity, namely Patient Health Questionnaire depression scale (PHQ-8). We proposed a multi-modal fusion model that combines three different modalities: audio, video, and text features. By training over the AVEC2017 dataset, our proposed model outperforms each single-modality prediction model, and surpasses the dataset baseline with a nice margin.
Gaussian Process Decentralized Data Fusion Meets Transfer Learning in Large-Scale Distributed Cooperative Perception
Ouyang, Ruofei (National University of Singapore) | Low, Kian Hsiang (National University of Singapore)
This paper presents novel Gaussian process decentralized data fusion algorithms exploiting the notion of agent-centric support sets for distributed cooperative perception of large-scale environmental phenomena. To overcome the limitations of scale in existing works, our proposed algorithms allow every mobile sensing agent to choose a different support set and dynamically switch to another during execution for encapsulating its own data into a local summary that, perhaps surprisingly, can still be assimilated with the other agents' local summaries (i.e., based on their current choices of support sets) into a globally consistent summary to be used for predicting the phenomenon. To achieve this, we propose a novel transfer learning mechanismfor a team of agents capable of sharing and transferring information encapsulated in a summary based on a support set to that utilizing a different support set with some loss that can be theoretically bounded and analyzed. To alleviate the issue of information loss accumulating over multiple instances of transfer learning, we propose a new information sharing mechanism to be incorporated into our algorithms in order to achieve memory-efficient lazy transfer learning. Empirical evaluation on real-world datasets show that our algorithms outperform the state-of-the-art methods.
3 best practices for integrating AI in health care
Bots are breaking into the most human industry on earth: health care. Just look at Microsoft -- the company recently launched a new division to address the intersection between health care and AI. That's not to say AI will be replacing doctors anytime soon. But the integration of AI into regular health care tasks is upon us. From surgical assistance to patient education to imaging analysis, robots are already part of the process -- and their roles will only increase over time. Of course, not everything is smooth sailing -- AI faces challenges in health care just as it does in other fields.