Goto

Collaborating Authors

 Information Fusion


What is Azure Synapse and how is it different from Azure Data Bricks?

#artificialintelligence

Azure Synapse Analytics is an unlimited information analysis service aimed at large companies that was presented as the evolution of Azure SQL Data Warehouse (SQL DW), bringing together business data storage and macro or Big Data analysis. Synapse provides a single service for all workloads when processing, managing and serving data for immediate business intelligence and data prediction needs. The latter is made possible by its integration with Power BI and Azure Machine Learning, due to Synapse's ability to integrate mathematical machine learning models using the ONNX format. It provides the freedom to handle and query huge amounts of information either on demand serverless (a type of deployment that automatically scales power on demand when large amounts of data are available) for data exploration and ad hoc analysis, or with provisioned resources, at scale. As one of the few Microsoft's Power BI partners in Spain, at Bismart we have a large experience working with both Power BI and Azure Synapse.



Data Engineer

#artificialintelligence

Spreetail is an ecommerce company that connects brands with customers wherever they love to shop online. We delight our customers every day by putting our technology, marketing, and supply chain to work for them behind the scenes. Born and raised in Lincoln, Nebraska, Spreetail has grown into offices and fulfillment centers in 8 cities across 6 states. Life at Spreetail Working at Spreetail is a once-in-a-lifetime opportunity to help build one of the fastest-growing ecommerce companies in history. We take on challenges that others would call impossible because we have a team of amazing, talented people who collaborate and think bigger together.


Multi-Modal Fusion Transformer for End-to-End Autonomous Driving

arXiv.org Artificial Intelligence

How should representations from complementary sensors be integrated for autonomous driving? Geometry-based sensor fusion has shown great promise for perception tasks such as object detection and motion forecasting. However, for the actual driving task, the global context of the 3D scene is key, e.g. a change in traffic light state can affect the behavior of a vehicle geometrically distant from that traffic light. Geometry alone may therefore be insufficient for effectively fusing representations in end-to-end driving models. In this work, we demonstrate that imitation learning policies based on existing sensor fusion methods under-perform in the presence of a high density of dynamic agents and complex scenarios, which require global contextual reasoning, such as handling traffic oncoming from multiple directions at uncontrolled intersections. Therefore, we propose TransFuser, a novel Multi-Modal Fusion Transformer, to integrate image and LiDAR representations using attention. We experimentally validate the efficacy of our approach in urban settings involving complex scenarios using the CARLA urban driving simulator. Our approach achieves state-of-the-art driving performance while reducing collisions by 76% compared to geometry-based fusion.


AI and Enterprise Knowledge Integration: Part 1 - Atos

#artificialintelligence

Artificial Intelligence may well be the most potentially transformative technology since the Cloud, but it's clearly become the reigning champion for Tech hype and media buzz. IBM's Watson – a "cognitive" computer capable of answering natural language questions - was developed to compete on Jeopardy, a popular quiz show. In 2011, Watson competed against world champions Brad Rutter and Ken Jennings before a TV audience of millions…and beat them. At the end, Jennings remarked: "I for one welcome our new computer overlords". In fact, the Watson that won Jeopardy was an outcome of decades of research in "Symbolic AI".


Measuring the Impact of Blockchain and Smart Contract on Construction Supply Chain Visibility

arXiv.org Artificial Intelligence

It uses comparative empirical experiments (Charrette Test Method) to draw comparisons between the visibility of state-of-practice and blockchain-enabled payment systems in a commercial construction project. Comparisons were drawn across four levels of granularity. The findings are twofold: 1) blockchain improved information completeness and information accuracy respectively by an average 216% and 261% compared with the digital state-of-practice solution. The improvements were significantly more pronounced for inquiries that had higher product, trade, and temporal granularity; 2) blockchain-enabled solution was robust in the face of increased granularity, while the conventional solution experienced 50% and 66.7% decline respectively in completeness and accuracy of information. The paper concludes with a discussion of mechanisms contributing to visibility and technology adoption based on business objectives.


A Fast Evidential Approach for Stock Forecasting

arXiv.org Artificial Intelligence

In the framework of evidence theory, data fusion combines the confidence functions of multiple different information sources to obtain a combined confidence function. Stock price prediction is the focus of economics. Stock price forecasts can provide reference data. The Dempster combination rule is a classic method of fusing different information. By using the Dempster combination rule and confidence function based on the entire time series fused at each time point and future time points, and the preliminary forecast value obtained through the time relationship, the accurate forecast value can be restored. This article will introduce the prediction method of evidence theory. This method has good running performance, can make a rapid response on a large amount of stock price data, and has far-reaching significance.


What's ETL? - KDnuggets

#artificialintelligence

In my last post, I talked about what it means to move machine learning (ML) models into production by introducing the concept of MLOps. This time we're going to look at the opposite end of the data science steps for ML -- data extraction and integration. ETL stands for Extract-Transform-Load, it usually involves moving data from one or more sources, making some changes, and then loading it into a new single destination. Most ML algorithms require large amounts of training data in order to produce models that can make accurate predictions. They also require good quality training data, representative of the problem we are trying to solve.


Data Agility and 'Popularity' vs. Data Quality in Self-Serve BI and Analytics

#artificialintelligence

One of the most valuable aspects of self-serve business intelligence is the opportunity it provides for data and analytical sharing among business users within the organization. When business users adopt true self-serve BI tools like Plug n' Play Predictive Analysis, Smart Data Visualization, and Self-Serve Data Preparation, they can apply the domain knowledge and skill they have developed in their role to create reports, analyze data and make recommendations and decisions with confidence. It is not uncommon for data shared or created by a particular business user to become popular among other business users because of a particular analytical approach, the clarity of the data and conclusions presented or other unique aspects of the user's approach to business intelligence and reporting. In fact, in some organizations, a business user can get a reputation as being'popular' or dependable and her or his business intelligence analysis and reports might be actively sought to shape opinion and make decisions. That's right, today there is a social networking aspect even in Business Intelligence.


The 'Rage Design' Behind Flatfile's Onboarding Success

#artificialintelligence

David Boskovic was excited to join a company called Envoy back in 2016. He had worked with B2B startups since he was 18, and was looking forward to helping another tech startup scale an idea. But that excitement turned to dread when Boskovic realized his first job was to build yet another data onboarding system. "Eric [Crane] was leading product I was leading engineering, and for the umpteenth time in our careers, we had to build this CSV data onboarding solution for yet another SaaS company," Boskovic said. Envoy needed a painless way for new customers to move their existing data into its new SaaS offering so that it can do interesting things with it.