Data Engineering Technologies in 2021

Airflow is an open-source workflow management platform for data engineering pipelines. Alation focused on data governance, analytics, and data management. Alluxio is an open-source data orchestration layer that brings Data close to compute for big data and AI/ML workloads in the cloud. Amundsen is a data discovery and metadata engine for improving the productivity of data analysts, data scientists, and engineers. Anodot detects and groups anomalies across silos to help you find and fix business incidents in real-time.