Airflow and Ray: A Data Science Story

You can now find the Ray Provider on the Astronomer Registry, the discovery and distribution hub for Apache Airflow integrations created to aggregate and curate the best bits of the ecosystem. Machine learning (ML) has become a crucial part of the data ecosystem at companies across all industries. As the Airflow community grows, we want to empower data science and engineering teams across the board to evolve their data pipelines into high-value outcomes. With this in mind, it's only natural that we turn our focus towards building an optimal Airflow ML story. One of the best measures of quality in a modern ML framework is the flexibility and agility it allows data scientists and engineers.