Machine Learning Data Lineage with MLflow and Delta Lake - Databricks

Then we will show a live demo on how to use various versioning features from these two frameworks to achieve data lineage in the machine learning process. We know that Machine Learning Development is complex. To give a sense of it, this is a typical machine learning pipeline. You take your raw data, you do some ETL or featurise it or data prep. Then you want to do some training with this data to produce a model and deploy this model to production.