Evolution of intelligent data pipelines