The New Data Engineering Stack

Remember the time when the software development industry realized that a single person can take on multiple technologies glued tightly with each other and came up with the notion of a Full Stack Developer -- someone who does data modelling, writes backend code and also does front end work. Something similar has happened to the data industry with the birth of a Data Engineer almost half a decade ago. For many, the Full Stack Developer remains a mythical creature because of the never-ending list of technologies that cover frontend, backend and data. One of the reasons for that could be the fact that visualisation (business intelligence) has become a massive field in its own right. A Data Engineer is supposed to build systems to make data available, make it useable, move it from one place to another and so on.