Automating Machine Learning Models on AWS

Working as a Research Assistant under Professor Gordon Gao, at the University of Maryland, I have had the opportunity to combine both my Data Engineering and Science interests to automate machine learning models in the cloud. Assisting one of Professor Gao's Phd fellows, I was tasked with providing an AWS-based solution, which would reduce human interventions when running a deep learning model for an upcoming health startup. "Reduce Costs of EC2 instances, by running them only for computations, these computations happen whenever a customer uploads data into an S3 bucket, which can be anytime during the day." The computations mentioned encompass the machine learning model and processing data uploaded in S3. This meant, the EC2 should only be run for executing the ML model and should be switched off at other times, also these jobs don't have a fixed time and, the only fixed property they possess is that they have to be run as soon as the data is uploaded into the S3 Data bucket.