Goto

Collaborating Authors

 Instructional Material


Deciding What to Model: Value-Equivalent Sampling for Reinforcement Learning

arXiv.org Artificial Intelligence

The quintessential model-based reinforcement-learning agent iteratively refines its estimates or prior beliefs about the true underlying model of the environment. Recent empirical successes in model-based reinforcement learning with function approximation, however, eschew the true model in favor of a surrogate that, while ignoring various facets of the environment, still facilitates effective planning over behaviors. Recently formalized as the value equivalence principle, this algorithmic technique is perhaps unavoidable as real-world reinforcement learning demands consideration of a simple, computationally-bounded agent interacting with an overwhelmingly complex environment, whose underlying dynamics likely exceed the agent's capacity for representation. In this work, we consider the scenario where agent limitations may entirely preclude identifying an exactly value-equivalent model, immediately giving rise to a trade-off between identifying a model that is simple enough to learn while only incurring bounded sub-optimality. To address this problem, we introduce an algorithm that, using rate-distortion theory, iteratively computes an approximately-value-equivalent, lossy compression of the environment which an agent may feasibly target in lieu of the true model. We prove an information-theoretic, Bayesian regret bound for our algorithm that holds for any finite-horizon, episodic sequential decision-making problem. Crucially, our regret bound can be expressed in one of two possible forms, providing a performance guarantee for finding either the simplest model that achieves a desired sub-optimality gap or, alternatively, the best model given a limit on agent capacity.


Deep Learning:Deep Neural Network for Beginners Using Python

#artificialintelligence

Deep Learning & Deep Neural Networks made super easy for absolute beginners without digging deep into harsh mathematics. Want to master the essential Deep Learning concepts fast? Ready to train your machine like how a father would teach his son? Yes, we know you can choose from lots of similar courses and lectures out there regarding DNNs. But this truly step-by-step course is different!


DART-Ed webinar series

#artificialintelligence

We are running a series of webinars looking at recent exciting developments in AI, robotics and digital technologies including the work the DART-Ed programme are undertaking around education, and preparing the workforce with the knowledge and skills they will need, now and for the future. Digital technology is transforming how dentistry will be delivered in the future. Adopting digital opportunities will enable staff and patients to confidently navigate this new digital environment. This webinar will provide a scene setting to digital readiness in dentistry, as well as demonstrate the potential role of AI in dentistry and the interoperability challenge in the context of the profession. The third installment of the DART-Ed webinar series took place on 11 August 2022 and looked at how artificial intelligence has the potential to transform healthcare, and in many cases is starting to do so.


Deep Learning & Neural Networks Python Keras

#artificialintelligence

You Save $121.01 93 % off The world has been revolving much around the terms "Machine Learning" and "Deep Learning" recently. With or without our knowledge every day we are using these technologies. There are tons of other applications too. No wonder why "Deep Learning" and "Machine Learning along with Data Science" are the most sought after talent in the technology world now a days. But the problem is that, when you think about learning these technologies, a misconception that lots of maths, statistics, complex algorithms and formulas needs to be studied prior to that.


Hands-on Machine Learning with AWS and NVIDIA

#artificialintelligence

Machine learning (ML) projects can be complex, tedious, and time consuming. AWS and NVIDIA solve this challenge with fast, effective, and easy-to-use capabilities for your ML project. This course is designed for ML practitioners, including data scientists and developers, who have a working knowledge of machine learning workflows. In this course, you will gain hands-on experience on building, training, and deploying scalable machine learning models with Amazon SageMaker and Amazon EC2 instances powered by NVIDIA GPUs. Amazon SageMaker helps data scientists and developers prepare, build, train, and deploy high-quality ML models quickly by bringing together a broad set of capabilities purpose-built for ML.


Performance Tuning Deep Learning In Python - A Masterclass

#artificialintelligence

This is a step-by-step course in getting the most out of deep learning models on your own predictive modeling projects. Deep learning neural networks have become easy to create. However, tuning these models for maximum performance remains something of a challenge for most modelers. This course will teach you how to get results as a machine learning practitioner. The course starts with an introduction to the problem of overfitting and a tour of regularization techniques.


Track2Vec: fairness music recommendation with a GPU-free customizable-driven framework

arXiv.org Artificial Intelligence

Recommendation systems have illustrated the significant progress made in characterizing users' preferences based on their past behaviors. Despite the effectiveness of recommending accurately, there exist several factors that are essential but unexplored for evaluating various facets of recommendation systems, e.g., fairness, diversity, and limited resources. To address these issues, we propose Track2Vec, a GPU-free customizable-driven framework for fairness music recommendation. In order to take both accuracy and fairness into account, our solution consists of three modules, a customized fairness-aware groups for modeling different features based on configurable settings, a track representation learning module for learning better user embedding, and an ensemble module for ranking the recommendation results from different track representation learning modules. Moreover, inspired by TF-IDF which has been widely used in natural language processing, we introduce a metric called Miss Rate - Inverse Ground Truth Frequency (MR-ITF) to measure the fairness. Extensive experiments demonstrate that our model achieves a 4th price ranking in a GPU-free environment on the leaderboard in the EvalRS @ CIKM 2022 challenge, which is superior to the official baseline by about 200% in terms of the official scores. In addition, the ablation study illustrates the necessity of ensembling each group to acquire both accurate and fair recommendations.


AI Applications in Marketing and Finance

#artificialintelligence

This specialization will provide learners with the fundamentals of using Big Data, Artificial Intelligence, and Machine Learning and the various areas in which you can deploy them to support your business. You'll cover ethics and risks of AI, designing governance frameworks to fairly apply AI, and also cover people management in the fair design of HR functions within Machine Learning. You'll also learn effective marketing strategies using data analytics, and how personalization can enhance and prolong the customer journey and lifecycle. Finally, you will hear from industry leaders who will provide you with insights into how AI and Big Data are revolutionizing the way we do business. By the end of this specialization, you will be able to implement ethical AI strategies for people management and have a better understanding of the relationship between data analytics, artificial intelligence, and machine learning. You will leave this specialization with insight into how these tools can shape and influence how you manage your business.


Course on Visualization for Machine Learning: Initial Report

#artificialintelligence

This semester I started a new graduate course at Northeastern on Visualization for Machine Learning. I am particularly excited about this course because it strongly connects with our research over the last few years. As usual, teaching is an excellent way to understand our research work better. We are about six weeks into the semester, and I am ready to share some details and observations. The course targets graduate students, and for this reason, it is heavily based on paper reading.


7 Best Time Series Courses Online You Must Know in 2022

#artificialintelligence

Are you looking for the Best Time Series Courses Online? If yes, this article is for you. In this article, I listed the Best Time Series Courses Online. So, give a few minutes to this article and find the best time series course for you. A time series is a set of numerical measurements of the same entity taken at equally spaced intervals over time.