Goto

Collaborating Authors

 Instructional Material


A tutorial on the Bayesian statistical approach to inverse problems

arXiv.org Artificial Intelligence

Inverse problems are ubiquitous in the sciences and engineering. Two categories of inverse problems concerning a physical system are (1) estimate parameters in a model of the system from observed input-output pairs and (2) given a model of the system, reconstruct the input to it that caused some observed output. Applied inverse problems are challenging because a solution may (i) not exist, (ii) not be unique, or (iii) be sensitive to measurement noise contaminating the data. Bayesian statistical inversion (BSI) is an approach to tackle ill-posed and/or ill-conditioned inverse problems. Advantageously, BSI provides a "solution" that (i) quantifies uncertainty by assigning a probability to each possible value of the unknown parameter/input and (ii) incorporates prior information and beliefs about the parameter/input. Herein, we provide a tutorial of BSI for inverse problems, by way of illustrative examples dealing with heat transfer from ambient air to a cold lime fruit. First, we use BSI to infer a parameter in a dynamic model of the lime temperature from measurements of the lime temperature over time. Second, we use BSI to reconstruct the initial condition of the lime from a measurement of its temperature later in time. We demonstrate the incorporation of prior information, visualize the posterior distributions of the parameter/initial condition, and show posterior samples of lime temperature trajectories from the model. Our tutorial aims to reach a wide range of scientists and engineers.


Policy Expansion for Bridging Offline-to-Online Reinforcement Learning

arXiv.org Artificial Intelligence

Pre-training with offline data and online fine-tuning using reinforcement learning is a promising strategy for learning control policies by leveraging the best of both worlds in terms of sample efficiency and performance. One natural approach is to initialize the policy for online learning with the one trained offline. In this work, we introduce a policy expansion scheme for this task. After learning the offline policy, we use it as one candidate policy in a policy set. We then expand the policy set with another policy which will be responsible for further learning. The two policies will be composed in an adaptive manner for interacting with the environment. With this approach, the policy previously learned offline is fully retained during online learning, thus mitigating the potential issues such as destroying the useful behaviors of the offline policy in the initial stage of online learning while allowing the offline policy participate in the exploration naturally in an adaptive manner. Moreover, new useful behaviors can potentially be captured by the newly added policy through learning. Experiments are conducted on a number of tasks and the results demonstrate the effectiveness of the proposed approach.


Fundamentals of Machine Learning for Supply Chain

#artificialintelligence

This course will teach you how to leverage the power of Python to understand complicated supply chain datasets. Even if you are not familiar with supply chain fundamentals, the rich data sets that we will use as a canvas will help orient you with several Pythonic tools and best practices for exploratory data analysis (EDA). As such, though all datasets are geared towards supply chain minded professionals, the lessons are easily generalizable to other use cases.


Quickly learn how to use AI tools with in-product tutorials

#artificialintelligence

For models that take a long time to train, a notebook isn't always the most convenient option. If you're building an ML application, it's unlikely you'll only need to train your model once. Over time you'll want to retrain your model to make sure it stays fresh and keeps producing valuable results. Manually executing the cells of your notebook might be the right options when you're getting started with a new ML problem, but when you want to automate experimentation at scale or retrain models for a production application, a managed ML training option will make things much easier.


Sign Language Translation from Instructional Videos

arXiv.org Artificial Intelligence

The advances in automatic sign language translation (SLT) to spoken languages have been mostly benchmarked with datasets of limited size and restricted domains. Our work advances the state of the art by providing the first baseline results on How2Sign, a large and broad dataset. We train a Transformer over I3D video features, using the reduced BLEU as a reference metric for validation, instead of the widely used BLEU score. We report a result of 8.03 on the BLEU score, and publish the first open-source implementation of its kind to promote further advances.


Analyzing ChatGPT's Aptitude in an Introductory Computer Engineering Course

arXiv.org Artificial Intelligence

ChatGPT has recently gathered attention from the general public and academia as a tool that is able to generate plausible and human-sounding text answers to various questions. One potential use, or abuse, of ChatGPT is in answering various questions or even generating whole essays and research papers in an academic or classroom setting. While recent works have explored the use of ChatGPT in the context of humanities, business school, or medical school, this work explores how ChatGPT performs in the context of an introductory computer engineering course. This work assesses ChatGPT's aptitude in answering quizzes, homework, exam, and laboratory questions in an introductory-level computer engineering course. This work finds that ChatGPT can do well on questions asking about generic concepts. However, predictably, as a text-only tool, it cannot handle questions with diagrams or figures, nor can it generate diagrams and figures. Further, also clearly, the tool cannot do hands-on lab experiments, breadboard assembly, etc., but can generate plausible answers to some laboratory manual questions. One of the key observations presented in this work is that the ChatGPT tool could not be used to pass all components of the course. Nevertheless, it does well on quizzes and short-answer questions. On the other hand, plausible, human-sounding answers could confuse students when generating incorrect but still plausible answers.


HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledge

arXiv.org Artificial Intelligence

Through The advent of instruction-following large language this process, we collect over 8,000 instruction models (LLMs), representative by Chat-data for supervised fine-tuning. Our model builds GPT(OpenAI, 2022), has generated significant interest upon the open-source LLaMa-7B base model, integrates due to their exceptional performance in understanding structured and unstructured medical knowledge instructions and generating human-like from the Chinese medical knowledge graph responses. Compared to smaller models, LLMs (CMeKG), and employs knowledge-based instruction exhibit strong generalization across various natural data for fine-tuning.


pyribs: A Bare-Bones Python Library for Quality Diversity Optimization

arXiv.org Artificial Intelligence

Recent years have seen a rise in the popularity of quality diversity (QD) optimization, a branch of optimization that seeks to find a collection of diverse, high-performing solutions to a given problem. To grow further, we believe the QD community faces two challenges: developing a framework to represent the field's growing array of algorithms, and implementing that framework in software that supports a range of researchers and practitioners. To address these challenges, we have developed pyribs, a library built on a highly modular conceptual QD framework. By replacing components in the conceptual framework, and hence in pyribs, users can compose algorithms from across the QD literature; equally important, they can identify unexplored algorithm variations. Furthermore, pyribs makes this framework simple, flexible, and accessible, with a user-friendly API supported by extensive documentation and tutorials. This paper overviews the creation of pyribs, focusing on the conceptual framework that it implements and the design principles that have guided the library's development.


How to Create Prompts for ChatGPT

#artificialintelligence

Are you a new user of ChatGPT struggling to create effective ChatGPT prompts? Do you find it challenging to generate the desired outcome from your prompts? This beginner/intermediate course will teach you how to craft ingenious and highly effective prompts for Chat GPT by utilizing various prompt structures. Our expert prompt engineers provide numerous examples and case studies, allowing you to learn better and create winning ChatGPT prompts for more meaningful conversations with ChatGPT. In this comprehensive guide to prompt engineering, you'll learn the essential concepts and techniques required to create powerful ChatGPT prompts.


This Podcast Is Not Hosted By AI Voice Clones. We Swear

WIRED

Artificial intelligence continues to seep into every aspect of our lives: search results, chatbots, images on social media, viral videos, documentaries about dead celebrities. A new class of emerging AI-powered services can take audio clips from voice recordings and build models off them. Anything you type into a computer can be spit out as an impression of that person's voice. Proponents of AI voice cloning see these tools as a way to make life a little easier for content creators. The robovoices can be used to fix mistakes, read ads, or perform other mundane duties.