Education
A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-Awareness
Liu, Jeremiah Zhe, Padhy, Shreyas, Ren, Jie, Lin, Zi, Wen, Yeming, Jerfel, Ghassen, Nado, Zack, Snoek, Jasper, Tran, Dustin, Lakshminarayanan, Balaji
Accurate uncertainty quantification is a major challenge in deep learning, as neural networks can make overconfident errors and assign high confidence predictions to out-of-distribution (OOD) inputs. The most popular approaches to estimate predictive uncertainty in deep learning are methods that combine predictions from multiple neural networks, such as Bayesian neural networks (BNNs) and deep ensembles. However their practicality in real-time, industrial-scale applications are limited due to the high memory and computational cost. Furthermore, ensembles and BNNs do not necessarily fix all the issues with the underlying member networks. In this work, we study principled approaches to improve the uncertainty property of a single network, based on a single, deterministic representation. By formalizing the uncertainty quantification as a minimax learning problem, we first identify distance awareness, i.e., the model's ability to quantify the distance of a testing example from the training data, as a necessary condition for a DNN to achieve highquality (i.e., minimax optimal) uncertainty estimation. We then propose Spectral-normalized Neural Gaussian Process (SNGP), a simple method that improves the distance-awareness ability of modern DNNs with two simple changes: (1) applying spectral normalization to hidden weights to enforce bi-Lipschitz smoothness in representations and (2) replacing the last output layer with a Gaussian process layer. On a suite of vision and language understanding benchmarks and on modern architectures (Wide-ResNet and BERT), SNGP consistently outperforms other single-model approaches in prediction, calibration and out-of-domain detection. Furthermore, SNGP provides complementary benefits to popular techniques such as deep ensembles and data augmentation, making it a simple and scalable building block for probabilistic deep learning.
A Copilot For All!
Spend less time creating boilerplate and repetitive code patterns, and more time on what matters: building great software. Write a comment describing the logic you want and GitHub Copilot will immediately suggest code to implement the solution. Microsoft's Github Copilot, trained by ingesting massive quantities of computer code, uses the OpenAI Codex to suggest code in real time. By all measures this will improve productivity for software professionals. Then there is Open AI's DALL-E, an AI-driven image generation tool meant to help the creative process for those in visual arts.
Writing Learning Objectives in a Post-AI World
Learning objectives play a critical part in dictating the success or failure of a learning experience. How well a learning objective is written is a powerful predictor of the overall success [impact] of a learning experience. This week, I'm going to summarise what the research tells us about the formula for optimised objectives, and answer the question that I asked myself at the start of this week: what might the process of objective writing look like for Learning Designer 3.0? Objectives should be constructed as statements of "what the learner will be know and be able to do as a result of some learning experience, as well as including some comment on the why." (Mager, 1997). Objectives are more effective when they describe applicable knowledge & skill as they might be used in a professional setting, rather than simply stating a contextless task. For example, saying "You will be able to explain neuroanatomical structures and their functions to a client, so that you can increase your influence in the workplace" is preferable to "you will be able to define neuroanatomical structures and their functions."
Machine learning could help predict defects, fraud and cancer
When Dr. Shen-Shyang Ho looks at a graph, he sees more than abstract data points. In the dynamic graphs he studies, the computer science researcher sees complex networks that change over time. An associate professor in the Department of Computer Science in Rowan University's College of Science & Mathematics, Ho has studied and developed machine-learning technologies for detecting anomalies in various application domains for nearly 20 years. "Anomalies are deviations from the normal," explained Ho, who also coordinates Rowan's master's degree program in computer science. Many anomalies are undesirable, he added, such as financial fraud, suspicious behavior, manufacturing defects and abnormal findings on medical tests.
An artificial intelligence robot dog, Unitree Go1 - TWB
With the advancement of robotics industry, we see new invention day by day. Recently a company name Unitree launched a Artificial intelligence robot named as Unitree Go1 pro, which has similar features like a trained army dog. One of the most thrilling robots to enter a classroom. With never-before-seen applications in fields including Advanced Manufacturing, Mechatronics, Law Enforcement, Quality Control, and More, Toolkit's quadruped robots are revolutionizing education and business! Our Go1 Ai Pro robot is the ideal choice for your training program because it comes with the Unitree Quadruped Go1 Ai Pro Robot "Dog" and a comprehensive curriculum for programming, CTE, computer science, and more.
Introduction to Deep Learning & Neural Networks with Keras
Looking to start a career in Deep Learning? This course will introduce you to the field of deep learning and help you answer many questions that people are asking nowadays, like what is deep learning, and how do deep learning models compare to artificial neural networks? You will learn about the different deep learning models and build your first deep learning model using the Keras library. After completing this course, learners will be able to: โข Describe what a neural network is, what a deep learning model is, and the difference between them.
Machine Learning with Python
Get ready to dive into the world of Machine Learning (ML) by using Python! This course is for you whether you want to advance your Data Science career or get started in Machine Learning and Deep Learning. This course will begin with a gentle introduction to Machine Learning and what it is, with topics like supervised vs unsupervised learning, linear & non-linear regression, simple regression and more. You will then dive into classification techniques using different classification algorithms, namely K-Nearest Neighbors (KNN), decision trees, and Logistic Regression. You'll also learn about the importance and different types of clustering such as k-means, hierarchical clustering, and DBSCAN.
Out-Of-Distribution Generalization on Graphs: A Survey
Li, Haoyang, Wang, Xin, Zhang, Ziwei, Zhu, Wenwu
Graph machine learning has been extensively studied in both academia and industry. Although booming with a vast number of emerging methods and techniques, most of the literature is built on the in-distribution hypothesis, i.e., testing and training graph data are identically distributed. However, this in-distribution hypothesis can hardly be satisfied in many real-world graph scenarios where the model performance substantially degrades when there exist distribution shifts between testing and training graph data. To solve this critical problem, out-of-distribution (OOD) generalization on graphs, which goes beyond the in-distribution hypothesis, has made great progress and attracted ever-increasing attention from the research community. In this paper, we comprehensively survey OOD generalization on graphs and present a detailed review of recent advances in this area. First, we provide a formal problem definition of OOD generalization on graphs. Second, we categorize existing methods into three classes from conceptually different perspectives, i.e., data, model, and learning strategy, based on their positions in the graph machine learning pipeline, followed by detailed discussions for each category. We also review the theories related to OOD generalization on graphs and introduce the commonly used graph datasets for thorough evaluations. Finally, we share our insights on future research directions. This paper is the first systematic and comprehensive review of OOD generalization on graphs, to the best of our knowledge.
GPT Takes the Bar Exam
Bommarito, Michael II, Katz, Daniel Martin
Nearly all jurisdictions in the United States require a professional license exam, commonly referred to as "the Bar Exam," as a precondition for law practice. To even sit for the exam, most jurisdictions require that an applicant completes at least seven years of post-secondary education, including three years at an accredited law school. In addition, most test-takers also undergo weeks to months of further, exam-specific preparation. Despite this significant investment of time and capital, approximately one in five test-takers still score under the rate required to pass the exam on their first try. In the face of a complex task that requires such depth of knowledge, what, then, should we expect of the state of the art in "AI?" In this research, we document our experimental evaluation of the performance of OpenAI's `text-davinci-003` model, often-referred to as GPT-3.5, on the multistate multiple choice (MBE) section of the exam. While we find no benefit in fine-tuning over GPT-3.5's zero-shot performance at the scale of our training data, we do find that hyperparameter optimization and prompt engineering positively impacted GPT-3.5's zero-shot performance. For best prompt and parameters, GPT-3.5 achieves a headline correct rate of 50.3% on a complete NCBE MBE practice exam, significantly in excess of the 25% baseline guessing rate, and performs at a passing rate for both Evidence and Torts. GPT-3.5's ranking of responses is also highly-correlated with correctness; its top two and top three choices are correct 71% and 88% of the time, respectively, indicating very strong non-entailment performance. While our ability to interpret these results is limited by nascent scientific understanding of LLMs and the proprietary nature of GPT, we believe that these results strongly suggest that an LLM will pass the MBE component of the Bar Exam in the near future.
Auditing the Imputation Effect on Fairness of Predictive Analytics in Higher Education
Anahideh, Hadis, Haghighat, Parian, Nezami, Nazanin, G`andara, Denisa
Colleges and universities use predictive analytics in a variety of ways to increase student success rates. Despite the potential for predictive analytics, two major barriers exist to their adoption in higher education: (a) the lack of democratization in deployment, and (b) the potential to exacerbate inequalities. Education researchers and policymakers encounter numerous challenges in deploying predictive modeling in practice. These challenges present in different steps of modeling including data preparation, model development, and evaluation. Nevertheless, each of these steps can introduce additional bias to the system if not appropriately performed. Most large-scale and nationally representative education data sets suffer from a significant number of incomplete responses from the research participants. While many education-related studies addressed the challenges of missing data, little is known about the impact of handling missing values on the fairness of predictive outcomes in practice. In this paper, we set out to first assess the disparities in predictive modeling outcomes for college-student success, then investigate the impact of imputation techniques on the model performance and fairness using a commonly used set of metrics. We conduct a prospective evaluation to provide a less biased estimation of future performance and fairness than an evaluation of historical data. Our comprehensive analysis of a real large-scale education dataset reveals key insights on modeling disparities and how imputation techniques impact the fairness of the student-success predictive outcome under different testing scenarios. Our results indicate that imputation introduces bias if the testing set follows the historical distribution. However, if the injustice in society is addressed and consequently the upcoming batch of observations is equalized, the model would be less biased.