Goto

Collaborating Authors

 Education


LMentry: A Language Model Benchmark of Elementary Language Tasks

arXiv.org Artificial Intelligence

As the performance of large language models rapidly improves, benchmarks are getting larger and more complex as well. We present LMentry, a benchmark that avoids this "arms race" by focusing on a compact set of tasks that are trivial to humans, e.g. writing a sentence containing a specific word, identifying which words in a list belong to a specific category, or choosing which of two words is longer. LMentry is specifically designed to provide quick and interpretable insights into the capabilities and robustness of large language models. Our experiments reveal a wide variety of failure cases that, while immediately obvious to humans, pose a considerable challenge for large language models, including OpenAI's latest 175B-parameter instruction-tuned model, TextDavinci002. LMentry complements contemporary evaluation approaches of large language models, providing a quick, automatic, and easy-to-run "unit test", without resorting to large benchmark suites of complex tasks.


iiot ai, Twitter, 12/16/2022 11:49:40 AM, 286405

#artificialintelligence

The graph represents a network of 1,479 Twitter users whose tweets in the requested range contained "iiot ai", or who were replied to or mentioned in those tweets. The network was obtained from the NodeXL Graph Server on Friday, 16 December 2022 at 11:45 UTC. The requested start date was Friday, 16 December 2022 at 01:01 UTC and the maximum number of tweets (going backward in time) was 7,500. The tweets in the network were tweeted over the 2-day, 6-hour, 56-minute period from Tuesday, 13 December 2022 at 18:03 UTC to Friday, 16 December 2022 at 01:00 UTC. Additional tweets that were mentioned in this data set were also collected from prior time periods.


MLOps: train your model using Azureml

#artificialintelligence

In your journey to learn machine learning and data science, there's a high chance that you've came across "MLOps" term mentioned in some of those online tutorials and articles, but you probably thought it's just another fancy word invented to add an extra layer of complexity to the DS world. MLOps stands for Machine Learning Operations, it refers to the set of practices that improves the quality of machine learning an AI projects, and makes their lifecycle management much easier and reproducible for all stakeholders. Productionizing ML projects is difficult. The machine learning lifecycle consists of many complex components such as data ingestion, preprocessing, model training, hyperparameters tuning, model deployment, and performance monitoring... etc. It also requires collaboration and hand-offs across teams, from Data Engineering to Data Science to ML Engineering.


Launching Machine Learning: Delivering Operational Success with Gold Standard ML Leadership

#artificialintelligence

Machine learning runs the world. It generates predictions for each individual customer, employee, voter, and suspect, and these predictions drive millions of business decisions more effectively, determining whom to call, mail, approve, test, diagnose, warn, investigate, incarcerate, set up on a date, or medicate. But, to make this work, you've got to bridge what is a prevalent gap between business leadership and technical know-how. Launching machine learning is as much a management endeavor as a technical one. Its success relies on a very particular business leadership practice.


Managing Machine Learning Lifecycles with MLflow

#artificialintelligence

Model development and experimentation is part of any machine learning lifecycle. However, without careful planning, keeping track of experiments can become tedious and challenging; especially given the number of configurations we typically deal with. MLflow is a machine learning lifecycle framework that allows ML engineers and teams to keep track of their experiments. In PART 1 of the series, we are going to focus on the first two steps -- tracking experiments and sharing code. PART 2 will be dedicated to model packaging, while PART 3 will show how the concepts outlined in the previous parts can be used in a React web application. For now, let's try to understand what MLflow is, and what it can do for us!


Fundamentals of Machine Learning in Finance

#artificialintelligence

The course aims at helping students to be able to solve practical ML-amenable problems that they may encounter in real life that include: (1) understanding where the problem one faces lands on a general landscape of available ML methods, (2) understanding which particular ML approach(es) would be most appropriate for resolving the problem, and (3) ability to successfully implement a solution, and assess its performance. A learner with some or no previous knowledge of Machine Learning (ML) will get to know main algorithms of Supervised and Unsupervised Learning, and Reinforcement Learning, and will be able to use ML open source Python packages to design, test, and implement ML algorithms in Finance. Fundamentals of Machine Learning in Finance will provide more at-depth view of supervised, unsupervised, and reinforcement learning, and end up in a project on using unsupervised learning for implementing a simple portfolio trading strategy. The course is designed for three categories of students: Practitioners working at financial institutions such as banks, asset management firms or hedge funds Individuals interested in applications of ML for personal day trading Current full-time students pursuing a degree in Finance, Statistics, Computer Science, Mathematics, Physics, Engineering or other related disciplines who want to learn about practical applications of ML in Finance Experience with Python (including numpy, pandas, and IPython/Jupyter notebooks), linear algebra, basic probability theory and basic calculus is necessary to complete assignments in this course.


The dawn of AI has come

#artificialintelligence

The release of OpenAI's ChatGPT chatbot has given us a glimpse into the future of teaching and learning alongside artificial intelligence. Educators immediately pointed out the chatbot's ability to generate meaningful responses to questions from assessments and exams. And it is often not possible to attribute these responses to a particular source – making it difficult to detect plagiarism. Shortly after ChatGPT's release, OpenAI announced that it was developing a "digital watermark" to embed into the chatbot's responses. This kind of watermark is embedded as a digital signal that can identify the content as being AI-generated and which (in theory) should be difficult to remove.


Specialized Models: Time Series and Survival Analysis

#artificialintelligence

This course introduces you to additional topics in Machine Learning that complement essential tasks, including forecasting and analyzing censored data. You will learn how to find analyze data with a time component and censored data that needs outcome inference. You will learn a few techniques for Time Series Analysis and Survival Analysis. The hands-on section of this course focuses on using best practices and verifying assumptions derived from Statistical Learning. By the end of this course you should be able to: Identify common modeling challenges with time series data Explain how to decompose Time Series data: trend, seasonality, and residuals Explain how autoregressive, moving average, and ARIMA models work Understand how to select and implement various Time Series models Describe hazard and survival modeling approaches Identify types of problems suitable for survival analysis Who should take this course?


Microsoft Azure Machine Learning

#artificialintelligence

Machine learning is at the core of artificial intelligence, and many modern applications and services depend on predictive machine learning models. Training a machine learning model is an iterative process that requires time and compute resources. Automated machine learning can help make it easier. In this course, you will learn how to use Azure Machine Learning to create and publish models without writing code. This course will help you prepare for Exam AI-900: Microsoft Azure AI Fundamentals.


Probing the properties of molecules and complex materials using machine learning

#artificialintelligence

The application of machine learning to predicting the properties of small and large discrete (single) molecules and complex materials (polymeric, extended or mixtures of molecules) has been increasing exponentially over the past few decades. Unlike physics-based and rule-based computational systems, machine learning algorithms can learn complex relationships between physicochemical and process parameters and their useful properties for an extremely diverse range of molecular entities. Both the breadth of machine learning methods and the range of physical, chemical, materials, biological, medical and many other application areas have increased markedly in the past decade. This Account summarises three decades of research into improved cheminformatics and machine learning methods and their application to drug design, regenerative medicine, biomaterials, porous and 2D materials, catalysts, biomarkers, surface science, physicochemical and phase properties, nanomaterials, electrical and optical properties, corrosion and battery research. Science has always been fascinated by change, uncovering new aspects of Nature and finding useful ways to exploit them to meet global challenges. The rate of change is accelerating, with average time between innovations decreasing exponentially (Figure 1). Computational molecular design prior to 1990 was focused on the use of computationally expensive physics-based methods like molecular modelling, molecular mechanics, molecular dynamics and quantum chemistry. The quantitative structure–activity relationship (QSAR) methods, developed by Hansch and Fujita in the 1960s, were based on the observation that changes in the constitution of small organic molecules generated a corresponding change in their biological activities. Regression methods were used to find relationships between structure, encoded by mathematical entities called descriptors or features, and biological properties of small organic molecules, also numerically encoded. QSAR use was limited to modelling of small data sets of molecules with similar scaffolds, with the primary aim of understanding the molecular basis for drug (or agrochemical) action. As they were not mechanism- or physics-based, their empirical nature created doubt as to their efficacy, the question of when correlation means causation (still an important issue), and lack of data were major barriers to their wider adoption. After that time, technological developments involving automation, computational power, algorithms, synthesis and informatics have maintained this exponential acceleration.