Goto

Collaborating Authors

 Instructional Material


AI Coloring Books Empire Review 2023 – Make Beautiful Coloring Books With AI

#artificialintelligence

Looking to enhance your coloring book empire using the power of AI? Then look no further than our'AI Coloring Books Empire' course! Our course offers a complete guide to using AI to produce stunning coloring pages, ideal for publishing in traditional paper books or selling as digital image packs on platforms such as Etsy. Our step-by-step tutorials will teach you how to leverage AI technology to create intricate and visually captivating designs that will appeal to both children and adults. Whether you're a seasoned coloring book creator or just starting out, our course is designed to help take your business to the next level. We'll provide you with all the necessary knowledge to create beautiful and unique designs that will stand out in a crowded market.


Physics-Guided Deep Learning for Dynamical Systems: A Survey

arXiv.org Artificial Intelligence

Modeling complex physical dynamics is a fundamental task in science and engineering. Traditional physics-based models are sample efficient, and interpretable but often rely on rigid assumptions. Furthermore, direct numerical approximation is usually computationally intensive, requiring significant computational resources and expertise, and many real-world systems do not have fully-known governing laws. While deep learning (DL) provides novel alternatives for efficiently recognizing complex patterns and emulating nonlinear dynamics, its predictions do not necessarily obey the governing laws of physical systems, nor do they generalize well across different systems. Thus, the study of physics-guided DL emerged and has gained great progress. Physics-guided DL aims to take the best from both physics-based modeling and state-of-the-art DL models to better solve scientific problems. In this paper, we provide a structured overview of existing methodologies of integrating prior physical knowledge or physics-based modeling into DL, with a special emphasis on learning dynamical systems. We also discuss the fundamental challenges and emerging opportunities in the area.


RIPPLE: Concept-Based Interpretation for Raw Time Series Models in Education

arXiv.org Artificial Intelligence

Time series is the most prevalent form of input data for educational prediction tasks. The vast majority of research using time series data focuses on hand-crafted features, designed by experts for predictive performance and interpretability. However, extracting these features is labor-intensive for humans and computers. In this paper, we propose an approach that utilizes irregular multivariate time series modeling with graph neural networks to achieve comparable or better accuracy with raw time series clickstreams in comparison to hand-crafted features. Furthermore, we extend concept activation vectors for interpretability in raw time series models. We analyze these advances in the education domain, addressing the task of early student performance prediction for downstream targeted interventions and instructional support. Our experimental analysis on 23 MOOCs with millions of combined interactions over six behavioral dimensions show that models designed with our approach can (i) beat state-of-the-art educational time series baselines with no feature extraction and (ii) provide interpretable insights for personalized interventions. Source code: https://github.com/epfl-ml4ed/ripple/.


5 Key Technology Trends Changing Banking's Competitive Balance

#artificialintelligence

The banking industry has undergone significant changes that have fundamentally altered the competitive battlefield. With a focus on improving efficiencies, finding new revenue opportunities and improving the customer experience, five megatrends have arisen to impact banking in tectonic ways. They all are components of the digital banking transformation process – some being revolutionary while others are evolutions of trends already in process. In this webinar from MeridianLink, you'll learn how to deliver a world-class, omnichannel digital banking experience that's fast, responsive and frictionless. Read More about Is Your Credit Union Addressing the Digital Imperative?


Learn JAX in 2023: Part 2 - grad, jit, vmap, and pmap

#artificialintelligence

In this tutorial, you will learn the power tools of JAX, grad, jit, vmap, and pmap. To learn how to use JAX's power tools, just keep reading. Welcome to our comprehensive guide on advanced JAX techniques! In the previous tutorial, we were introduced to JAX, and its predecessors autograd and xla. We also briefly looked into numerical computing with JAX. In this post, we'll be diving into some of the most powerful and useful features of the JAX library, including grad, jit, vmap, and pmap. These functions allow you to easily and efficiently compute gradients of functions, optimize your code for faster execution, and apply functions to arrays of data in parallel. By the end of this post, you'll have a solid understanding of how to use these tools to improve the performance and functionality of your numerical computation and machine learning tasks. We'll also cover the topic of randomness in JAX, including how to generate and control random numbers for use in your computations.



Injectivity of ReLU networks: perspectives from statistical physics

arXiv.org Artificial Intelligence

When can the input of a ReLU neural network be inferred from its output? In other words, when is the network injective? We consider a single layer, $x \mapsto \mathrm{ReLU}(Wx)$, with a random Gaussian $m \times n$ matrix $W$, in a high-dimensional setting where $n, m \to \infty$. Recent work connects this problem to spherical integral geometry giving rise to a conjectured sharp injectivity threshold for $\alpha = \frac{m}{n}$ by studying the expected Euler characteristic of a certain random set. We adopt a different perspective and show that injectivity is equivalent to a property of the ground state of the spherical perceptron, an important spin glass model in statistical physics. By leveraging the (non-rigorous) replica symmetry-breaking theory, we derive analytical equations for the threshold whose solution is at odds with that from the Euler characteristic. Furthermore, we use Gordon's min--max theorem to prove that a replica-symmetric upper bound refutes the Euler characteristic prediction. Along the way we aim to give a tutorial-style introduction to key ideas from statistical physics in an effort to make the exposition accessible to a broad audience. Our analysis establishes a connection between spin glasses and integral geometry but leaves open the problem of explaining the discrepancies.


CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis

arXiv.org Artificial Intelligence

Program synthesis strives to generate a computer program as a solution to a given problem specification, expressed with input-output examples or natural language descriptions. The prevalence of large language models advances the state-of-the-art for program synthesis, though limited training resources and data impede open access to such models. To democratize this, we train and release a family of large language models up to 16.1B parameters, called CODEGEN, on natural language and programming language data, and open source the training library JAXFORMER. We show the utility of the trained model by demonstrating that it is competitive with the previous state-of-the-art on zero-shot Python code generation on HumanEval. We further investigate the multi-step paradigm for program synthesis, where a single program is factorized into multiple prompts specifying subproblems. To this end, we construct an open benchmark, Multi-Turn Programming Benchmark (MTPB), consisting of 115 diverse problem sets that are factorized into multi-turn prompts. Our analysis on MTPB shows that the same intent provided to CODEGEN in multi-turn fashion significantly improves program synthesis over that provided as a single turn. We make the training library JAXFORMER and model checkpoints available as open source contribution: https://github.com/salesforce/CodeGen.


On the Role of Emergent Communication for Social Learning in Multi-Agent Reinforcement Learning

arXiv.org Artificial Intelligence

Explicit communication among humans is key to coordinating and learning. Social learning, which uses cues from experts, can greatly benefit from the usage of explicit communication to align heterogeneous policies, reduce sample complexity, and solve partially observable tasks. Emergent communication, a type of explicit communication, studies the creation of an artificial language to encode a high task-utility message directly from data. However, in most cases, emergent communication sends insufficiently compressed messages with little or null information, which also may not be understandable to a third-party listener. This paper proposes an unsupervised method based on the information bottleneck to capture both referential complexity and task-specific utility to adequately explore sparse social communication scenarios in multi-agent reinforcement learning (MARL). We show that our model is able to i) develop a natural-language-inspired lexicon of messages that is independently composed of a set of emergent concepts, which span the observations and intents with minimal bits, ii) develop communication to align the action policies of heterogeneous agents with dissimilar feature models, and iii) learn a communication policy from watching an expert's action policy, which we term `social shadowing'.


Multiple Linear Regression in R - Lituptech Digital

#artificialintelligence

We are going to learn how to implement a Multiple Linear Regression model in R. This is a bit more complex than Simple Linear Regression but it's going to be so practical and fun. Multiple Linear Regression is a data science technique that uses several explanatory variables to predict the outcome of a response variable. A Multiple linear regression model attempts to model the relationship between two or more explanatory variables (independent variables) and a response variable (dependent variable), by fitting a linear equation to observed data. Every value of the independent variable x is associated with a value of the dependent variable y.