Goto

Collaborating Authors

 forward


Local Linear Convergence of Forward--Backward under Partial Smoothness

Neural Information Processing Systems

In this paper, we consider the Forward--Backward proximal splitting algorithm to minimize the sum of two proper closed convex functions, one of which having a Lipschitz continuous gradient and the other being partly smooth relatively to an active manifold $\mathcal{M}$. We propose a generic framework in which we show that the Forward--Backward (i) correctly identifies the active manifold $\mathcal{M}$ in a finite number of iterations, and then (ii) enters a local linear convergence regime that we characterize precisely. This gives a grounded and unified explanation to the typical behaviour that has been observed numerically for many problems encompassed in our framework, including the Lasso, the group Lasso, the fused Lasso and the nuclear norm regularization to name a few. These results may have numerous applications including in signal/image processing processing, sparse recovery and machine learning.


Local Linear Convergence of Forward--Backward under Partial Smoothness

Neural Information Processing Systems

In this paper, we consider the Forward--Backward proximal splitting algorithm to minimize the sum of two proper closed convex functions, one of which having a Lipschitz continuous gradient and the other being partly smooth relatively to an active manifold \mathcal{M} . We propose a generic framework in which we show that the Forward--Backward (i) correctly identifies the active manifold \mathcal{M} in a finite number of iterations, and then (ii) enters a local linear convergence regime that we characterize precisely. This gives a grounded and unified explanation to the typical behaviour that has been observed numerically for many problems encompassed in our framework, including the Lasso, the group Lasso, the fused Lasso and the nuclear norm regularization to name a few. These results may have numerous applications including in signal/image processing processing, sparse recovery and machine learning.


Probabilistic Inference with Generating Functions for Poisson Latent Variable Models

Neural Information Processing Systems

Graphical models with latent count variables arise in a number of fields. Standard exact inference techniques such as variable elimination and belief propagation do not apply to these models because the latent variables have countably infinite support. As a result, approximations such as truncation or MCMC are employed. We present the first exact inference algorithms for a class of models with latent count variables by developing a novel representation of countably infinite factors as probability generating functions, and then performing variable elimination with generating functions. Our approach is exact, runs in pseudo-polynomial time, and is much faster than existing approximate techniques. It leads to better parameter estimates for problems in population ecology by avoiding error introduced by approximate likelihood computations.


Local Linear Convergence of Forward--Backward under Partial Smoothness

Neural Information Processing Systems

In this paper, we consider the Forward--Backward proximal splitting algorithm to minimize the sum of two proper closed convex functions, one of which having a Lipschitz continuous gradient and the other being partly smooth relatively to an active manifold $\mathcal{M}$. We propose a generic framework in which we show that the Forward--Backward (i) correctly identifies the active manifold $\mathcal{M}$ in a finite number of iterations, and then (ii) enters a local linear convergence regime that we characterize precisely. This gives a grounded and unified explanation to the typical behaviour that has been observed numerically for many problems encompassed in our framework, including the Lasso, the group Lasso, the fused Lasso and the nuclear norm regularization to name a few. These results may have numerous applications including in signal/image processing processing, sparse recovery and machine learning. Papers published at the Neural Information Processing Systems Conference.


Stemming and Lemmatization in Python with NLTK (natural language processing)

#artificialintelligence

Two other methods to reduce dimensions are stemming and lemmatization. I will use one of the articles in the previous post. First, I create new string called news. After than I split the words to tokens. To see the effect we can compare the first 50 words of the lists.


Robot-Building Lab and Contest at the 1993 National AI Conference

AI Magazine

A robot-building lab and contest was held at the Eleventh National Conference on Artificial Intelligence. Teams of three worked day and night for 72 hours to build tabletop autonomous robots of legos, a small microcontroller board, and sensors. The robots then competed head to head in two events. The contest was a chance to learn about building machines that operate in the real world. The lab was in a roped-off area of the main exhibition area.


Anne v.d.L. Gardner

AI Magazine

The object is to bring the situation, or problem state, forward from its initial configuration to one satisfying a goal condition. For example, an initial situation might be the placement of chessmen on the board at the beginning of the game; the desired goal, any board configuration that is a checkmate; and the operators, rules for the legal moves in chess. This difference is then used to index the (forward) operator most relevant to reducing the difference. If this especially relevant operator cannot be immediately applied to the present problem state, subgoals are set up to change the problem state so that the relevant operator can be applied. After these subgoals are solved, the relevant operator is applied and the resulting, modified situation becomes a new starting point from which to solve for the original goal.


Mac made intelligent

AI Magazine

I should like to lodge a complaint about your editorial standards in the article "An Assessment of Tools for Building Large KB Systems," by William Mettrey, in the winter 1987 [volume 9 number As a primary architect of CRL-Ops and a former KnowledgeCraft class instructor, I had to deal with the general public's misconceptions about forward versus backward chaining systems. Mr. Mettrey's article, in my opinion, is the type which generates the confusion that forward chaining rule systems cannot "backwards chain." This nonsensical view was held by the vast majority of our customers in the KC class. The section on Rule-Based inference implies that backward chaining is done only by Prolog in KC with its statement "by contrast, Knowledge-Craft implements backward chaining by supporting a version of Prolog." Any forward chaining rules system can efficiently implement constrained backward chaining by simply using a goal structure to search for the required knowledge.


Editorial

AI Magazine

I am honored by the appointment and look forward to the opportunity to guide the magazine as it begins its third decade of publication. AI Magazine serves the artificial intelligence community in many ways. It is a medium for disseminating information about AI areas and methods to readers across the entire field of AI, as well as to a broad multidisciplinary audience. It is a journal of record for articles on important research and applications advances as well as for meeting reports, reviews, and discussions that illuminate the state of the art and emerging areas. Equally important, it is a forum for sharing visions for the field--perspectives on issues, priorities, and challenges for moving forward.


Toward Integrated Soccer Robots

AI Magazine

Robot soccer competition provides an excellent opportunity for integrated robotics research. In particular, robot players in a soccer game must recognize and track objects in real time, navigate in a dynamic field, collaborate with teammates, and strike the ball in the correct direction. All these tasks demand robots that are autonomous (sensing, thinking, and acting as independent creatures), efficient (functioning under time and resource constraints), cooperative (collaborating with each other to accomplish tasks that are beyond an individual's capabilities), and intelligent (reasoning and planning actions and perhaps learning from experience). Furthermore, all these capabilities must be integrated into a single and complete system, which raises a set of challenges that are new to individual research disciplines. This article describes our experience (problems and solutions) in these aspects.