Plotting

 Government


An Optimality Principle for Unsupervised Learning

Neural Information Processing Systems

We propose an optimality principle for training an unsupervised feedforward neural network based upon maximal ability to reconstruct the input data from the network outputs. We describe an algorithm which can be used to train either linear or nonlinear networks with certain types of nonlinearity. Examples of applications to the problems of image coding, feature detection, and analysis of randomdot stereograms are presented.


An Optimality Principle for Unsupervised Learning

Neural Information Processing Systems

We propose an optimality principle for training an unsupervised feedforwardneural network based upon maximal ability to reconstruct the input data from the network outputs. Wedescribe an algorithm which can be used to train either linear or nonlinear networks with certain types of nonlinearity. Examples of applications to the problems of image coding, feature detection, and analysis of randomdot stereogramsare presented.


Letters to the Editor

AI Magazine

Jim Saveland For a fire in that fuel complex to Research Forester The Phoenix project ("Trial by Fire: grow to the size indicated in the time Associate Editor, AI Application in Understanding the Design Requirements indicated would require a midflame Natural Resource Management for Agents in Complex Environments." Agriculture 3) presents very interesting work in The authors go on to state, "Firefighting Forest Service forest fire simulation. I am especially objects are also accurately Southern Forest Fire Laboratory glad to see recognition that the "realtime, simulated; for example, bulldozers Route 1, Box 182A spatially distributed, multiagent, move at a maximum speed of... 0.5 Dry Branch, GA 31020 dynamic, and unpredictable fire kph when cutting a fireline." In reality, environment" provides an excellent sustained fireline production for Editor: opportunity to explore a variety of AI bulldozers is variable (0.1 - 2.0 kph) issues, such as how complex environments depending on steepness of the slope, Mr. Saveland's letter focuses our constrain the design of intelligent vegetation, and size of the bulldozer. I hope more AI researchers Furthermore, although bulldozers are between accuracy and realism.


Expert Systems: How Far Can They Go? Part Two

AI Magazine

A panel session at the 1989 International Joint Conference on Artificial Intelligence in Los Angeles dealt with the subject of knowledge-based systems; the session was entitled "Expert Systems: How Far Can They Go?" The panelists included Randall Davis (Massachusetts Institute of Technology); Stuart Dreyfus (University of California at Berkeley); Brian Smith (Xerox Palo Alto Research Center); and Terry Winograd (Stanford University), chairman. Part 1 of this article, which appeared in the Spring 1989 issue, began with Winograd's original charge to the panel, followed by lightly edited transcripts of presentations from Winograd and Dreyfus. Part 2 begins with the presentations from Smith and Davis and concludes with the panel discussion. Although almost four years have passed since this discussion took place, the issues raised and the points discussed appear no less relevant today.


The Mind at AI: Horseless Carriage to Clock

AI Magazine

Commentators on AI converge on two goals they believe define the field: (1) to better understand the mind by specifying computational models and (2) to construct computer systems that perform actions traditionally regarded as mental. We should recognize that AI has a third, hidden, more basic aim; that the first two goals are special cases of the third; and that the actual technical substance of AI concerns only this more basic aim. This third aim is to establish new computation-based representational media, media in which human intellect can come to express itself with different clarity and force. This article articulates this proposal by showing how the intellectual activity we label AI can be likened in revealing ways to each of five familiar technologies.


Expert Systems in Government Administration

AI Magazine

Artificial Intelligence is solving more and more real world problems, but penetration into the complexities of government administration has been minimal. The author suggests that combining expert system technology with conventional procedural computer systems can lead to substantial efficiencies. Business rules can be removed from business-oriented computer systems and stored in a separate but integrated knowledge base, where maintenance will be centralized. Fourteen specific practical applications are suggested.



A Method for the Design of Stable Lateral Inhibition Networks that is Robust in the Presence of Circuit Parasitics

Neural Information Processing Systems

A serious problem of unwanted spontaneous oscillation often arises with these circuits and renders them unusable in practice. This paper reports a design approach that guarantees such a system will be stable, even though the values of designed elements and parasitic elements in the resistive grid may be unknown. The method is based on a rigorous, somewhat novel mathematical analysis using Tellegen's theorem and the idea of Popov multipliers from control theory. It is thoroughly practical because the criteria are local in the sense that no overall analysis of the interconnected system is required, empirical in the sense that they involve only measurable frequency response data on the individual cells, and robust in the sense that unmodelled parasitic resistances and capacitances in the interconnection networkcannot affect the analysis. I. INTRODUCTION The term "lateral inhibition" first arose in neurophysiology to describe a common form of neural circuitry in which the output of each neuron in some population is used to inhibit the response of each of its neighbors. Perhaps the best understood example is the horizontal cell layer in the vertebrate retina, in which lateral inhibition simultaneously enhances intensity edges and acts as an automatic lain control to extend the dynamic range of the retina as a whole. The principle has been used in the design of artificial neural system algorithms by Kohonen2 and others and in the electronic design of neural chips by Carver Mead et.


Introduction to a System for Implementing Neural Net Connections on SIMD Architectures

Neural Information Processing Systems

INTRODUCTION TO A SYSTEM FOR IMPLEMENTING NEURAL NET CONNECTIONS ON SIMD ARCHITECTURES Sherryl Tomboulian Institute for Computer Applications in Science and Engineering NASA Langley Research Center, Hampton VA 23665 ABSTRACT Neural networks have attracted much interest recently, and using parallel architectures to simulate neural networks is a natural and necessary application. The SIMD model of parallel computation is chosen, because systems of this type can be built with large numbers of processing elements. However, such systems are not naturally suited to generalized communication. A method is proposed that allows an implementation of neural network connections on massively parallel SIMD architectures. The key to this system is an algorithm that allows the formation of arbitrary connections between the "neurons". A feature is the ability to add new connections quickly. It also has error recovery ability and is robust over a variety of network topologies. Simulations of the general connection system, and its implementation on the Connection Machine, indicate that the time and space requirements are proportional to the product of the average number of connections per neuron and the diameter of the interconnection network.


A Method for the Design of Stable Lateral Inhibition Networks that is Robust in the Presence of Circuit Parasitics

Neural Information Processing Systems

A METHOD FOR THE DESIGN OF STABLE LATERAL INHIBITION NETWORKS THAT IS ROBUST IN THE PRESENCE OF CIRCUIT PARASITICS J.L. WYATT, Jr and D.L. STANDLEY Department of Electrical Engineering and Computer Science Massachusetts Institute of Technology Cambridge, Massachusetts 02139 ABSTRACT In the analog VLSI implementation of neural systems, it is sometimes convenient to build lateral inhibition networks by using a locally connected on-chip resistive grid. A serious problem of unwanted spontaneous oscillation often arises with these circuits and renders them unusable in practice. This paper reports a design approach that guarantees such a system will be stable, even though the values of designed elements and parasitic elements in the resistive grid may be unknown. The method is based on a rigorous, somewhat novel mathematical analysis using Tellegen's theorem and the idea of Popov multipliers from control theory. It is thoroughly practical because the criteria are local in the sense that no overall analysis of the interconnected system is required, empirical in the sense that they involve only measurable frequency response data on the individual cells, and robust in the sense that unmodelled parasitic resistances and capacitances in the interconnection network cannot affect the analysis.