Performance Analysis
Familiarity Discrimination of Radar Pulses
Granger, Eric, Grossberg, Stephen, Rubin, Mark A., Streilein, William W.
H3C 3A7 CANADA 2Department of Cognitive and Neural Systems, Boston University Boston, MA 02215 USA Abstract The ARTMAP-FD neural network performs both identification (placing test patterns in classes encountered during training) and familiarity discrimination (judging whether a test pattern belongs to any of the classes encountered during training). The performance ofARTMAP-FD is tested on radar pulse data obtained in the field, and compared to that of the nearest-neighbor-based NEN algorithm and to a k 1 extension of NEN. 1 Introduction The recognition process involves both identification and familiarity discrimination. Consider, for example, a neural network designed to identify aircraft based on their radar reflections and trained on sample reflections from ten types of aircraft A . . . After training, the network should correctly classify radar reflections belonging to the familiar classes A . Familiarity discrimination is also referred to as "novelty detection," a "reject option," and "recognition in partially exposed environments."
Making Templates Rotationally Invariant. An Application to Rotated Digit Recognition
This paper describes a simple and efficient method to make template-based object classification invariant to in-plane rotations. The task is divided into two parts: orientation discrimination and classification. The key idea is to perform the orientation discrimination before the classification. This can be accomplished byhypothesizing, in turn, that the input image belongs to each class of interest. The image can then be rotated to maximize its similarity to the training imagesin each class (these contain the prototype object in an upright orientation). Thisprocess yields a set of images, at least one of which will have the object in an upright position. The resulting images can then be classified by models which have been trained with only upright examples. This approach has been successfully applied to two real-world vision-based tasks: rotated handwritten digit recognition and rotated face detection in cluttered scenes.
Machine Learning, Machine Vision, and the Brain
Poggio, Tomaso, Shelton, Christian R.
The figure shows an ideal continuous loop from theory to feasibility understanding the problem of intelligence. In reality, the learning is also becoming a key to the study of interactions--as one might expect--are less artificial and biological vision. For example in years, both computer vision--which attempts 1990, ideas from the mathematics of learning to build machines that see--and visual neuroscience--which theory--radial basis function networks--suggested aims to understand how our a model for biological object recognition visual system works--are undergoing a fundamental that led to the physiological experiments change in their approaches. Visual neuroscience in cortex described later in the article. It was is beginning to focus on the mechanisms only later that the same idea found its way into that allow the cortex to adapt its the computer graphics applications described circuitry and learn a new task. In this article, we concentrate on one aspect of Vision systems that learn and adapt represent learning: supervised learning.
Asymptotic Theory for Regularization: One-Dimensional Linear Case
The generalization ability of a neural network can sometimes be improved dramatically by regularization. To analyze the improvement one needs more refined results than the asymptotic distribution of the weight vector. Here we study the simple case of one-dimensional linear regression under quadratic regularization, i.e., ridge regression. We study the random design, misspecified case, where we derive expansions for the optimal regularization parameter and the ensuing improvement. It is possible to construct examples where it is best to use no regularization.
Asymptotic Theory for Regularization: One-Dimensional Linear Case
The generalization ability of a neural network can sometimes be improved dramatically by regularization. To analyze the improvement one needs more refined results than the asymptotic distribution of the weight vector. Here we study the simple case of one-dimensional linear regression under quadratic regularization, i.e., ridge regression. We study the random design, misspecified case, where we derive expansions for the optimal regularization parameter and the ensuing improvement. It is possible to construct examples where it is best to use no regularization.
A General Purpose Image Processing Chip: Orientation Detection
Etienne-Cummings, Ralph, Cai, Donghui
The generalization ability of a neural network can sometimes be improved dramatically by regularization. To analyze the improvement one needs more refined results than the asymptotic distribution of the weight vector. Here we study the simple case of one-dimensional linear regression under quadratic regularization, i.e., ridge regression. We study the random design, misspecified case, where we derive expansions for the optimal regularization parameter and the ensuing improvement. It is possible to construct examples where it is best to use no regularization.