Goto

Collaborating Authors

 automatic target recognition


Studying the Effects of Self-Attention on SAR Automatic Target Recognition

Fein-Ashley, Jacob, Kannan, Rajgopal, Prasanna, Viktor

arXiv.org Artificial Intelligence

Attention mechanisms are critically important in the advancement of synthetic aperture radar (SAR) automatic target recognition (ATR) systems. Traditional SAR ATR models often struggle with the noisy nature of the SAR data, frequently learning from background noise rather than the most relevant image features. Attention mechanisms address this limitation by focusing on crucial image components, such as the shadows and small parts of a vehicle, which are crucial for accurate target classification. By dynamically prioritizing these significant features, attention-based models can efficiently characterize the entire image with a few pixels, thus enhancing recognition performance. This capability allows for the discrimination of targets from background clutter, leading to more practical and robust SAR ATR models. We show that attention modules increase top-1 accuracy, improve input robustness, and are qualitatively more explainable on the MSTAR dataset.


Contrastive Learning and Cycle Consistency-based Transductive Transfer Learning for Target Annotation

Sami, Shoaib Meraj, Hasan, Md Mahedi, Nasrabadi, Nasser M., Rao, Raghuveer

arXiv.org Artificial Intelligence

Annotating automatic target recognition (ATR) is a highly challenging task, primarily due to the unavailability of labeled data in the target domain. Hence, it is essential to construct an optimal target domain classifier by utilizing the labeled information of the source domain images. The transductive transfer learning (TTL) method that incorporates a CycleGAN-based unpaired domain translation network has been previously proposed in the literature for effective ATR annotation. Although this method demonstrates great potential for ATR, it severely suffers from lower annotation performance, higher Fr\'echet Inception Distance (FID) score, and the presence of visual artifacts in the synthetic images. To address these issues, we propose a hybrid contrastive learning base unpaired domain translation (H-CUT) network that achieves a significantly lower FID score. It incorporates both attention and entropy to emphasize the domain-specific region, a noisy feature mixup module to generate high variational synthetic negative patches, and a modulated noise contrastive estimation (MoNCE) loss to reweight all negative patches using optimal transport for better performance. Our proposed contrastive learning and cycle-consistency-based TTL (C3TTL) framework consists of two H-CUT networks and two classifiers. It simultaneously optimizes cycle-consistency, MoNCE, and identity losses. In C3TTL, two H-CUT networks have been employed through a bijection mapping to feed the reconstructed source domain images into a pretrained classifier to guide the optimal target domain classifier. Extensive experimental analysis conducted on three ATR datasets demonstrates that the proposed C3TTL method is effective in annotating civilian and military vehicles, as well as ship targets.


PAHD: Perception-Action based Human Decision Making using Explainable Graph Neural Networks on SAR Images

Wijeratne, Sasindu, Zhang, Bingyi, Kannan, Rajgopal, Prasanna, Viktor, Busart, Carl

arXiv.org Artificial Intelligence

Synthetic Aperture Radar (SAR) images are commonly utilized in military applications for automatic target recognition (ATR). Machine learning (ML) methods, such as Convolutional Neural Networks (CNN) and Graph Neural Networks (GNN), are frequently used to identify ground-based objects, including battle tanks, personnel carriers, and missile launchers. Determining the vehicle class, such as the BRDM2 tank, BMP2 tank, BTR60 tank, and BTR70 tank, is crucial, as it can help determine whether the target object is an ally or an enemy. While the ML algorithm provides feedback on the recognized target, the final decision is left to the commanding officers. Therefore, providing detailed information alongside the identified target can significantly impact their actions. This detailed information includes the SAR image features that contributed to the classification, the classification confidence, and the probability of the identified object being classified as a different object type or class. We propose a GNN-based ATR framework that provides the final classified class and outputs the detailed information mentioned above. This is the first study to provide a detailed analysis of the classification class, making final decisions more straightforward. Moreover, our GNN framework achieves an overall accuracy of 99.2\% when evaluated on the MSTAR dataset, improving over previous state-of-the-art GNN methods.



Deep Transductive Transfer Learning for Automatic Target Recognition

Sami, Shoaib M., Nasrabadi, Nasser M., Rao, Raghuveer

arXiv.org Artificial Intelligence

One of the major obstacles in designing an automatic target recognition (ATR) algorithm, is that there are often labeled images in one domain (i.e., infrared source domain) but no annotated images in the other target domains (i.e., visible, SAR, LIDAR). Therefore, automatically annotating these images is essential to build a robust classifier in the target domain based on the labeled images of the source domain. Transductive transfer learning is an effective way to adapt a network to a new target domain by utilizing a pretrained ATR network in the source domain. We propose an unpaired transductive transfer learning framework where a CycleGAN model and a well-trained ATR classifier in the source domain are used to construct an ATR classifier in the target domain without having any labeled data in the target domain. We employ a CycleGAN model to transfer the mid-wave infrared (MWIR) images to visible (VIS) domain images (or visible to MWIR domain). To train the transductive CycleGAN, we optimize a cost function consisting of the adversarial, identity, cycle-consistency, and categorical cross-entropy loss for both the source and target classifiers. In this paper, we perform a detailed experimental analysis on the challenging DSIAC ATR dataset. The dataset consists of ten classes of vehicles at different poses and distances ranging from 1-5 kilometers on both the MWIR and VIS domains. In our experiment, we assume that the images in the VIS domain are the unlabeled target dataset. We first detect and crop the vehicles from the raw images and then project them into a common distance of 2 kilometers. Our proposed transductive CycleGAN achieves 71.56% accuracy in classifying the visible domain vehicles in the DSIAC ATR dataset.


A Global Model Approach to Robust Few-Shot SAR Automatic Target Recognition

Inkawhich, Nathan

arXiv.org Artificial Intelligence

In real-world scenarios, it may not always be possible to collect hundreds of labeled samples per class for training deep learning-based SAR Automatic Target Recognition (ATR) models. This work specifically tackles the few-shot SAR ATR problem, where only a handful of labeled samples may be available to support the task of interest. Our approach is composed of two stages. In the first, a global representation model is trained via self-supervised learning on a large pool of diverse and unlabeled SAR data. In the second stage, the global model is used as a fixed feature extractor and a classifier is trained to partition the feature space given the few-shot support samples, while simultaneously being calibrated to detect anomalous inputs. Unlike competing approaches which require a pristine labeled dataset for pretraining via meta-learning, our approach learns highly transferable features from unlabeled data that have little-to-no relation to the downstream task. We evaluate our method in standard and extended MSTAR operating conditions and find it to achieve high accuracy and robust out-of-distribution detection in many different few-shot settings. Our results are particularly significant because they show the merit of a global model approach to SAR ATR, which makes minimal assumptions, and provides many axes for extendability.


BAE Systems selected to Advance Autonomous Technology for Automatic Target Recognition

#artificialintelligence

The Air Force Research Laboratory (AFRL) awarded BAE Systems a $7.8 million contract to develop tightly integrated machine learning software as part of the Multi-Sensor Exploitation for Tactical Autonomy (META) program. This technology will enable advanced situational awareness and automatic target recognition (ATR). Under the terms of the award, BAE Systems' FAST Labs research and development organization will provide Environmentally Adaptive Geospatial Learning and Exploitation, an innovative suite of machine learning and fusion algorithms. The system integrates multiple elements of the company's extensive autonomy portfolio to provide high confidence detection, tracking, identification, and intent understanding for critical mobile targets in contested environments, including targets under camouflage, concealment, and deception. "With the addition of environmentally adaptive processing, this solution bridges a critical gap in machine learning," said Mark Kolba, program manager for BAE Systems' FAST Labs.


Automatic Target Recognition Using Discrimination Based on Optimal Transport

Sadeghian, Ali, Lim, Deoksu, Karlsson, Johan, Li, Jian

arXiv.org Artificial Intelligence

The use of distances based on optimal transportation has recently shown promise for discrimination of power spectra. In particular, spectral estimation methods based on l1 regularization as well as covariance based methods can be shown to be robust with respect to such distances. These transportation distances provide a geometric framework where geodesics corresponds to smooth transition of spectral mass, and have been useful for tracking. In this paper, we investigate the use of these distances for automatic target recognition. We study the use of the Monge-Kantorovich distance compared to the standard l2 distance for classifying civilian vehicles based on SAR images. We use a version of the Monge-Kantorovich distance that applies also for the case where the spectra may have different total mass, and we formulate the optimization problem as a minimum flow problem that can be computed using efficient algorithms.


Automatic Target Recognition of Personnel and Vehicles from an Unmanned Aerial System Using Learning Algorithms

#artificialintelligence

OBJECTIVE: Develop a system that can be integrated and deployed in a class 1 or class 2 Unmanned Aerial System (UAS) to automatically Detect, Recognize, Classify, Identify (DRCI) and target personnel and ground platforms or other targets of interest. The system should implement learning algorithms that provide operational flexibility by allowing the target set and DRCI taxonomy to be quickly adjusted and to operate in different environments. DESCRIPTION: The use of UASs in military applications is an area of increasing interest and growth. This coupled with the ongoing resurgence in the research, development, and implementation of different types of learning algorithms such as Artificial Neural Networks (ANNs) provide the potential to develop small, rugged, low cost, and flexible systems capable of Automatic Target Recognition (ATR) and other DRCI capabilities that can be integrated in class 1 or class 2 UASs. Implementation of a solution is expected to potentially require independent development in the areas of sensors, communication systems, and algorithms for DRCI and data integration.