thermal imaging
Detecting spills using thermal imaging, pretrained deep learning models, and a robotic platform
Yeghiyan, Gregory, Azar, Jurius, Butani, Devson, Chung, Chan-Jin
This paper presents a real-time spill detection system that utilizes pretrained deep learning models with RGB and thermal imaging to classify spill vs. no-spill scenarios across varied environments. Using a balanced binary dataset (4,000 images), our experiments demonstrate the advantages of thermal imaging in inference speed, accuracy, and model size. We achieve up to 100% accuracy using lightweight models like VGG19 and NasNetMobile, with thermal models performing faster and more robustly across different lighting conditions. Our system runs on consumer-grade hardware (RTX 4080) and achieves inference times as low as 44 ms with model sizes under 350 MB, highlighting its deployability in safety-critical contexts. Results from experiments with a real robot and test datasets indicate that a VGG19 model trained on thermal imaging performs best.
- North America > United States > Michigan > Oakland County > Southfield (0.05)
- North America > United States > Michigan > Wayne County > Livonia (0.04)
Real-time Deer Detection and Warning in Connected Vehicles via Thermal Sensing and Deep Learning
Puppala, Hemanth, Sarasua, Wayne, Biyaguda, Srinivas, Farzinpour, Farhad, Chowdhury, Mashrur
Deer-vehicle collisions represent a critical safety challenge in the United States, causing nearly 2.1 million incidents annually and resulting in approximately 440 fatalities, 59,000 injuries, and 10 billion USD in economic damages. These collisions also contribute significantly to declining deer populations. This paper presents a real-time detection and driver warning system that integrates thermal imaging, deep learning, and vehicle-to-everything communication to help mitigate deer-vehicle collisions. Our system was trained and validated on a custom dataset of over 12,000 thermal deer images collected in Mars Hill, North Carolina. Experimental evaluation demonstrates exceptional performance with 98.84 percent mean average precision, 95.44 percent precision, and 95.96 percent recall. The system was field tested during a follow-up visit to Mars Hill and readily sensed deer providing the driver with advanced warning. Field testing validates robust operation across diverse weather conditions, with thermal imaging maintaining between 88 and 92 percent detection accuracy in challenging scenarios where conventional visible light based cameras achieve less than 60 percent effectiveness. When a high probability threshold is reached sensor data sharing messages are broadcast to surrounding vehicles and roadside units via cellular vehicle to everything (CV2X) communication devices. Overall, our system achieves end to end latency consistently under 100 milliseconds from detection to driver alert. This research establishes a viable technological pathway for reducing deer-vehicle collisions through thermal imaging and connected vehicles.
- North America > United States > North Carolina (0.24)
- North America > United States > Pennsylvania (0.04)
- North America > United States > Minnesota (0.04)
- (2 more...)
- Automobiles & Trucks (1.00)
- Transportation > Ground > Road (0.93)
- Information Technology (0.93)
Brain Tumor Detection through Thermal Imaging and MobileNET
Maiti, Roham, Bhoumik, Debasmita
Brain plays a crucial role in regulating body functions and cognitive processes, with brain tumors posing significant risks to human health. Precise and prompt detection is a key factor in proper treatment and better patient outcomes. Traditional methods for detecting brain tumors, that include biopsies, MRI, and CT scans often face challenges due to their high costs and the need for specialized medical expertise. Recent developments in machine learning (ML) and deep learning (DL) has exhibited strong capabilities in automating the identification and categorization of brain tumors from medical images, especially MRI scans. However, these classical ML models have limitations, such as high computational demands, the need for large datasets, and long training times, which hinder their accessibility and efficiency. Our research uses MobileNET model for efficient detection of these tumors. The novelty of this project lies in building an accurate tumor detection model which use less computing re-sources and runs in less time followed by efficient decision making through the use of image processing technique for accurate results. The suggested method attained an average accuracy of 98.5%.
- Asia > Middle East > Yemen > Amran Governorate > Amran (0.04)
- Asia > India > West Bengal > Kolkata (0.04)
- Health & Medicine > Therapeutic Area > Oncology (1.00)
- Health & Medicine > Diagnostic Medicine > Imaging (1.00)
Is thermography a viable solution for detecting pressure injuries in dark skin patients?
Asare-Baiden, Miriam, Jordan, Kathleen, Chung, Andrew, Sonenblum, Sharon Eve, Ho, Joyce C.
Pressure injury (PI) detection is challenging, especially in dark skin tones, due to the unreliability of visual inspection. Thermography has been suggested as a viable alternative as temperature differences in the skin can indicate impending tissue damage. Although deep learning models have demonstrated considerable promise toward reliably detecting PI, the existing work fails to evaluate the performance on darker skin tones and varying data collection protocols. In this paper, we introduce a new thermal and optical imaging dataset of 35 participants focused on darker skin tones where temperature differences are induced through cooling and cupping protocols. We vary the image collection process to include different cameras, lighting, patient pose, and camera distance. We compare the performance of a small convolutional neural network (CNN) trained on either the thermal or the optical images on all skin tones. Our preliminary results suggest that thermography-based CNN is robust to data collection protocols for all skin tones.
- Asia > Middle East > Jordan (0.05)
- North America > United States > Virginia (0.04)
- Europe > France (0.04)
- Research Report > New Finding (1.00)
- Research Report > Experimental Study (0.68)
Advancing Newborn Care: Precise Birth Time Detection Using AI-Driven Thermal Imaging with Adaptive Normalization
García-Torres, Jorge, Meinich-Bache, Øyvind, Johannessen, Anders, Rettedal, Siren, Kolstad, Vilde, Engan, Kjersti
Around 5-10\% of newborns need assistance to start breathing. Currently, there is a lack of evidence-based research, objective data collection, and opportunities for learning from real newborn resuscitation emergency events. Generating and evaluating automated newborn resuscitation algorithm activity timelines relative to the Time of Birth (ToB) offers a promising opportunity to enhance newborn care practices. Given the importance of prompt resuscitation interventions within the "golden minute" after birth, having an accurate ToB with second precision is essential for effective subsequent analysis of newborn resuscitation episodes. Instead, ToB is generally registered manually, often with minute precision, making the process inefficient and susceptible to error and imprecision. In this work, we explore the fusion of Artificial Intelligence (AI) and thermal imaging to develop the first AI-driven ToB detector. The use of temperature information offers a promising alternative to detect the newborn while respecting the privacy of healthcare providers and mothers. However, the frequent inconsistencies in thermal measurements, especially in a multi-camera setup, make normalization strategies critical. Our methodology involves a three-step process: first, we propose an adaptive normalization method based on Gaussian mixture models (GMM) to mitigate issues related to temperature variations; second, we implement and deploy an AI model to detect the presence of the newborn within the thermal video frames; and third, we evaluate and post-process the model's predictions to estimate the ToB. A precision of 88.1\% and a recall of 89.3\% are reported in the detection of the newborn within thermal frames during performance evaluation. Our approach achieves an absolute median deviation of 2.7 seconds in estimating the ToB relative to the manual annotations.
- Europe > Norway > Western Norway > Rogaland > Stavanger (0.05)
- Europe > Netherlands > Gelderland > Nijmegen (0.04)
- Europe > France > Grand Est > Meurthe-et-Moselle > Nancy (0.04)
ThermoHands: A Benchmark for 3D Hand Pose Estimation from Egocentric Thermal Images
Ding, Fangqiang, Zhu, Lawrence, Wen, Xiangyu, Liu, Gaowen, Lu, Chris Xiaoxuan
In this work, we present ThermoHands, a new benchmark for thermal image-based egocentric 3D hand pose estimation, aimed at overcoming challenges like varying lighting conditions and obstructions (e.g., handwear). The benchmark includes a multi-view and multi-spectral dataset collected from 28 subjects performing hand-object and hand-virtual interactions under diverse scenarios, accurately annotated with 3D hand poses through an automated process. We introduce a new baseline method, TherFormer, utilizing dual transformer modules for effective egocentric 3D hand pose estimation in thermal imagery. Our experimental results highlight TherFormer's leading performance and affirm thermal imaging's effectiveness in enabling robust 3D hand pose estimation in adverse conditions.
A Telecare System for Use in Traditional Persian Medicine
Nafisi, Vahid Reza, Ghods, Roshanak
Persian Medicine (PM) uses wrist temperature/humidity and pulse to determine a person's health status and temperament. However, the diagnosis may depend on the physician's interpretation, hindering the combination of PM with modern medical methods. This study proposes a system for measuring pulse signals and temperament detection based on PM. The system uses recorded thermal distribution, a temperament questionnaire, and a customized pulse measurement device. The collected data can be sent to a physician via a telecare system for interpretation and prescription of medications. The system was clinically implemented for patient care, assessed the temperaments of 34 participants, and recorded thermal images of the wrist, back of the hand, and entire face. The study suggests that a customized device for measuring pulse waves and other criteria based on PM can be incorporated into a telemedicine system, reducing the dependency on PM specialists for diagnosis.
- North America > United States > Minnesota > Hennepin County > Minneapolis (0.14)
- Asia > Middle East > Iran > Tehran Province > Tehran (0.05)
- Europe > Iceland > Capital Region > Reykjavik (0.04)
- (3 more...)
- Research Report > New Finding (0.68)
- Research Report > Experimental Study (0.48)
Nuro gets green light to become first autonomous-vehicle delivery service in California
A driverless-vehicle startup has become the first company approved to make deliveries in in California using an autonomous vehicle. Mountain View, California-based Nuro says it plans to begin commercial service as early as next year. Nuro started testing its fleet on California roads in 2017 and, during the pandemic, has shuttled medical goods to a Sacramento field hospital. The permit, however, will allow the company to charge for its service. Founded by two former Google engineers, Nuro will first launch a fleet of autonomous Toyota Priuses, then introduce its own low-speed R2 vehicle.
- Transportation > Passenger (0.94)
- Automobiles & Trucks > Manufacturer (0.93)
- Transportation > Ground > Road (0.92)
- Health & Medicine > Health Care Providers & Services (0.57)
Don't expect AI to solve the coronavirus crisis on its own
Scientists are exploring every possible option for help battling the coronavirus pandemic, and artificial intelligence represents an intriguing avenue. AI has been used to search for new molecules capable of treating Covid-19, to scan through lung CTs for signs of Covid-related pneumonia, and to aid the epidemiologists who tracked the disease's spread early on. The technology is even powering new tracking software that might help identify those walking around with a fever or catch people violating quarantine rules. But how much faith should people really have in these untested tools? In a recent brief, Alex Engler, who studies AI at the Brookings Institution, warned that people should manage their expectations.
A guide to healthy skepticism of artificial intelligence and coronavirus
The COVID-19 outbreak has spurred considerable news coverage about the ways artificial intelligence (AI) can combat the pandemic's spread. Unfortunately, much of it has failed to be appropriately skeptical about the claims of AI's value. Like many tools, AI has a role to play, but its effect on the outbreak is probably small. While this may change in the future, technologies like data reporting, telemedicine, and conventional diagnostic tools are currently far more impactful than AI. Still, various news articles have dramatized the role AI is playing in the pandemic by overstating what tasks it can perform, inflating its effectiveness and scale, neglecting the level of human involvement, and being careless in consideration of related risks. In fact, the COVID-19 AI-hype has been diverse enough to cover the greatest hits of exaggerated claims around AI. And so, framed around examples from the COVID-19 outbreak, here are eight considerations for a skeptic's approach to AI claims.
- Asia > China > Hubei Province > Wuhan (0.05)
- North America > United States > Illinois > Cook County > Chicago (0.04)
- North America > United States > California (0.04)
- (4 more...)