super resolution model
From Blurry to Brilliant Detection: YOLOv5-Based Aerial Object Detection with Super Resolution
Nihal, Ragib Amin, Yen, Benjamin, Itoyama, Katsutoshi, Nakadai, Kazuhiro
The demand for accurate object detection in aerial imagery has surged with the widespread use of drones and satellite technology. Traditional object detection models, trained on datasets biased towards large objects, struggle to perform optimally in aerial scenarios where small, densely clustered objects are prevalent. To address this challenge, we present an innovative approach that combines super-resolution and an adapted lightweight YOLOv5 architecture. We employ a range of datasets, including VisDrone-2023, SeaDroneSee, VEDAI, and NWPU VHR-10, to evaluate our model's performance. Our Super Resolved YOLOv5 architecture features Transformer encoder blocks, allowing the model to capture global context and context information, leading to improved detection results, especially in high-density, occluded conditions. This lightweight model not only delivers improved accuracy but also ensures efficient resource utilization, making it well-suited for real-time applications. Our experimental results demonstrate the model's superior performance in detecting small and densely clustered objects, underlining the significance of dataset choice and architectural adaptation for this specific task. In particular, the method achieves 52.5% mAP on VisDrone, exceeding top prior works. This approach promises to significantly advance object detection in aerial imagery, contributing to more accurate and reliable results in a variety of real-world applications.
OpenCV Super Resolution with Deep Learning - PyImageSearch
In this tutorial you will learn how to perform super resolution in images and real-time video streams using OpenCV and Deep Learning. Today's blog post is inspired by an email I received from PyImageSearch reader, Hisham: "Hi Adrian, I read your Deep Learning for Computer Vision with Python book and went through your super resolution implementation with Keras and TensorFlow. It was super helpful, thank you. Are there any pre-trained super resolution models compatible with OpenCV's dnn module? Can they work in real-time? If you have any suggestions, that would be a big help."
Google creates tech that lets you enhance zoomed-in images
The system was developed by researchers working on Google Brain. It's based on a pixel recursive super resolution model that allows pixelated, low-resolution images to be dynamically enhanced. It reduces blur, fills in details and eventually pieces together a high-resolution copy. Google Brain uses two neural networks to create the output images. Working with an input file containing 8x8 pixels, it attempts to match the low-resolution source with an existing high-resolution image. Each high-resolution image is downscaled so it's also 8x8 pixels in size.