Goto

Collaborating Authors

 all-in-one



WebUOT-1M: Advancing Deep Underwater Object Tracking with A Million-Scale Benchmark

arXiv.org Artificial Intelligence

Underwater object tracking (UOT) is a foundational task for identifying and tracing submerged entities in underwater video sequences. However, current UOT datasets suffer from limitations in scale, diversity of target categories and scenarios covered, hindering the training and evaluation of modern tracking algorithms. To bridge this gap, we take the first step and introduce WebUOT-1M, \ie, the largest public UOT benchmark to date, sourced from complex and realistic underwater environments. It comprises 1.1 million frames across 1,500 video clips filtered from 408 target categories, largely surpassing previous UOT datasets, \eg, UVOT400. Through meticulous manual annotation and verification, we provide high-quality bounding boxes for underwater targets. Additionally, WebUOT-1M includes language prompts for video sequences, expanding its application areas, \eg, underwater vision-language tracking. Most existing trackers are tailored for open-air environments, leading to performance degradation when applied to UOT due to domain gaps. Retraining and fine-tuning these trackers are challenging due to sample imbalances and limited real-world underwater datasets. To tackle these challenges, we propose a novel omni-knowledge distillation framework based on WebUOT-1M, incorporating various strategies to guide the learning of the student Transformer. To the best of our knowledge, this framework is the first to effectively transfer open-air domain knowledge to the UOT model through knowledge distillation, as demonstrated by results on both existing UOT datasets and the newly proposed WebUOT-1M. Furthermore, we comprehensively evaluate WebUOT-1M using 30 deep trackers, showcasing its value as a benchmark for UOT research by presenting new challenges and opportunities for future studies. The complete dataset, codes and tracking results, will be made publicly available.


SAS Video-QA: Self-Adaptive Sampling for Efficient Video Question-Answering

arXiv.org Artificial Intelligence

Video question--answering is a fundamental task in the field of video understanding. Although current vision--language models (VLMs) equipped with Video Transformers have enabled temporal modeling and yielded superior results, they are at the cost of huge computational power and thus too expensive to deploy in real-time application scenarios. An economical workaround only samples a small portion of frames to represent the main content of that video and tune an image--text model on these sampled frames. Recent video understanding models usually randomly sample a set of frames or clips, regardless of internal correlations between their visual contents, nor their relevance to the problem. We argue that such kinds of aimless sampling may omit the key frames from which the correct answer can be deduced, and the situation gets worse when the sampling sparsity increases, which always happens as the video lengths increase. To mitigate this issue, we propose two frame sampling strategies, namely the most domain frames (MDF) and most implied frames (MIF), to maximally preserve those frames that are most likely vital to the given questions. MDF passively minimizes the risk of key frame omission in a bootstrap manner, while MIS actively searches key frames customized for each video--question pair with the assistance of auxiliary models. The experimental results on three public datasets from three advanced VLMs (CLIP, GIT and All-in-one) demonstrate that our proposed strategies can boost the performance for image--text pretrained models. The source codes pertaining to the method proposed in this paper are publicly available at https://github.com/declare-lab/sas-vqa.


All in One: Exploring Unified Vision-Language Tracking with Multi-Modal Alignment

arXiv.org Artificial Intelligence

Current mainstream vision-language (VL) tracking framework consists of three parts, \ie a visual feature extractor, a language feature extractor, and a fusion model. To pursue better performance, a natural modus operandi for VL tracking is employing customized and heavier unimodal encoders, and multi-modal fusion models. Albeit effective, existing VL trackers separate feature extraction and feature integration, resulting in extracted features that lack semantic guidance and have limited target-aware capability in complex scenarios, \eg similar distractors and extreme illumination. In this work, inspired by the recent success of exploring foundation models with unified architecture for both natural language and computer vision tasks, we propose an All-in-One framework, which learns joint feature extraction and interaction by adopting a unified transformer backbone. Specifically, we mix raw vision and language signals to generate language-injected vision tokens, which we then concatenate before feeding into the unified backbone architecture. This approach achieves feature integration in a unified backbone, removing the need for carefully-designed fusion modules and resulting in a more effective and efficient VL tracking framework. To further improve the learning efficiency, we introduce a multi-modal alignment module based on cross-modal and intra-modal contrastive objectives, providing more reasonable representations for the unified All-in-One transformer backbone. Extensive experiments on five benchmarks, \ie OTB99-L, TNL2K, LaSOT, LaSOT$_{\rm Ext}$ and WebUAV-3M, demonstrate the superiority of the proposed tracker against existing state-of-the-arts on VL tracking. Codes will be made publicly available.


All-in-One: A Highly Representative DNN Pruning Framework for Edge Devices with Dynamic Power Management

arXiv.org Artificial Intelligence

During the deployment of deep neural networks (DNNs) on edge devices, many research efforts are devoted to the limited hardware resource. However, little attention is paid to the influence of dynamic power management. As edge devices typically only have a budget of energy with batteries (rather than almost unlimited energy support on servers or workstations), their dynamic power management often changes the execution frequency as in the widely-used dynamic voltage and frequency scaling (DVFS) technique. This leads to highly unstable inference speed performance, especially for computation-intensive DNN models, which can harm user experience and waste hardware resources. We firstly identify this problem and then propose All-in-One, a highly representative pruning framework to work with dynamic power management using DVFS. The framework can use only one set of model weights and soft masks (together with other auxiliary parameters of negligible storage) to represent multiple models of various pruning ratios. By re-configuring the model to the corresponding pruning ratio for a specific execution frequency (and voltage), we are able to achieve stable inference speed, i.e., keeping the difference in speed performance under various execution frequencies as small as possible. Our experiments demonstrate that our method not only achieves high accuracy for multiple models of different pruning ratios, but also reduces their variance of inference latency for various frequencies, with minimal memory consumption of only one model and one soft mask.


All-in-One:Machine Learning,DL,NLP,AWS Deply [Hindi][Python]

#artificialintelligence

Online Courses Udemy - All-in-One:Machine Learning,DL,NLP,AWS Deply [Hindi][Python], Complete hands-on Machine Learning Course with Data Science, NLP, Deep Learning and Artificial Intelligence Created by Rishi Bansal English Students also bought Java from Zero to First Job: Part 1 - Java Basics and OOP C Programming for Beginners - Master the C Fundamentals Full-Stack Web Development For Beginners The Complete Java Programmer: From Scratch to Advanced Python and Django Full-Stack Web Development for beginners Learn To Create AI Assistant (JARVIS) With Python Preview this course GET COUPON CODE Description This course is designed to cover maximum Concept of Machine Learning. Anyone can opt for this course. No prior understanding of Machine Learning is required. As a Bonus Introduction Natural Language Processing and Deep Learning is included. Below Topics are covered Chapter - Introduction to Machine Learning - Machine Learning?


All-in-One: Machine Learning, DL, NLP [Hindi][Python]

#artificialintelligence

This course is designed to cover maximum Concept of Machine Learning. Anyone can opt for this course. No prior understanding of Machine Learning is required. NOTE: Course is still under Development. You will see new topics will get added regularly. Now question is why this course?


Canary View review: This budget-friendly Canary companion also makes a great standalone camera

PCWorld

The Canary View is the third security camera in the Canary lineup, following the Canary All-In-One and the Canary Flex. Whereas the indoor/outdoor battery-powered Flex was clearly meant to be a companion to the indoor-only All-In-One, the View's place in the family is tougher to figure at first glance. Aesthetically, it's a virtual carbon copy of the original Canary and sports a nearly identical set of security features--all for a much more wallet friendly $99 than the All-In-One's $169. A side-by-side spec sheet comparison might convince you you're seeing double. Both the View and the All-In-One have a 147-degree field of view, 1080p resolution, motion detection, two-way audio, motion and person detection, and integrate with Echo Show, Echo Spot, Fire TV, Wink, and Google Home.


NIST Unveils "All-in-One" Robotic Millimeter-Wave Antenna Test Facility

AITopics Original Links

Along with it comes mm-wave antennas and greater challenges in testing. Gone are the days when antenna calibration for far-field characterization revolved around football-field-size installations and towers tens of meters tall. By the 1960s, antenna testing for near-field measurements moved indoors; those results could then be extrapolated to real-world far-field values. Properly testing today's antennas requires measurements at thousands of positions, each accurate to within one-hundredth of a wavelength. For signals at 183 gigahertz (the emission line for atmospheric water vapor absorption), which have a wavelength of 1,638 micrometers, the probe must be within 33 μm of its ideal position in every dimension on every measurement.