Kotor
GIMMICK -- Globally Inclusive Multimodal Multitask Cultural Knowledge Benchmarking
Schneider, Florian, Holtermann, Carolin, Biemann, Chris, Lauscher, Anne
Large Vision-Language Models (LVLMs) have recently gained attention due to their distinctive performance and broad applicability. While it has been previously shown that their efficacy in usage scenarios involving non-Western contexts falls short, existing studies are limited in scope, covering just a narrow range of cultures, focusing exclusively on a small number of cultural aspects, or evaluating a limited selection of models on a single task only. Towards globally inclusive LVLM research, we introduce GIMMICK, an extensive multimodal benchmark designed to assess a broad spectrum of cultural knowledge across 144 countries representing six global macro-regions. GIMMICK comprises six tasks built upon three new datasets that span 728 unique cultural events or facets on which we evaluated 20 LVLMs and 11 LLMs, including five proprietary and 26 open-weight models of all sizes. We systematically examine (1) regional cultural biases, (2) the influence of model size, (3) input modalities, and (4) external cues. Our analyses reveal strong biases toward Western cultures across models and tasks and highlight strong correlations between model size and performance, as well as the effectiveness of multimodal input and external geographic cues. We further find that models have more knowledge of tangible than intangible aspects (e.g., food vs. rituals) and that they excel in recognizing broad cultural origins but struggle with a more nuanced understanding.
- South America > Colombia (0.28)
- Africa > Republic of the Congo (0.28)
- Europe > Germany (0.14)
- (169 more...)
- Law (1.00)
- Health & Medicine (1.00)
- Media (0.92)
- (3 more...)
- Information Technology > Artificial Intelligence > Vision (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Chatbot (0.93)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.93)
A dataset for audio-video based vehicle speed estimation
Djukanović, Slobodan, Bulatović, Nikola, Čavor, Ivana
Accurate speed estimation of road vehicles is important for several reasons. One is speed limit enforcement, which represents a crucial tool in decreasing traffic accidents and fatalities. Compared with other research areas and domains, the number of available datasets for vehicle speed estimation is still very limited. We present a dataset of on-road audio-video recordings of single vehicles passing by a camera at known speeds, maintained stable by the on-board cruise control. The dataset contains thirteen vehicles, selected to be as diverse as possible in terms of manufacturer, production year, engine type, power and transmission, resulting in a total of $ 400 $ annotated audio-video recordings. The dataset is fully available and intended as a public benchmark to facilitate research in audio-video vehicle speed estimation. In addition to the dataset, we propose a cross-validation strategy which can be used in a machine learning model for vehicle speed estimation. Two approaches to training-validation split of the dataset are proposed.
- Europe > Montenegro > Podgorica > Podgorica (0.05)
- Europe > Montenegro > Kotor > Kotor (0.04)
- Transportation > Ground > Road (1.00)
- Automobiles & Trucks > Manufacturer (1.00)
A three-day work week? It's possible with artificial intelligence
Artificial intelligence (AI) has a perception problem in India. In the emerging debate around AI, it is either a bugaboo or the tech industry's secret potion for profiteering. It is also seen as a gigantic steamroller that is flattening the IT jobs landscape. Nothing could be farther from the truth. AI is making the future brighter; it represents civilizational progress.
AI Will Help Self-Navigating Ships Plot Their Ways, First Fleet Expected By 2025
If you have ever been on a ship, you might have realized navigation is the most technical and the most important part of sailing -- a slight error in calculation might literally sink you. And such errors, in the past, have been caused mostly by humans. Japan has found a unique solution to the problem -- self-navigating ships. These "smart ships" will find the safest, shortest and most fuel-efficient routes using artificial intelligence (AI) and could be put into service by 2025. The AI tech is expected to make shipping safer by not just potting the course, but also detecting machinery malfunctions and other problems way in advance.
- Asia > Japan (0.29)
- Europe > Montenegro > Kotor > Kotor (0.06)
- Transportation > Passenger (0.54)
- Information Technology > Robotics & Automation (0.38)
- Transportation > Ground > Road (0.35)
- (2 more...)