Goto

Collaborating Authors

 Africa


Visual Spatial Reasoning

arXiv.org Artificial Intelligence

Spatial relations are a basic part of human cognition. However, they are expressed in natural language in a variety of ways, and previous work has suggested that current vision-and-language models (VLMs) struggle to capture relational information. In this paper, we present Visual Spatial Reasoning (VSR), a dataset containing more than 10k natural text-image pairs with 66 types of spatial relations in English (such as: under, in front of, and facing). While using a seemingly simple annotation format, we show how the dataset includes challenging linguistic phenomena, such as varying reference frames. We demonstrate a large gap between human and model performance: the human ceiling is above 95%, while state-of-the-art models only achieve around 70%. We observe that VLMs' by-relation performances have little correlation with the number of training examples and the tested models are in general incapable of recognising relations concerning the orientations of objects.


Benchmarking the Reliability of Post-training Quantization: a Particular Focus on Worst-case Performance

arXiv.org Artificial Intelligence

Post-training quantization (PTQ) is a popular method for compressing deep neural networks (DNNs) without modifying their original architecture or training procedures. Despite its effectiveness and convenience, the reliability of PTQ methods in the presence of some extrem cases such as distribution shift and data noise remains largely unexplored. This paper first investigates this problem on various commonly-used PTQ methods. We aim to answer several research questions related to the influence of calibration set distribution variations, calibration paradigm selection, and data augmentation or sampling strategies on PTQ reliability. A systematic evaluation process is conducted across a wide range of tasks and commonly-used PTQ paradigms. The results show that most existing PTQ methods are not reliable enough in term of the worst-case group performance, highlighting the need for more robust methods. Our findings provide insights for developing PTQ methods that can effectively handle distribution shift scenarios and enable the deployment of quantized DNNs in real-world applications.


Guiding Online Reinforcement Learning with Action-Free Offline Pretraining

arXiv.org Artificial Intelligence

Offline RL methods have been shown to reduce the need for environment interaction by training agents using offline collected episodes. However, these methods typically require action information to be logged during data collection, which can be difficult or even impossible in some practical cases. In this paper, we investigate the potential of using action-free offline datasets to improve online reinforcement learning, name this problem Reinforcement Learning with Action-Free Offline Pretraining (AFP-RL). We introduce Action-Free Guide (AF-Guide), a method that guides online training by extracting knowledge from action-free offline datasets. AF-Guide consists of an Action-Free Decision Transformer (AFDT) implementing a variant of Upside-Down Reinforcement Learning. It learns to plan the next states from the offline dataset, and a Guided Soft Actor-Critic (Guided SAC) that learns online with guidance from AFDT. Experimental results show that AF-Guide can improve sample efficiency and performance in online training thanks to the knowledge from the action-free offline dataset. Code is available at https://github.com/Vision-CAIR/AF-Guide.


ExpressivE: A Spatio-Functional Embedding For Knowledge Graph Completion

arXiv.org Artificial Intelligence

Knowledge graphs are inherently incomplete. Therefore substantial research has been directed toward knowledge graph completion (KGC), i.e., predicting missing triples from the information represented in the knowledge graph (KG). KG embedding models (KGEs) have yielded promising results for KGC, yet any current KGE is incapable of: (1) fully capturing vital inference patterns (e.g., composition), (2) capturing prominent patterns jointly (e.g., hierarchy and composition), and (3) providing an intuitive interpretation of captured patterns. In this work, we propose ExpressivE, a fully expressive spatio-functional KGE that solves all these challenges simultaneously. ExpressivE embeds pairs of entities as points and relations as hyper-parallelograms in the virtual triple space $\mathbb{R}^{2d}$. This model design allows ExpressivE not only to capture a rich set of inference patterns jointly but additionally to display any supported inference pattern through the spatial relation of hyper-parallelograms, offering an intuitive and consistent geometric interpretation of ExpressivE embeddings and their captured patterns. Experimental results on standard KGC benchmarks reveal that ExpressivE is competitive with state-of-the-art KGEs and even significantly outperforms them on WN18RR.


A Survey on Task Allocation and Scheduling in Robotic Network Systems

arXiv.org Artificial Intelligence

Cloud Robotics is helping to create a new generation of robots that leverage the nearly unlimited resources of large data centers (i.e., the cloud), overcoming the limitations imposed by on-board resources. Different processing power, capabilities, resource sizes, energy consumption, and so forth, make scheduling and task allocation critical components. The basic idea of task allocation and scheduling is to optimize performance by minimizing completion time, energy consumption, delays between two consecutive tasks, along with others, and maximizing resource utilization, number of completed tasks in a given time interval, and suchlike. In the past, several works have addressed various aspects of task allocation and scheduling. In this paper, we provide a comprehensive overview of task allocation and scheduling strategies and related metrics suitable for robotic network cloud systems. We discuss the issues related to allocation and scheduling methods and the limitations that need to be overcome. The literature review is organized according to three different viewpoints: Architectures and Applications, Methods and Parameters. In addition, the limitations of each method are highlighted for future research.


AIIPot: Adaptive Intelligent-Interaction Honeypot for IoT Devices

arXiv.org Artificial Intelligence

The proliferation of the Internet of Things (IoT) has raised concerns about the security of connected devices. There is a need to develop suitable and cost-efficient methods to identify vulnerabilities in IoT devices in order to address them before attackers seize opportunities to compromise them. The deception technique is a prominent approach to improving the security posture of IoT systems. Honeypot is a popular deception technique that mimics interaction in real fashion and encourages unauthorised users (attackers) to launch attacks. Due to the large number and the heterogeneity of IoT devices, manually crafting the low and high-interaction honeypots is not affordable. This has forced researchers to seek innovative ways to build honeypots for IoT devices. In this paper, we propose a honeypot for IoT devices that uses machine learning techniques to learn and interact with attackers automatically. The evaluation of the proposed model indicates that our system can improve the session length with attackers and capture more attacks on the IoT network.


Young Sudan inventor utilises electronic waste to build robots – Middle East Monitor

#artificialintelligence

Moatasem Jibril, a young man from Sudan, is realising his dream of conducting technological experiments to manufacture robots by using recycled electronic waste. Despite modest capabilities and living in a mud house in the city of Omdurman, west of the capital, Khartoum, Jibril did not give up on his dream of making a robot, even after having to quit university due to the deteriorating economic conditions of his family. For about ten years, Jibril has been trying to create robots in a narrow space inside his family house, and he challenges poverty by working daily in the market to earn money to purchase the materials he needs for his project. He hopes that his dream will be funded by any businessman or institution. Sudan is suffering from many crises, starting with a shortage of basic and imported commodities, as well as the depreciation of the local currency, in addition to the government's measures to lift fuel subsidies at the request of the International Monetary Fund in 2021.


Men are using ChatGPT to generate Tinder dating profiles and responses to potential matches

Daily Mail - Science & tech

ChatGPT has proven to be the ultimate wingman among men looking for love online - the chatbot helped one Tinder users get a date in less than one hour. Singles are harnessing the power of OpenAI's tool to curate the perfect dating profiles and responses to snag a potential match, as some feel dating apps have always favored women and ChatGPT is helping them'tip the scales.' Men are going from zero dates to dozens in just the first month of using the chatbot that creates whimsical poems, romantic notes and confident replies for individuals who would otherwise'struggle to come up with conversation starters.' While'the results have been astounding,' some people feel it is dishonest to use ChatGPT to reel women in because they are unaware they are talking to a chatbot. However, one Tinder user is not thinking twice about getting a little help to attract more women.


World in pictures: 43 jaw-dropping photos from Sony World Photography Awards finalists

FOX News

What a wonderful world for all to see. Photographers from around the globe highlighted the best of our planet as part of the open competition for the Sony World Photography Awards 2023. The World Photography Organisation announced last week the best single shots, all taken in 2022, chosen from more than 415,000 submissions from over 200 countries and territories, according to a press release. The competition was split into 10 categories: Architecture, creative, landscape, lifestyle, motion, natural world & wildlife, object, portraiture, street photography and travel. While 10 individual category winners were named -- and they will be awarded Sony digital imaging equipment and the ability to compete for the Open Photographer of the Year title -- finalists were also given honorable mentions.


Detailed images from space offer clearer picture of drought effects on plants

#artificialintelligence

"MIT is a place where dreams come true," says César Terrer, an assistant professor in the Department of Civil and Environmental Engineering. Here at MIT, Terrer says he's given the resources needed to explore ideas he finds most exciting, and at the top of his list is climate science. In particular, he is interested in plant-soil interactions, and how the two can mitigate impacts of climate change. In 2022, Terrer received seed grant funding from the Abdul Latif Jameel Water and Food Systems Lab (J-WAFS) to produce drought monitoring systems for farmers. The project is leveraging a new generation of remote sensing devices to provide high-resolution plant water stress at regional to global scales.