Vision-Language Models (VLMs) are integral to tasks such as image captioning and visual question answering, but their high computational cost, driven by large memory footprints and processing time, limits their scalability and real-time applicability. In this work, we propose leveraging Singular-Value Decomposition (SVD) over the joint query (Q), key (K), and value (V) weight matrices to reduce KV cache size and computational overhead. We in addition introduce an efficient rank allocation strategy that dynamically adjusts the SVD rank based on its impact on VLM accuracy, achieving a significant reduction in both memory usage and computational cost. Finally, we extend this approach by applying quantization to both VLM weights and activations, resulting in a highly efficient VLM. Our method outperforms previous approaches that rely solely on quantization or SVD by achieving more than $10\%$ accuracy improvement while consuming less hardware cost, making it better for real-time deployment on resource-constrained devices. We open source our code at \href{https://github.com/SAI-Lab-NYU/QSVD}{\texttt{https://github.com/SAI-Lab-NYU/QSVD}}.

The sea floor is home to all sorts of weird and wonderful creatures. But one in particular has become an online sensation, thanks to its impressive'buttocks'. A big–bottomed sea star has been spotted more than 1,000 metres (3,280ft) below the waves. And it appears to have a backside that will make even the most avid gymgoer jealous. This has led many baffled viewers to compare the creature to Patrick from the animated series Spongebob Squarepants.

Source: OpenAI's DALL·E 2 with prompt "a hyperrealistic picture of a robot reading the news on a laptop at a coffee shop" Welcome to the 2nd edition of Robo-Insight, a biweekly robotics news update! In this post, we are excited to share a range of remarkable advancements in the field, showcasing progress in hazard mapping, surface crawling, pump controls, adaptive gripping, surgery, health assistance, and mineral extraction. In the domain of hazard mapping, researchers have developed a collaborative scheme that utilizes both ground and aerial robots for hazard mapping of contaminated areas. The team improved the quality of density maps and lowered estimation errors by using a heterogeneous coverage control technique. In comparison to homogeneous alternatives, the strategy optimizes the deployment of robots based on each one's unique characteristics, producing better estimation values and shorter operation times.

If you've ever watched Planet Earth, you know the ocean is a wild place to live. The water is teeming with different ecosystems and organisms varying in complexity from an erudite octopus to a sea star. Unexpectedly, it is the sea star, a simple organism characterized by a decentralized nervous system, that offers insights into advanced adaptation to hydrodynamic forces--the forces created by water pressure and flow. Researchers from the USC Viterbi School of Engineering found that sea stars effectively stay attached to surfaces under extreme hydrodynamic loads by altering their shape. The researchers, including the Henry Salvatori Early Career Chair in Aerospace and Mechanical Engineering Mitul Luhar and doctoral student Mark Hermes, found sea stars create a "downforce" due to their shape.

Yes, but: This is just one area, and this doesn't mean the disease is gone. A major outbreak is happening in the Salish Sea in Washington, and the disease appears to be persisting at low levels from North/Central California up through British Columbia. Some good news: Across the coast, there's been an abundance of baby sea stars. This'pulse', first identified a few years ago, appears to be growing, per a September report by UC Santa Cruz researchers. Although some juveniles show signs of the disease, researchers hope they'll prevent the populations from collapsing.

Starfish are making a comeback on the West Coast, four years after a mysterious syndrome killed millions of them. Starfish are fighting their way back to the West Coast, years after a mysterious syndrome killed millions of them. A catastrophic number of the sea creatures were killed around 2013-2014 by Sea Star Wasting Syndrome. Starfish from British Columbia to Mexico would develop lesions and then disintegrate, with their arms turning into goo. This photos shows a starfish suffering from a wasting disease epidemic is shown in this handout photo courtesy of Kevin Lafferty of the United States Geological Survey, provided November 17, 2014.