disperse
- North America > United States > Texas > Tarrant County > Fort Worth (0.04)
- North America > United States > Massachusetts > Suffolk County > Boston (0.04)
- Law (1.00)
- Information Technology > Security & Privacy (1.00)
- Government > Regional Government > North America Government > United States Government (0.70)
- North America > United States > Michigan > Washtenaw County > Ann Arbor (0.14)
- North America > United States > Massachusetts > Hampshire County > Amherst (0.14)
- Europe (0.14)
- (5 more...)
- Information Technology > Security & Privacy (1.00)
- Information Technology > Artificial Intelligence > Machine Learning (1.00)
- Information Technology > Data Science > Data Mining > Big Data (0.46)
- North America > United States > Texas > Tarrant County > Fort Worth (0.04)
- North America > United States > Massachusetts > Suffolk County > Boston (0.04)
- Law (1.00)
- Information Technology (0.82)
- Government > Regional Government > North America Government > United States Government (0.70)
- Europe (0.14)
- North America > United States > Maryland > Prince George's County > Oxon Hill (0.04)
- North America > United States > Texas > Tarrant County > Fort Worth (0.04)
- (5 more...)
SEMA: a Scalable and Efficient Mamba like Attention via Token Localization and Averaging
Tran, Nhat Thanh, Xue, Fanghui, Zhang, Shuai, Lyu, Jiancheng, Zheng, Yunling, Qi, Yingyong, Xin, Jack
Attention is the critical component of a transformer. Yet the quadratic computational complexity of vanilla full attention in the input size and the inability of its linear attention variant to focus have been challenges for computer vision tasks. We provide a mathematical definition of generalized attention and formulate both vanilla softmax attention and linear attention within the general framework. We prove that generalized attention disperses, that is, as the number of keys tends to infinity, the query assigns equal weights to all keys. Motivated by the dispersion property and recent development of Mamba form of attention, we design Scalable and Efficient Mamba like Attention (SEMA) which utilizes token localization to avoid dispersion and maintain focusing, complemented by theoretically consistent arithmetic averaging to capture global aspect of attention. We support our approach on Imagenet-1k where classification results show that SEMA is a scalable and effective alternative beyond linear attention, outperforming recent vision Mamba models on increasingly larger scales of images at similar model parameter sizes.
- North America > United States > California > San Diego County > San Diego (0.05)
- North America > United States > California > Orange County > Irvine (0.04)
- South America > Colombia > Meta Department > Villavicencio (0.04)
- (2 more...)
- Research Report (0.70)
- Overview (0.46)
Dozens of anti-ICE rioters arrested in LA as Trump sends in National Guard to quell violence
Fox News' Jonathan Hunt reports the latest on the anti-ICE riots in Los Angeles. Correspondent Rich Edson details Dems' response to Trump deploying the National Guard and'Outnumbered' co-host Kayleigh McEnany weighs in on the escalation. Dozens of protesters have been arrested following a weekend of violence across Los Angeles as tensions hit a boiling point over immigration raids throughout the city. On Sunday, law enforcement officials from multiple agencies arrested 41 protesters as anti-Immigration and Customs Enforcement (ICE) demonstrations spiraled out of control. Of the nearly four-dozen arrests, 21 were made by the Los Angeles Police Department (LAPD), 19 by California Highway Patrol and one by the Los Angeles Sheriff's Department.
- North America > United States > California > Los Angeles County > Los Angeles (1.00)
- North America > United States > California > Los Angeles County > Compton (0.07)
- North America > United States > California > Los Angeles County > Paramount (0.06)
Battery-free origami microfliers from UW researchers offer a new bio-inspired future of flying machines
Researchers at the University of Washington developed small robotic devices that can change how they move through the air by "snapping" into a folded position during their descent. Shown here is a timelapse photo of the "microflier" falling in its unfolded state, which makes it tumble chaotically and spread outward in the wind. On a cool afternoon at the heart of the University of Washington's campus, autumn, for a few fleeting moments, appears to have arrived early. Tiny golden squares resembling leaves flutter then fall, switching from a frenzied tumble to a graceful descent with a snap. Aptly named "microfliers" and inspired by Miura-fold origami, these small robotic devices can fold closed during their descent after being dropped from a drone.
LAAT: Locally Aligned Ant Technique for detecting manifolds of varying density
Taghribi, Abolfazl, Bunte, Kerstin, Smith, Rory, Shin, Jihye, Mastropietro, Michele, Peletier, Reynier F., Tino, Peter
Dimensionality reduction and clustering are often used as preliminary steps for many complex machine learning tasks. The presence of noise and outliers can deteriorate the performance of such preprocessing and therefore impair the subsequent analysis tremendously. In manifold learning, several studies indicate solutions for removing background noise or noise close to the structure when the density is substantially higher than that exhibited by the noise. However, in many applications, including astronomical datasets, the density varies alongside manifolds that are buried in a noisy background. We propose a novel method to extract manifolds in the presence of noise based on the idea of Ant colony optimization. In contrast to the existing random walk solutions, our technique captures points which are locally aligned with major directions of the manifold. Moreover, we empirically show that the biologically inspired formulation of ant pheromone reinforces this behavior enabling it to recover multiple manifolds embedded in extremely noisy data clouds. The algorithm's performance is demonstrated in comparison to the state-of-the-art approaches, such as Markov Chain, LLPD, and Disperse, on several synthetic and real astronomical datasets stemming from an N-body simulation of a cosmological volume.
- Europe > Netherlands > Groningen (0.04)
- South America > Argentina > Pampas > Buenos Aires F.D. > Buenos Aires (0.04)
- North America > United States > Rhode Island > Providence County > Providence (0.04)
- (4 more...)
United is set to use 100lb robots that disperse an antimicrobial spray to disinfect planes
Robots have become key players during the coronavirus pandemic and United Airlines is using one to disinfect planes with the hopes of encouraging people to take flight again. The firm has designed a 100-pound robot to disperse an antimicrobial spray that forms a long-lasting bond on surfaces and hinders the growth of microbes. Called NovaRover, the system is equipped with an omnidirectional nozzle atop a poll that sprays the fine mist in six directions as it rolls down the aisle. United explains that it only takes one and a half minutes to disinfect a majority of planes and is set to release these robots at 10 airports across the US that help during a craft's'deepest cleaning' overnight. Robots are being used across the US and worldwide to help limit the spread of the lingering coronavirus.
- Health & Medicine > Therapeutic Area (1.00)
- Transportation > Air (0.95)
- Transportation > Passenger (0.72)
- Health & Medicine > Health Care Equipment & Supplies (0.64)
2 AI-based construction platforms receive millions in funding
Once considered futuristic, artificial intelligence has been made more accessible and integral to contractors in recent years by several burgeoning startups, through programs such as OpenSpace and Smartvid.io. Alice, an AI-based simulation platform for construction, announced yesterday that it has closed $8 million in Series A funding round led by Merus Capital with participation from Foundamental, Blackhorn Ventures and Lightspeed Venture Partners. Founded by Stanford scholar and inventor Rene Morkos in 2018, Alice uses AI to help analyze the flows of labor and equipment throughout a jobsite. In use by firms such as DPR Construction, Mortenson and Parsons, the technology allows users to explore a variety of building plans in real-time and understand the impact of key construction decisions on project cost and duration. The firm says that its customers have cut project duration by 16% and labor costs by nearly 15%.
- North America > United States > New York (0.08)
- Europe > United Kingdom (0.06)