Goto

Collaborating Authors

 Oceania


AILA--First Experiments with Localist Language Models

arXiv.org Artificial Intelligence

This paper presents the first empirical demonstration of controllable locality in transformer language models, a novel architectural framework that enables continuous control over the degree of representation localization through a tunable locality dial parameter. Unlike traditional language models that rely exclusively on distributed representations, our approach allows dynamic interpolation between highly interpretable localist encodings and efficient distributed representations without requiring model retraining. We conducted experiments on the WikiText corpus using a two-layer transformer architecture, systematically varying the locality parameter ฮป across the full spectrum from 1.0 (fully localist) to 0.0 (fully distributed). Our results demonstrate that localist configurations achieve dramatically lower attention entropy, with ฮป = 1.0 yielding 5.36 bits compared to 7.18 bits at ฮป = 0.0, while maintaining substantially higher pointer fidelity scores reflecting stronger alignment with rule-specified targets. Prediction experiments reveal that intermediate locality values optimize the tradeoff between interpretability and performance, with ฮป = 0.6 achieving test perplexity of 4.65 and accuracy of 84.7%. These findings establish that localist language models provide a practical framework for applications in regulated domains requiring both transparency and capability, offering precise mathematical control over the interpretability-performance spectrum through explicit penalty thresholds and information-theoretic design principles.


A Quantized VAE-MLP Botnet Detection Model: A Systematic Evaluation of Quantization-Aware Training and Post-Training Quantization Strategies

arXiv.org Artificial Intelligence

In an effort to counter the increasing IoT botnet-based attacks, state-of-the-art deep learning methods have been proposed and have achieved impressive detection accuracy. However, their computational intensity restricts deployment on resource-constrained IoT devices, creating a critical need for lightweight detection models. A common solution to this challenge is model compression via quantization. This study proposes a VAE-MLP model framework where an MLP-based classifier is trained on 8-dimensional latent vectors derived from the high-dimensional train data using the encoder component of a pretrained variational autoencoder (VAE). Two widely used quantization strategies--Quantization-Aware Training (QAT) and Post-Training Quantization (PTQ)--are then systematically evaluated in terms of their impact on detection performance, storage efficiency, and inference latency using two benchmark IoT botnet datasets--N-BaIoT and CICIoT2022. The results revealed that, with respect to detection accuracy, the QAT strategy experienced a more noticeable decline,whereas PTQ incurred only a marginal reduction compared to the original unquantized model. Furthermore, PTQ yielded a 6x speedup and 21x reduction in size, while QAT achieved a 3x speedup and 24x compression, demonstrating the practicality of quantization for device-level IoT botnet detection.


SME-TEAM: Leveraging Trust and Ethics for Secure and Responsible Use of AI and LLMs in SMEs

arXiv.org Artificial Intelligence

Artificial Intelligence (AI) and Large Language Models (LLMs) are revolutionizing today's business practices; however, their adoption within small and medium-sized enterprises (SMEs) raises serious trust, ethical, and technical issues. In this perspective paper, we introduce a structured, multi-phased framework, "SME-TEAM" for the secure and responsible use of these technologies in SMEs. Based on a conceptual structure of four key pillars, i.e., Data, Algorithms, Human Oversight, and Model Architecture, SME-TEAM bridges theoretical ethical principles with operational practice, enhancing AI capabilities across a wide range of applications in SMEs. Ultimately, this paper provides a structured roadmap for the adoption of these emerging technologies, positioning trust and ethics as a driving force for resilience, competitiveness, and sustainable innovation within the area of business analytics and SMEs.


King handed Nvidia boss a letter warning of AI dangers

BBC News

Jensen Huang, the head of the world's most valuable company Nvidia, says King Charles III personally handed him a copy of a speech he delivered in 2023 that included a warning about the dangers of artificial intelligence. He said, there's something I want to talk to you about. And he handed me a letter, Huang told the BBC, speaking after receiving the 2025 Queen Elizabeth Prize for Engineering in a ceremony at St James's Palace. The letter was a copy of the speech delivered by the King in 2023 at the world's first AI Summit, held at Bletchley Park . In it the monarch said that the risks of AI needed to be tackled with a sense of urgency, unity and collective strength.


Ride on a humpback whale with little sucker fish

Popular Science

New POV video shows a mutually beneficial relationship between remoras and the gentle giants. Breakthroughs, discoveries, and DIY tips sent every weekday. In addition to its pod, the sizable cetacean generally hosts dozens of remoras. Also known as a suckerfish, these evolutionary wonders in the family hitch rides on whales in order to make a meal of the sea lice and other crustaceans that also make a home on the marine mammal's skin. To accomplish this, the remora possesses a distinctive, oval dorsal fin that functions like an adapted suction cup.


Warning to tourists as world's first ban on smoking cigarettes is enforced

Daily Mail - Science & tech

How doctor's husband died the day he was due to go to prison for killing daughter, 2, in hot car - as eldest daughter, 17, vows to continue lawsuit against widow Rising Republican's future now in tatters as he's blamed for electoral bloodbath I keep hearing the same mortifying whisper about Meghan and Harry... their American dream is about to come crumbling down: MEGYN KELLY Baby girl with horrifying side effects, mom couldn't breathe and dad seriously sick... after simple error turned dream home into a death trap I was an undercover seductress ensnaring the world's most powerful men. Famous American writer's son, 19, arrested over alleged plot to bomb Detroit gay bars in ISIS terror attack Trump's Ice Maiden steps in to save knifed billionaire's NASA nomination: 'Knock it off' Why screaming female migrant who shouted'Help me, I have papers!' was arrested by ICE at Salt Lake City airport Inside Kate and William's forever home: Princess is kitting out Forest Lodge in her preferred'classic contemporary style' to create a'lovely but absolutely inoffensive' look Somali-American who said protecting illegal migrants from Trump was top priority LOSES bid to become America's wokest mayor Emotional Christina Applegate reflects on boyfriend's shock death from drug overdose in rare interview My girlfriend's new body modification is repulsive. She says she did it for me... This Leftist election landslide was caused by the same vile disease that's triggered a GOP civil war. The murder that haunts the Kennedys: Martha Moxley's loved ones reveal their truth in the FREE The Crime Desk newsletter... as accused cousin cleared in killing breaks cover Taylor Momsen admits Gossip Girl role was'killing' her during'long battle' to quit hit series Inside Zohran Mamdani's woke, celebrity filled victory party after socialist won NYC mayoral election Warning to tourists as world's first ban on smoking cigarettes is enforced The Maldives has become the first nation in the world to impose a generational ban on smoking.


Deep-space sci-fi novel is delightful, profound and not to be missed

New Scientist

A planet is about to be destroyed by the collapse of a binary star system in Slow Gods, Claire North's first venture into classic science fiction. It's bad luck for those living on Adjumir, which is set to be obliterated Claire North is a successful and prolific novelist, writing under three separate names, but this is their first shift into classic science fiction, i.e. a novel with spaceships in it. I loved the title of this book, Slow Gods, and I loved the cover art. All of which is to say that I went in with high hopes. It begins: "My name is Mawukana na-Vdnaze, and I am a very poor copy of myself."


Zohran Mamdani Just Inherited the NYPD Surveillance State

WIRED

In addition to affordability, New York City's mayor-elect will be forced to reckon with the NYPD's sweeping mass surveillance operations. New York City mayor-elect Zohran Mamdani may have an ambitious policy agenda, but overhauling the self-governing and deeply dysfunctional behemoth that is the New York City Police Department is not on the list. Mamdani surprised supporters by asking current Police Commissioner Jessica Tisch to stay on after his inauguration early next year. Tisch, a technocrat heir to a vast real estate fortune, clashes with Mamdani on several fronts, including policy (she believes New York State's bail reforms caused rising crime) and the geopolitics that inevitably make their way into New York City's streets. One area where Mamdani is guaranteed to clash with Tisch is on the NYPD's massive technical surveillance apparatus and intelligence-gathering methods, which have metastasized since 9/11 to levels that rival the capabilities of a midsize country.


MP wants Elon Musk's chatbot shut down over claim he enabled grooming gangs

BBC News

MP wants Elon Musk's chatbot shut down over claim he enabled grooming gangs An MP has called for Elon Musk's artificial intelligence (AI) chatbot to be shut down after it called him a rape enabler. The Grok chatbot made the post on X about SNP MP Pete Wishart, after a user asked it to comment on the member's opinion on whether there should be an inquiry into grooming gangs in Scotland. Mr Wishart said he was seeking legal advice over the deeply distressing accusation and called for Musk to recalibrate the bot to shut it down. The BBC has approached XAI, the parent company of X, for comment. I was genuinely shocked to be described in such an appalling and defamatory way, Mr Wishart said in a statement.


Amazon sues AI startup over browser's automated shopping and buying feature

The Guardian

Perplexity AI logo is seen in this illustration taken on 4 January 2024. Perplexity AI logo is seen in this illustration taken on 4 January 2024. Amazon sues AI startup over browser's automated shopping and buying feature Amazon sued a prominent artificial intelligence startup on Tuesday over a shopping feature in the company's browser, which can automate placing orders for users. Amazon accused Perplexity AI of covertly accessing customer accounts and disguising AI activity as human browsing. "Perplexity's misconduct must end," Amazon's lawyers wrote.