Tombouctou
Towards Robust Knowledge Representations in Multilingual LLMs for Equivalence and Inheritance based Consistent Reasoning
Arora, Gaurav, Merugu, Srujana, Jain, Shreya, Saxena, Vaibhav
Reasoning and linguistic skills form the cornerstone of human intelligence, facilitating problem-solving and decision-making. Recent advances in Large Language Models (LLMs) have led to impressive linguistic capabilities and emergent reasoning behaviors, fueling widespread adoption across application domains. However, LLMs still struggle with complex reasoning tasks, highlighting their systemic limitations. In this work, we focus on evaluating whether LLMs have the requisite representations to reason using two foundational relationships: "equivalence" and "inheritance". We introduce novel tasks and benchmarks spanning six languages and observe that current SOTA LLMs often produce conflicting answers to the same questions across languages in 17.3-57.5% of cases and violate inheritance constraints in up to 37.2% cases. To enhance consistency across languages, we propose novel "Compositional Representations" where tokens are represented as composition of equivalent tokens across languages, with resulting conflict reduction (up to -4.7%) indicating benefits of shared LLM representations.
Effects of Human Adversarial and Affable Samples on BERT Generalization
Elangovan, Aparna, He, Jiayuan, Li, Yuan, Verspoor, Karin
BERT-based models have had strong performance on leaderboards, yet have been demonstrably worse in real-world settings requiring generalization. Limited quantities of training data is considered a key impediment to achieving generalizability in machine learning. In this paper, we examine the impact of training data quality, not quantity, on a model's generalizability. We consider two characteristics of training data: the portion of human-adversarial (h-adversarial), i.e., sample pairs with seemingly minor differences but different ground-truth labels, and human-affable (h-affable) training samples, i.e., sample pairs with minor differences but the same ground-truth label. We find that for a fixed size of training samples, as a rule of thumb, having 10-30% h-adversarial instances improves the precision, and therefore F1, by up to 20 points in the tasks of text classification and relation extraction. Increasing h-adversarials beyond this range can result in performance plateaus or even degradation. In contrast, h-affables may not contribute to a model's generalizability and may even degrade generalization performance.
AI Is Steeped in Big Tech's 'Digital Colonialism'
It has been said that algorithms are "opinions embedded in code." Few people understand the implications of that better than Abeba Birhane. Born and raised in Bahir Dar, Ethiopia, Birhane moved to Ireland to study: first psychology, then philosophy, then a PhD in cognitive science at University College Dublin. During her doctorate, she found herself surrounded by software developers and data science students--immersed in the models they were building and the data sets they were using. But she started to realize that no one was really asking questions about what was actually in those data sets.
Acoustic scene classification using auditory datasets
Kumpawat, Jayesh, Dey, Shubhajit
The approach used not only challenges some of the fundamental mathematical techniques used so far in early experiments of the same trend but also introduces new scopes and new horizons for interesting results. The physics governing spectrograms have been optimized in the project along with exploring how it handles the intense requirements of the problem at hand. Major contributions and developments brought under the light, through this project involve using better mathematical techniques and problem-specific machine learning methods. Improvised data analysis and data augmentation for audio datasets like frequency masking and random frequency-time stretching are used in the project and hence are explained in this paper. In the used methodology, the audio transforms principle were also tried and explored, and indeed the insights gained were used constructively in the later stages of the project. Using a deep learning principle is surely one of them. Also, in this paper, the potential scopes and upcoming research openings in both short and long term tunnel of time has been presented. Although much of the results gained are domain-specific as of now, they are surely potent enough to produce novel solutions in various different domains of diverse backgrounds.
Forty fighters 'neutralised' in drone strikes in Niger
French drone strikes have killed nearly 40 fighters earlier travelling on motorcycles near Niger's border with Burkina Faso, France's military said on Thursday. In a statement, the French military called the strikes a "new tactical success" for France's counterterrorism efforts in Africa's Sahel region, named Operation Barkhane. "Intelligence obtained from Nigerien units in contact with the column confirmed that the motorcycles belonged to an armed terrorist group moving between Burkina Faso and Niger," Barkhane said in the statement. "In close coordination with Niger's Armed Forces, the Barkhane force conducted several strikes against the column. Nearly 40 terrorists were neutralised."
What is Synthetic Intelligence and What Does It Mean for Humanity?
A merger between humans and machines is coming, and it's not what you may have thought. Something mysterious flickered into reality when our ancestors first learned to extract knowledge from their heads and embed it in tools. Now, millions of years later, our tools are fusing with us and, in so doing, bringing about something that is part biological and part technological. We are incubating this new intelligence in our organizations, but it is also true that it represents an extension of ourselves. Humanity is like a seed in an enigmatic womb made up of artificial intelligence and automation.
What is Synthetic Intelligence and What Does It Mean for Humanity?
A merger between humans and machines is coming, and it's not what you may have thought. Something mysterious flickered into reality when our ancestors first learned to extract knowledge from their heads and embed it in tools. Now, millions of years later, our tools are fusing with us and, in so doing, bringing about something that is part biological and part technological. We are incubating this new intelligence in our organizations, but it is also true that it represents an extension of ourselves. Humanity is like a seed in an enigmatic womb made up of artificial intelligence and automation.
Accelerating AI: Past...
SiFive does a quarterly series of tech talks, not necessarily directly to do with SiFive or even RISC-V. For example, last quarter it was Paul Kocher (and if you don't know that name, you need to go and read my post about that talk Paul Kocher: Differential Power Analysis and Spectre). This quarter it was Krste Asanoviฤ on Accelerating AI: Past, Present, and Future. This post will cover the past. The present and future have to wait (good title for a movie?).
Why Alexa's the woman wives hate
Looking back, things probably started to unravel when my wife, Katie, found me tucked up in bed, talking to another woman. 'Goodnight,' she heard me say. 'Sweet dreams,' came the woman's obliging response. The next morning, Katie walked past the sitting room door to catch me muttering something about the weather. 'I wasn't talking to you,' I replied.
Vaux speaker dock review: Add battery power and an improved speaker to your Echo Dot
Amazon's Echo Dot is the most cost-effective way to add voice-activated control to your smart home. There's an Alexa skill for just about every smart-home platform, DIY or custom installed, and second-generation Echo Dot's cost just $50 each. I have six deployed in my own house, connected to a Vivint Smart Home system. The Vaux speaker dock changes that and delivers a bonus: A rechargeable battery that lets you take Alexa all over your house--and out onto the porch, too. The Vaux costs $50, so it and an Echo Dot still cost less than Amazon's own portable Alexa solution, the Amazon Tap. The Vaux's speaker not only sounds better than the Tap, it doesn't force you to press a button to get Alexa's attention like the Tap does.