Goto

Collaborating Authors

 Africa


A Derandomization Framework for Structure Discovery: Applications in Neural Networks and Beyond

arXiv.org Machine Learning

Understanding the dynamics of feature learning in neural networks (NNs) remains a significant challenge. The work of (Mousavi-Hosseini et al., 2023) analyzes a multiple index teacher-student setting and shows that a two-layer student attains a low-rank structure in its first-layer weights when trained with stochastic gradient descent (SGD) and a strong regularizer. This structural property is known to reduce sample complexity of generalization. Indeed, in a second step, the same authors establish algorithm-specific learning guarantees under additional assumptions. In this paper, we focus exclusively on the structure discovery aspect and study it under weaker assumptions, more specifically: we allow (a) NNs of arbitrary size and depth, (b) with all parameters trainable, (c) under any smooth loss function, (d) tiny regularization, and (e) trained by any method that attains a second-order stationary point (SOSP), e.g.\ perturbed gradient descent (PGD). At the core of our approach is a key $\textit{derandomization}$ lemma, which states that optimizing the function $\mathbb{E}_{\mathbf{x}} \left[g_ฮธ(\mathbf{W}\mathbf{x} + \mathbf{b})\right]$ converges to a point where $\mathbf{W} = \mathbf{0}$, under mild conditions. The fundamental nature of this lemma directly explains structure discovery and has immediate applications in other domains including an end-to-end approximation for MAXCUT, and computing Johnson-Lindenstrauss embeddings.


Benchmarking Probabilistic Time Series Forecasting Models on Neural Activity

arXiv.org Machine Learning

Neural activity forecasting is central to understanding neural systems and enabling closed-loop control. While deep learning has recently advanced the state-of-the-art in the time series forecasting literature, its application to neural activity forecasting remains limited. To bridge this gap, we systematically evaluated eight probabilistic deep learning models, including two foundation models, that have demonstrated strong performance on general forecasting benchmarks. We compared them against four classical statistical models and two baseline methods on spontaneous neural activity recorded from mouse cortex via widefield imaging. Across prediction horizons, several deep learning models consistently outperformed classical approaches, with the best model producing informative forecasts up to 1.5 seconds into the future. Our findings point toward future control applications and open new avenues for probing the intrinsic temporal structure of neural activity.


A Justice Lens on Fairness and Ethics Courses in Computing Education: LLM-Assisted Multi-Perspective and Thematic Evaluation

arXiv.org Artificial Intelligence

Course syllabi set the tone and expectations for courses, shaping the learning experience for both students and instructors. In computing courses, especially those addressing fairness and ethics in artificial intelligence (AI), machine learning (ML), and algorithmic design it is imperative that we understand how approaches to navigating barriers to fair outcomes are being addressed.These expectations should be inclusive, transparent, and grounded in promoting critical thinking. Syllabus analysis offers a way to evaluate the coverage, depth, practices, and expectations within a course. Manual syllabus evaluation, however, is time-consuming and prone to inconsistency. To address this, we developed a justice-oriented scoring rubric and asked a large language model (LLM) to review syllabi through a multi-perspective role simulation. Using this rubric, we evaluated 24 syllabi from four perspectives: instructor, departmental chair, institutional reviewer, and external evaluator. We also prompted the LLM to identify thematic trends across the courses. Findings show that multi-perspective evaluation aids us in noting nuanced, role-specific priorities, leveraging them to fill hidden gaps in curricula design of AI/ML and related computing courses focused on fairness and ethics. These insights offer concrete directions for improving the design and delivery of fairness, ethics, and justice content in such courses.


Temu agrees to remove rip-off greeting cards from its site more quickly

BBC News

Online shopping giant Temu has agreed to work with the greeting card industry to remove copied designs from its site more quickly. Designers told the BBC the process for getting the plagiarised listings removed has been like the fairground game'whack-a-mole' with copied products re-appearing within days. Temu said protecting intellectual property was a top priority and that it was encouraging sellers to join the trial of a new takedown process specifically for the greetings card industry. Amanda Mountain, the co-founder of York-based Lola Design, discovered the catalogue of designs she had built up over a decade had nearly all been copied. She found the images she had created had been lifted and were being advertised by other sellers on cards and other products like t-shirts.


US to announce 'substantial' Russia sanctions

BBC News

US to announce'substantial' Russia sanctions The US government will impose a substantial pickup in sanctions against Russia as the fighting in Ukraine continues, according to US Treasury Secretary Scott Bessent. Bessent's comments came just before Nato Secretary-General Mark Rutte was due at the White House, in which he said he hopes to discuss how to deliver Trump's vision of peace in the conflict. Earlier in the day, Rutte said he believes that Trump is the only one who can get this done. At least seven people were killed, including two children, during intense Russian drone and missile strikes on Ukraine - just hours after Trump said plans for a meeting with Vladimir Putin in Budapest had been shelved. Bessent provided no further details on the incoming sanctions, but said they would be announced either after the close this afternoon or first thing tomorrow morning.


Conservative activist sues Google over AI-generated statements

Al Jazeera

Conservative activist Robby Starbuck sued Google, alleging that the tech giant's artificial intelligence systems generated "outrageously false" information about him. On Wednesday, Starbuck said in the lawsuit, filed in Delaware state court, that Google's AI systems falsely called him a "child rapist," "serial sexual abuser" and "shooter" in response to user queries and delivered defamatory statements to millions of users. "Hallucinations are a well-known issue for all LLMs, which we disclose and work hard to minimise," Castaneda said. "But as everyone knows, if you're creative enough, you can prompt a chatbot to say something misleading." Starbuck is best known for opposing diversity, equity and inclusion initiatives.


Moment Russian drone strikes near apartments in Ukraine

Al Jazeera

How successful is Ukraine's'gas war' against Russia? How will Putin travel to Hungary with an ICC arrest warrant? How much of Europe's oil still comes from Russia? A bystander filmed the moment a Russian drone struck near an apartment building in Sumy, Ukraine, injuring several people. Russia launched a wave of deadly drone and missile attacks on cities across Ukraine on Tuesday.


Children among victims in Russian air strikes, hours after Trump-Putin talks shelved

BBC News

At least seven people have been killed including two children during intense Russian drone and missile strikes on Ukraine, says President Volodymyr Zelensky. A kindergarten was hit in Ukraine's second biggest city Kharkiv and there was widespread damage in Kyiv, in a series of attacks that Zelensky said proved Moscow had not come under enough pressure for its continued war. At least 27 people including children are reported hurt. Hours earlier, US President Donald Trump said his plans for an imminent summit in Budapest with Russia's Vladimir Putin had been shelved as he did not want a wasted meeting. The Kremlin has rejected calls for a ceasefire along the current front lines made both by Trump and European leaders.


Sadiq Khan's hated ULEZ expansion had NO impact on air pollution while raking in millions from drivers

Daily Mail - Science & tech

In April 2019, the Mayor of London introduced the ULEZ, an area in which drivers of more polluting vehicles must pay a daily charge of ยฃ12.50. It aims to reduce air pollution emissions from road transport and accelerating compliance with EU air quality standards. It previously only covered the same area of central London as the Congestion Charge, but it was expanded across all London boroughs on August 29, 2023. ULEZ is one of several London air pollution policies introduced since 2016 like the Low Emission Zone, Low Emission Bus Zones, and bus and taxi electrification. Share or comment on this article: Sadiq Khan's hated ULEZ expansion had NO impact on air pollution while raking in millions from drivers


Dispatch: Partying at one of Africa's largest AI gatherings

MIT Technology Review

Nyalleng Moorosi is part of a movement aimed at involving more African voices in AI policymaking. The room is draped in white curtains, and a giant screen blinks with videos created with generative AI. A classic East African folk song by the Tanzanian singer Saida Karoli plays loudly on the speakers. Friends greet each other as waiters serve arrowroot crisps and sugary mocktails. A man and a woman wearing leopard skins atop their clothes sip beer and chat; many women are in handwoven Ethiopian garb with red, yellow, and green embroidery. "The best thing about the Indaba is always the parties," computer scientist Nyalleng Moorosi tells me.