Goto

Collaborating Authors

 Industry


Online Learning with Transductive Regret

Neural Information Processing Systems

We study online learning with the general notion of transductive regret, that is regret with modification rules applying to expert sequences (as opposed to single experts) that are representable by weighted finite-state transducers. We show how transductive regret generalizes existing notions of regret, including: (1) external regret; (2) internal regret; (3) swap regret; and (4) conditional swap regret. We present a general and efficient online learning algorithm for minimizing transductive regret. We further extend that to design efficient algorithms for the time-selection and sleeping expert settings. A by-product of our study is an algorithm for swap regret, which, under mild assumptions, is more efficient than existing ones, and a substantially more efficient algorithm for time selection swap regret.


The Human Skill That Eludes AI

The Atlantic - Technology

Why can't language models write well? I n a certain, strange way, generative AI peaked with OpenAI's GPT-2 seven years ago. Little known to anyone outside of tech circles, GPT-2 excelled at producing unexpected answers. "You could be like, 'Continue this story:,' and GPT-2 would be like, ','" Katy Gero, a poet and computer scientist who has been experimenting with language models since 2017, told me. "The models won't do that anymore." AI leaders boast about their models' superhuman technical abilities.


Gamers are right to be disgusted by NVIDIA's DLSS 5

Engadget

Maybe not everything needs to be AI yassified? You can sum up the gamer response to NVIDIA's DLSS 5 announcement with the ever-relevant meme: Everyone disliked that. Across social media and Reddit last night, I couldn't find anyone who's genuinely positive about the potential for DLSS 5, which uses AI to add photorealistic lighting and materials to in-game models and environments. It's not unusual to see gamers being reflexively angry about new technology on the internet, especially when it's being pitched by NVIDIA as the "biggest breakthrough in computer graphics" since its RTX 20-series GPUs arrived in 2018 with real-time ray tracing. There was plenty of suspicion around DLSS's original AI upscaling model, as well as the fake frames generated by later iterations.


Targeting EEG/LFP Synchrony with Neural Nets

Neural Information Processing Systems

We consider the analysis of Electroencephalography (EEG) and Local Field Potential (LFP) datasets, which are "big" in terms of the size of recorded data but rarely have sufficient labels required to train complex models (e.g., conventional deep learning methods). Furthermore, in many scientific applications, the goal is to be able to understand the underlying features related to the classification, which prohibits the blind application of deep networks. This motivates the development of a new model based on {\em parameterized} convolutional filters guided by previous neuroscience research; the filters learn relevant frequency bands while targeting synchrony, which are frequency-specific power and phase correlations between electrodes.


Union of Intersections (UoI) for Interpretable Data Driven Discovery and Prediction

Neural Information Processing Systems

The increasing size and complexity of scientific data could dramatically enhance discovery and prediction for basic scientific applications, e.g., neuroscience, genetics, systems biology, etc. Realizing this potential, however, requires novel statistical analysis methods that are both interpretable and predictive. We introduce the Union of Intersections (UoI) method, a flexible, modular, and scalable framework for enhanced model selection and estimation. The method performs model selection and model estimation through intersection and union operations, respectively. We show that UoI can satisfy the bi-criteria of low-variance and nearly unbiased estimation of a small number of interpretable features, while maintaining high-quality prediction accuracy. We perform extensive numerical investigation to evaluate a UoI algorithm ($UoI_{Lasso}$) on synthetic and real data. In doing so, we demonstrate the extraction of interpretable functional networks from human electrophysiology recordings as well as the accurate prediction of phenotypes from genotype-phenotype data with reduced features. We also show (with the $UoI_{L1Logistic}$ and $UoI_{CUR}$ variants of the basic framework) improved prediction parsimony for classification and matrix factorization on several benchmark biomedical data sets. These results suggest that methods based on UoI framework could improve interpretation and prediction in data-driven discovery across scientific fields.


VAIN: Attentional Multi-agent Predictive Modeling

Neural Information Processing Systems

Multi-agent predictive modeling is an essential step for understanding physical, social and team-play systems. Recently, Interaction Networks (INs) were proposed for the task of modeling multi-agent physical systems. One of the drawbacks of INs is scaling with the number of interactions in the system (typically quadratic or higher order in the number of agents). In this paper we introduce VAIN, a novel attentional architecture for multi-agent predictive modeling that scales linearly with the number of agents. We show that VAIN is effective for multi-agent predictive modeling. Our method is evaluated on tasks from challenging multi-agent prediction domains: chess and soccer, and outperforms competing multi-agent approaches.



Amazon's Echo Dot Max just got its best discount yet (25% off)

PCWorld

When you purchase through links in our articles, we may earn a small commission. Amazon's Echo Dot Max just got its best discount yet (25% off) It's the newest model of the Echo Dot and it can be yours for just $75 (was $100) right now with this limited-time Amazon deal. Amazon's newest smart speaker, the Echo Dot Max, has just gone on sale for the best price it's had so far. The latest model of the Echo Dot, this one's a bit larger and a lot louder than previous iterations, plus it now features a new chip that's perfectly optimized for the Alexa Plus AI assistant. In this way, the speaker ensures an effortless experience across all major streaming platforms.


Nvidia faces gamer backlash over 'breakthrough' AI graphics feature

BBC News

Nvidia faces gamer backlash over'breakthrough' AI graphics feature A new feature from chip-maker Nvidia that promises cinematic-quality graphics using AI has prompted a backlash online, despite the company claiming it would reinvent what is possible in video games. Nvidia said the DLSS 5 tool, which will be rolled out this autumn, would allow games to have photoreal computer graphics previously only achieved in Hollywood visual effects. In images shared with the media, the tech was shown radically changing the appearance of characters and environments in games such as Resident Evil Requiem and Hogwarts Legacy. But some industry professionals said its use of AI went too far, making graphics feel airbrushed and hollow. Clearly this is a massive glow-up for environments, said video game critic Alex Donaldson on Bluesky.


Task-based End-to-end Model Learning in Stochastic Optimization

Neural Information Processing Systems

With the increasing popularity of machine learning techniques, it has become common to see prediction algorithms operating within some larger process. However, the criteria by which we train these algorithms often differ from the ultimate criteria on which we evaluate them. This paper proposes an end-to-end approach for learning probabilistic machine learning models in a manner that directly captures the ultimate task-based objective for which they will be used, within the context of stochastic programming. We present three experimental evaluations of the proposed approach: a classical inventory stock problem, a real-world electrical grid scheduling task, and a real-world energy storage arbitrage task. We show that the proposed approach can outperform both traditional modeling and purely black-box policy optimization approaches in these applications.