Deep Learning
Will AI Destroy the World Wide Web?
The World Wide Web (Web) emerged as a new medium in the mid-1990s. It was invented by Tim Berners-Lee at the European Organization for Nuclear Research (CERN) in 1989, but its exploding popularity was also enabled by the release of the Mosaic Web browser in 1993 and the Internet becoming commercially available in 1995. A communication revolution was launched. Roughly 30 years later, the release of ChatGPT by OpenAI in Nov. 2022 launched another revolution. High-quality generation of natural-language text, defined as the hallmark of intelligence by Alan Turing in 1950, is suddenly widely available. I wonder, however, if the generative AI (GenAI) revolution will end up devouring the Web revolution.
Optimizing Data Collection for Machine Learning
Optimizing Data Collection for Machine Learning
An Empirical Investigation of Domain Generalization with Empirical Risk Minimizers
Minimization (ERM) can generalize under distribution shift, outperforming specialized training algorithms for domain generalization. The goal of this paper is to further understand this phenomenon.
FET A: Towards Specializing Foundation Models for Expert Task Applications
This underlines the necessity to explicitly evaluate and finetune FMs on such expert tasks, arguably ones that appear the most in practical real-world applications.
Unsupervised Part Discovery from Contrastive Reconstruction
On the other hand, representation learning at part level has received significantly less attention.
