Goto

Collaborating Authors

 Genre


0f83556a305d789b1d71815e8ea4f4b0-Paper.pdf

Neural Information Processing Systems

Topic model evaluation, like evaluation of other unsupervised methods, can be contentious. However, the field has coalesced around automated estimates of topic coherence, which rely on the frequency of word co-occurrences in a reference corpus. Contemporary neural topic models surpass classical ones according to these metrics. At the same time, topic model evaluation suffers from a validation gap: automated coherence, developed for classical models, has not been validated using human experimentation for neural models. In addition, a meta-analysis of topic modeling literature reveals a substantial standardization gap in automated topic modeling benchmarks. To address the validation gap, we compare automated coherence with the two most widely accepted human judgment tasks: topic rating and word intrusion. To address the standardization gap, we systematically evaluate a dominant classical model and two state-of-the-art neural models on two commonly used datasets. Automated evaluations declare a winning model when corresponding human evaluations do not, calling into question the validity of fully automatic evaluations independent of human judgments.



The sun just fired off two massive solar flares

Popular Science

But the X-class events aren't even close to the most powerful flare on record. More information Adding us as a Preferred Source in Google by using this link indicates that you would like to see more of our content in Google News results. NASA's Solar Dynamics Observatory captured these images of solar flares -- seen as the bright flashes in the top right -- on April 23 and 24, 2026. The images show a subset of extreme ultraviolet light that highlights the extremely hot material in flares and which is colorized in in gold and blue on the left and teal on the right. Breakthroughs, discoveries, and DIY tips sent six days a week.