Confidence Regulation Neurons in Language Models Alessandro Stolfo ETH Zürich Ben Wu
–Neural Information Processing Systems
Entropy neurons are characterized by an unusually high weight norm and influence the final layer normalization (LayerNorm) scale to effectively scale down the logits.
Neural Information Processing Systems
Oct-10-2025, 19:21:25 GMT
- Country:
- Asia
- Indonesia > Bali (0.04)
- Middle East
- Israel (0.04)
- Jordan (0.04)
- UAE > Abu Dhabi Emirate
- Abu Dhabi (0.04)
- Singapore (0.04)
- Europe
- Ireland > Leinster
- County Dublin > Dublin (0.04)
- Italy > Tuscany
- Florence (0.04)
- Switzerland > Zürich
- Zürich (0.40)
- Ireland > Leinster
- North America
- Canada > Ontario
- Toronto (0.04)
- Dominican Republic (0.04)
- Greenland (0.04)
- United States > California
- San Francisco County > San Francisco (0.14)
- Canada > Ontario
- Asia
- Genre:
- Research Report
- Experimental Study (1.00)
- New Finding (0.93)
- Research Report
- Industry:
- Information Technology > Security & Privacy (0.46)
- Technology: