Confidence Regulation Neurons in Language Models Alessandro Stolfo ETH Zürich Ben Wu
–Neural Information Processing Systems
Entropy neurons are characterized by an unusually high weight norm and influence the final layer normalization (LayerNorm) scale to effectively scale down the logits.
Neural Information Processing Systems
Oct-10-2025, 19:21:25 GMT
- Country:
- North America
- Greenland (0.04)
- Dominican Republic (0.04)
- United States > California
- San Francisco County > San Francisco (0.14)
- Canada > Ontario
- Toronto (0.04)
- Europe
- Switzerland > Zürich
- Zürich (0.40)
- Italy > Tuscany
- Florence (0.04)
- Ireland > Leinster
- County Dublin > Dublin (0.04)
- Switzerland > Zürich
- Asia
- Singapore (0.04)
- Indonesia > Bali (0.04)
- Middle East
- Jordan (0.04)
- Israel (0.04)
- UAE > Abu Dhabi Emirate
- Abu Dhabi (0.04)
- North America
- Genre:
- Research Report
- Experimental Study (1.00)
- New Finding (0.93)
- Research Report
- Industry:
- Information Technology > Security & Privacy (0.46)
- Technology: