Large Language Model
AI chatbot maker Anthropic plans to raise 10bn to reach 350bn valuation
Website of Claude seen in an iPhone screen on 21 May 2023. Website of Claude seen in an iPhone screen on 21 May 2023. Anthropic is planning a $10bn fundraise that would value the Claude chatbot maker at $350bn, according to multiple reports published on Wednesday. The new valuation represents an increase of nearly double from about four months ago, per CNBC, which reported that the company had signed a term sheet that stipulated the $350bn figure. The round could close within weeks, although the size and terms could change.
ChatGPT is launching a new dedicated Health portal
Be cautious if you opt to use it. OpenAI is launching a new facet for its AI chatbot called ChatGPT Health . This new feature will allow users to connect medical records and wellness apps to ChatGPT in order to get more tailored responses to queries about their health. The company noted that there will be additional privacy safeguards for this separate space within ChatGPT, and said that it will not use conversations held in Health for training foundational models. ChatGPT Health is currently in a testing stage, and there are some regional restrictions on which health apps can be connected to the AI company's platform.
AI Models Are Starting to Learn by Asking Themselves Questions
An AI model that learns without human input--by posing interesting queries for itself--might point the way to superintelligence. Even the smartest artificial intelligence models are essentially copycats. They learn either by consuming examples of human work or by trying to solve problems that have been set for them by human instructors. But perhaps AI can, in fact, learn in a more human way--by figuring out interesting questions to ask itself and attempting to find the right answer. A project from Tsinghua University, the Beijing Institute for General Artificial Intelligence (BIGAI), and Pennsylvania State University shows that AI can learn to reason in this way by playing with computer code.
The Download: war in Europe, and the company that wants to cool the planet
Plus: Amazon has listed retailers' goods without their permission Last spring, 3,000 British soldiers deployed an invisible automated intelligence network, known as a "digital targeting web," as part of a NATO exercise called Hedgehog in the damp forests of Estonia's eastern territories. The system had been cobbled together over the course of four months--an astonishing pace for weapons development, which is usually measured in years. Its purpose is to connect everything that looks for targets--"sensors," in military lingo--and everything that fires on them ("shooters") to a single, shared wireless electronic brain. Eighty years after total war last transformed the continent, the Hedgehog tests signal a brutal new calculus of European defense. But leaning too much on this new mathematics of warfare could be a risky bet. This story is from the next print issue of magazine.
LLMs contain a LOT of parameters. But what's a parameter?
LLMs contain a LOT of parameters. They're the mysterious numbers that make your favorite AI models tick. What are they and what do they do? I am writing this because one of my editors woke up in the middle of the night and scribbled on a bedside notepad: "What is a parameter?" Unlike a lot of thoughts that hit at 4 a.m., it's a really good question--one that goes right to the heart of how large language models work. A large language model's parameters are often said to be the dials and levers that control how it behaves.
Consolidate your AI apps into one platform built for creators and businesses -- now a flat 59.99
When you purchase through links in our articles, we may earn a small commission. Consolidate your AI apps into one platform built for creators and businesses -- now a flat $59.99 Get three years of access to 1min.AI's Advanced Business Plan for $59.99 (MSRP $299) and unlock a massive suite of AI tools powered by leading models like GPT-4o, Claude, Gemini, and more. Wrangling a different AI tool for every task gets messy fast -- one for writing, one for images, one for video, another for audio, and suddenly you have more subscriptions than actual productivity. That's where this $59.99 1min.AI deal steps in, giving you one platform that can do just about everything in your workflow. From content writing to SEO research to image editing to video generation, it's all baked in, powered by top models from OpenAI, Anthropic, Google, Meta, Mistral, and Cohere.
From Entropy to Epiplexity: Rethinking Information for Computationally Bounded Intelligence
Finzi, Marc, Qiu, Shikai, Jiang, Yiding, Izmailov, Pavel, Kolter, J. Zico, Wilson, Andrew Gordon
Can we learn more from data than existed in the generating process itself? Can new and useful information be constructed from merely applying deterministic transformations to existing data? Can the learnable content in data be evaluated without considering a downstream task? On these questions, Shannon information and Kolmogorov complexity come up nearly empty-handed, in part because they assume observers with unlimited computational capacity and fail to target the useful information content. In this work, we identify and exemplify three seeming paradoxes in information theory: (1) information cannot be increased by deterministic transformations; (2) information is independent of the order of data; (3) likelihood modeling is merely distribution matching. To shed light on the tension between these results and modern practice, and to quantify the value of data, we introduce epiplexity, a formalization of information capturing what computationally bounded observers can learn from data. Epiplexity captures the structural content in data while excluding time-bounded entropy, the random unpredictable content exemplified by pseudorandom number generators and chaotic dynamical systems. With these concepts, we demonstrate how information can be created with computation, how it depends on the ordering of the data, and how likelihood modeling can produce more complex programs than present in the data generating process itself. We also present practical procedures to estimate epiplexity which we show capture differences across data sources, track with downstream performance, and highlight dataset interventions that improve out-of-distribution generalization. In contrast to principles of model selection, epiplexity provides a theoretical foundation for data selection, guiding how to select, generate, or transform data for learning systems.
Chronicals: A High-Performance Framework for LLM Fine-Tuning with 3.51x Speedup over Unsloth
Large language model fine-tuning is bottlenecked by memory: a 7B parameter model requires 84GB--14GB for weights, 14GB for gradients, and 56GB for FP32 optimizer states--exceeding even A100-40GB capacity. We present Chronicals, an open-source training framework achieving 3.51x speedup over Unsloth through four synergistic optimizations: (1) fused Triton kernels eliminating 75% of memory traffic via RMSNorm (7x), SwiGLU (5x), and QK-RoPE (2.3x) fusion; (2) Cut Cross-Entropy reducing logit memory from 5GB to 135MB through online softmax computation; (3) LoRA+ with theoretically-derived 16x differential learning rates between adapter matrices; and (4) Best-Fit Decreasing sequence packing recovering 60-75% of compute wasted on padding. On Qwen2.5-0.5B with A100-40GB, Chronicals achieves 41,184 tokens/second for full fine-tuning versus Unsloth's 11,736 tokens/second (3.51x). For LoRA at rank 32, we reach 11,699 tokens/second versus Unsloth MAX's 2,857 tokens/second (4.10x). Critically, we discovered that Unsloth's reported 46,000 tokens/second benchmark exhibited zero gradient norms--the model was not training. We provide complete mathematical foundations: online softmax correctness proofs, FlashAttention IO complexity bounds O(N^2 d^2 M^{-1}), LoRA+ learning rate derivations from gradient magnitude analysis, and bin-packing approximation guarantees. All implementations, benchmarks, and proofs are available at https://github.com/Ajwebdevs/Chronicals with pip installation via https://pypi.org/project/chronicals/.
Detecting and Mitigating Treatment Leakage in Text-Based Causal Inference: Distillation and Sensitivity Analysis
Daoud, Adel, Johansson, Richard, Jerzak, Connor T.
Text-based causal inference increasingly employs textual data as proxies for unobserved confounders, yet this approach introduces a previously undertheorized source of bias: treatment leakage. Treatment leakage occurs when text intended to capture confounding information also contains signals predictive of treatment status, thereby inducing post-treatment bias in causal estimates. Critically, this problem can arise even when documents precede treatment assignment, as authors may employ future-referencing language that anticipates subsequent interventions. Despite growing recognition of this issue, no systematic methods exist for identifying and mitigating treatment leakage in text-as-confounder applications. This paper addresses this gap through three contributions. First, we provide formal statistical and set-theoretic definitions of treatment leakage that clarify when and why bias occurs. Second, we propose four text distillation methods -- similarity-based passage removal, distant supervision classification, salient feature removal, and iterative nullspace projection -- designed to eliminate treatment-predictive content while preserving confounder information. Third, we validate these methods through simulations using synthetic text and an empirical application examining International Monetary Fund structural adjustment programs and child mortality. Our findings indicate that moderate distillation optimally balances bias reduction against confounder retention, whereas overly stringent approaches degrade estimate precision.
Stand Up for Research, Innovation, and Education
Our community is standing up for MIT and its mission to serve the nation and the world. And we need you to join us at this critical moment. This story was part of our September/October 2025 issue. We're learning more about what vitamin D does to our bodies Jessica Hamzelou OpenAI's new LLM exposes the secrets of how AI really works Will Douglas Heaven China figured out how to sell EVs. Now it has to deal with their aging batteries. We're learning more about what vitamin D does to our bodies The sunshine vitamin could affect your immune system and heart health.