Goto

Collaborating Authors

 thesequence


Fast Spawn\&Prune (FS\&P): Global convergence of stochastic conic particle gradient descent via birth/death process

arXiv.org Machine Learning

We investigate the global optimization of the objective function arising in continuous sparse regression, specifically the Beurling LASSO (BLASSO), over the space of measures. While Conic Particle Gradient Descent (CPGD) methods are computationally efficient, they may become trapped in local minima due to the non-convexity of the parameterization. To overcome this limitation, we introduce Fast Spawn\&Prune (FS\&P), a stochastic algorithm that extends FastPart introduced in De Castro et al. (2025) and combines CPGD with a birth-death process. The birth mechanism ensures asymptotic global exploration by introducing particles in regions where first-order optimality conditions are violated, while the death process preserves computational efficiency by pruning non-informative particles. We provide the first theoretical guarantee of global convergence for this class of discrete-time stochastic algorithms, without requiring exponentially large initializations. Furthermore, we derive explicit convergence rates for the excess risk, which scale as $\mathcal{O}\big(\left(\log K / K\right)^{\frac{1}{2(2+d)}}\big)$, where $K$ denotes the number of iterations and d the dimension of the domain, thereby quantifying the trade-off between global exploration and local refinement. Moreover, the sample complexity is $\mathcal{O}\big(N^{-\frac{1}{4(2+d)}}\big)$ (up to logarithmic factors). We also propose a horizon-free variant that does not require prior knowledge of the iteration budget.


Temporally-ConsistentSurvivalAnalysis

Neural Information Processing Systems

Wemodel theeventofinterest asaspecial terminal state, andwe seek to estimate the survival distribution (i.e., the distribution of the hitting time for that terminal state) from anyother state.


TheSequence

#artificialintelligence

TheSequence is an ML community media, trusted by over 144,000+ specialists from all over the world, including the top AI labs like DeepMind, OpenAI, Google Brain, MSFT Research, LinkedIn, universities like MIT, Cornell, Berkeley, Carnegie Mellon, Columbia, and hundreds of large enterprises. Sent Bi-Weekly.


The First ML Value Chain Landscape - KDnuggets

#artificialintelligence

TheSequence is an ML community that has worked with DeepMind, OpenAI, Google Brain, and many more. The world of ML and AI is growing so quickly, to keep up with all of the changes is difficult for professionals and aspiring professionals. The goal at TheSequence is to make people who are interested in the sector smarter about AI without having to read white papers and spend hours on end researching. They also offer other days of knowledge, if you would like to know more click on this link. On October 12th, 2022, TheSequence released the first-ever ML Chain Landscape shaped by data scientists.