Goto

Collaborating Authors

 Europe


RareGems: FindingLotteryTicketsatInitialization

Neural Information Processing Systems

A large body of research since the 1980s empirically observed that large neural networks can be compressed orsparsified toasmallfraction oftheiroriginal sizewhilemaintaining theirpredictive accuracy[14-16,20,23,29,45].






ShoppingMMLU: AMassiveMulti-TaskOnline ShoppingBenchmarkforLargeLanguageModels

Neural Information Processing Systems

However,existingmodelsand benchmarks are commonly tailored to specific tasks, falling short of capturing the full complexity of online shopping. Large Language Models (LLMs), with their multi-task and few-shot learning abilities, have the potential to profoundly transform online shopping byalleviating task-specific engineering effortsandby providing users with interactiveconversations.



8abfe8ac9ec214d68541fcb888c0b4c3-Paper.pdf

Neural Information Processing Systems

More specifically,inour main result (Theorem 3.2) we identify a set of sufficient conditions on the initialization and the network topology under which theglobal convergence ofgradient descent isobtained.