ticket
Country:
- North America > United States > New York > Rensselaer County > Troy (0.04)
- North America > United States > Texas > Travis County > Austin (0.04)
- North America > United States > New York > Erie County > Buffalo (0.04)
- (3 more...)
Technology: Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.69)
Country:
- North America > United States (0.04)
- Asia > China > Tianjin Province > Tianjin (0.04)
Genre:
- Contests & Prizes (0.71)
- Research Report > New Finding (0.48)
Technology: Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.68)
One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers
Ari Morcos, Haonan Yu, Michela Paganini, Yuandong Tian
Neural Information Processing Systems http://nips.cc/
Genre:
- Research Report (0.97)
- Contests & Prizes (0.94)
Technology: Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.69)
Country:
- Africa > Ethiopia > Addis Ababa > Addis Ababa (0.05)
- North America > Canada > British Columbia > Vancouver (0.04)
- North America > United States > Louisiana > Orleans Parish > New Orleans (0.04)
- (12 more...)
Technology:
AnalyzingLotteryTicketHypothesisfrom PAC-BayesianTheoryPerspective
However,sincetheinitial large learning rate generally helps the optimizer to converge to flatter minima, we hypothesize that the winning tickets have relatively sharp minima, which is considered a disadvantage in terms of generalization ability.
Country:
Technology: Information Technology > Artificial Intelligence > Machine Learning > Neural Networks (0.30)
Technology: Information Technology > Artificial Intelligence > Machine Learning > Neural Networks (1.00)
The Elastic Lottery Ticket Hypothesis
Work was done when the author interned at Microsoft.
Genre:
- Contests & Prizes (0.60)
- Research Report > New Finding (0.46)
Technology: Information Technology > Artificial Intelligence > Machine Learning > Neural Networks (1.00)
Country:
- North America > United States > California > Santa Clara County > Palo Alto (0.04)
- North America > United States > California > Los Angeles County > Long Beach (0.04)
- North America > Canada (0.04)
- (2 more...)
Technology: Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.47)
Sanity-CheckingPruningMethods: RandomTicketscanWintheJackpot
However, overparameterization also leads to excessive computational and memory requirements.
Country:
- North America > United States > California (0.04)
- North America > Canada > British Columbia > Metro Vancouver Regional District > Vancouver (0.04)
- Asia > China > Beijing > Beijing (0.04)
Technology: Information Technology > Artificial Intelligence > Machine Learning > Neural Networks (0.96)
