Neural Networks: Frankle's Miracle
Jonathan Frankle and Michael Carbin, of Lottery Ticket fame, and Alex Renda, have made the perfect pruner, shrinking neural networks as much as you please, without sacrificing accuracy. And, the method is dead simple. When you add up the utility gained at the edge, these researchers are worth their weight in Californium. Paul Erdos, one of the greatest and by far the most prolific mathematician of the last century, would fall in love with those proofs and theorems which, by their utter simplicity, elegance, breadth of impact, and insightful technique, must have come from "The Book." By that, Erdos meant that scroll of truths God used to make the world.
Sep-3-2020, 17:15:17 GMT