Neural networks are powerful thanks to physics, not math

When you think about how a neural network can beat a Go champion or otherwise accomplish tasks that would be impractical for most computers, it's tempting to attribute the success to math. Surely it's those algorithms that help them solve certain problems so quickly, right? Researchers from Harvard and MIT have determined that the nature of physics gives neural networks their edge. When you write down the laws of physics mathematically, you can describe all of them using functions with basic properties. As such, a neural network doesn't need to understand every possible function (like a conventional computer would) to generate an answer -- it just needs to know some fundamentals.