Goto

Collaborating Authors

 special neuron


Adding One Neuron Can Eliminate All Bad Local Minima

Neural Information Processing Systems

One of the main difficulties in analyzing neural networks is the non-convexity of the loss function which may have many bad local minima. In this paper, we study the landscape of neural networks for binary classification tasks. Under mild assumptions, we prove that after adding one special neuron with a skip connection to the output, or one special neuron per layer, every local minimum is a global minimum.


Adding One Neuron Can Eliminate All Bad Local Minima

Neural Information Processing Systems

One of the main difficulties in analyzing neural networks is the non-convexity of the loss function which may have many bad local minima. In this paper, we study the landscape of neural networks for binary classification tasks. Under mild assumptions, we prove that after adding one special neuron with a skip connection to the output, or one special neuron per layer, every local minimum is a global minimum.


Adding One Neuron Can Eliminate All Bad Local Minima

Neural Information Processing Systems

One of the main difficulties in analyzing neural networks is the non-convexity of the loss function which may have many bad local minima. In this paper, we study the landscape of neural networks for binary classification tasks. Under mild assumptions, we prove that after adding one special neuron with a skip connection to the output, or one special neuron per layer, every local minimum is a global minimum.


Locusts could hold the key to collision avoidance tech for robots, drones and self-driving cars

Daily Mail - Science & tech

Drones, robots and self-driving cars could dodge accidents in future thanks to a new sensor inspired by the collision avoidance neurons of swarming locusts. Flying locusts travel in swarms of millions at 2–3 miles an hour -- but are capable of making evasive manoeuvres within just hundreds of milliseconds to avoid collisions. Researchers from the US have developed an electronic version of a special neuron, unique to locusts, that allows them to react rapidly without using much energy. Unlike current collision sensors for self-driving cars -- which tend to be bulky and heavy -- the insect-inspired detector is tiny and can respond in just two seconds. 'We are always looking for animals with unusual abilities, ones that do something better than humans,' said paper author and engineer Saptarshi Das of the Pennsylvania State University.


Fruit flies have special neurons that sense the wind to aid navigation

New Scientist

Specific neurons in fruit flies fire according to wind direction, helping them form a neural map of their surroundings. Algorithms inspired by this may be able to help robots to better navigate their environment. Tatsuo Okubo at Harvard Medical School and his colleagues wanted to determine how wind direction was characterised by a fruit fly's brain. While it is well known that wind direction affects the behaviour of insects, no one had yet developed a map of the neurons involved in this phenomenon for any animal.


Adding One Neuron Can Eliminate All Bad Local Minima

LIANG, SHIYU, Sun, Ruoyu, Lee, Jason D., Srikant, R.

Neural Information Processing Systems

One of the main difficulties in analyzing neural networks is the non-convexity of the loss function which may have many bad local minima. In this paper, we study the landscape of neural networks for binary classification tasks. Under mild assumptions, we prove that after adding one special neuron with a skip connection to the output, or one special neuron per layer, every local minimum is a global minimum. Papers published at the Neural Information Processing Systems Conference.


Drones may soon come with 'spidey-senses' as tiny detectors pick up on vibrations

Daily Mail - Science & tech

Drones and self-driving cars may soon come with'spidey' senses. That's according to engineers in America, who believe the unmanned machines would benefit from sensory detectors similar to those often seen in arachinds. Specifically, they're referring the hairs on a spider's legs, which are linked to special neurons called mechanoreceptors, which flag-up danger through vibrations. If machines had similar characteristics, they'd be able to navigate more effectively in dangerous environments. Until now, sensor technology hasn't always been able to process data fast enough, or as smoothly, as nature.