diffractive deep neural network
Optical multi-task learning using multi-wavelength diffractive deep neural networks
Duan, Zhengyang, Chen, Hang, Lin, Xing
Photonic neural networks are brain-inspired information processing technology using photons instead of electrons to perform artificial intelligence (AI) tasks. However, existing architectures are designed for a single task but fail to multiplex different tasks in parallel within a single monolithic system due to the task competition that deteriorates the model performance. This paper proposes a novel optical multi-task learning system by designing multi-wavelength diffractive deep neural networks (D2NNs) with the joint optimization method. By encoding multi-task inputs into multi-wavelength channels, the system can increase the computing throughput and significantly alle-viate the competition to perform multiple tasks in parallel with high accuracy. We design the two-task and four-task D2NNs with two and four spectral channels, respectively, for classifying different inputs from MNIST, FMNIST, KMNIST, and EMNIST databases. The numerical evaluations demonstrate that, under the same network size, mul-ti-wavelength D2NNs achieve significantly higher classification accuracies for multi-task learning than single-wavelength D2NNs. Furthermore, by increasing the network size, the multi-wavelength D2NNs for simultaneously performing multiple tasks achieve comparable classification accuracies with respect to the individual training of multiple single-wavelength D2NNs to perform tasks separately. Our work paves the way for developing the wave-length-division multiplexing technology to achieve high-throughput neuromorphic photonic computing and more general AI systems to perform multiple tasks in parallel.
An optical diffractive deep neural network with multiple frequency-channels
Diffractive deep neural network (DNNet) is a novel machine learning framework on the modulation of optical transmission. Diffractive network would get predictions at the speed of light. It's pure passive architecture, no additional power consumption. We improved the accuracy of diffractive network with optical waves at different frequency. Each layers have multiple frequency-channels (optical distributions at different frequency). These channels are merged at the output plane to get final output. The experiment in the fasion-MNIST and EMNIST datasets showed multiple frequency-channels would increase the accuracy a lot. We also give detailed analysis to show the difference between DNNet and MLP. The modulation process in DNNet is actually optical activation function. We develop an open source package ONNet. The source codes are available at https://github.com/closest-git/ONNet.
Comment on All-optical machine learning using diffractive deep neural networks
Wei, Haiqing, Huang, Gang, Wei, Xiuqing, Sun, Yanlong, Wang, Hongbin
ARTICLE HISTORY Compiled September 25, 2018 ABSTRACT Lin et al. (Reports, 7 September 2018, p. 1004) reported a remarkable proposal that employs a passive, strictly linear optical setup to perform pattern classifications. But interpreting the multilayer diffractive setup as a deep neural network and advocating it as an all-optical deep learning framework are not well justified and represent a mischaracterization of the system by overlooking its defining characteristics of perfect linearity and strict passivity. Lin et al. [1] proposed a combination of methods for creating a computer-generated volumetric hologram (CGVH) made of multiple planar diffractive elements, and using such hologram to scatter and directionally focus each of a multitude of patternimprinted coherent light fields into a designated spatial region on an image sensor, effectively realizing a functionality of pattern recognition and classification. Their alloptical multi-planed setup bears a certain resemblance to the multi-layered structure of a deep neural network (DNN) [2], but that is about as far as the similarity goes. It is a mischaracterization to interpret the CGVH construct as a DNN, when its functionality is strictly limited to linear transformations of the input light field, thus unable to perform any task of statistical inference/prediction beyond the capacity of a single layer perceptron [2,3].
All-optical machine learning using diffractive deep neural networks
Deep learning has been transforming our ability to execute advanced inference tasks using computers. Here we introduce a physical mechanism to perform machine learning by demonstrating an all-optical diffractive deep neural network (D2NN) architecture that can implement various functions following the deep learningโbased design of passive diffractive layers that work collectively. We created 3D-printed D2NNs that implement classification of images of handwritten digits and fashion products, as well as the function of an imaging lens at a terahertz spectrum. Our all-optical deep learning framework can perform, at the speed of light, various complex functions that computer-based neural networks can execute; will find applications in all-optical image analysis, feature detection, and object classification; and will also enable new camera designs and optical components that perform distinctive tasks using D2NNs.
Best of arXiv.org for AI, Machine Learning, and Deep Learning โ July 2018 - insideBIGDATA
Researchers from all over the world contribute to this repository as a prelude to the peer review process for publication in traditional journals. We hope to save you some time by picking out articles that represent the most promise for the typical data scientist. The articles listed below represent a fraction of all articles appearing on the preprint server. They are listed in no particular order with a link to each paper along with a brief overview. Especially relevant articles are marked with a "thumbs up" icon.
Researchers Use AI, 3D Printing & Bending Light for Numerical Calculations
Today, you will find 3D printers in the most surprising places--and all over the world. Not only that, but they are often busy doing the most surprising things for the human race. If you have been following 3D printing for even the shortest amount of time, then you may have learned to continually expect the unexpected. Machine learning and data calculations are perfect examples of this as they are now being applied in 3D via a new artificial intelligence system that performs its work through bending light. AI is built on looping calculations of numbers and data that ultimately result in recognition.
New Artificial Intelligence Device Identifies Objects at the Speed of Light
The network, composed of a series of polymer layers, works using light that travels through it. Each layer is 8 centimeters square. A team of UCLA electrical and computer engineers has created a physical artificial neural network -- a device modeled on how the human brain works -- that can analyze large volumes of data and identify objects at the actual speed of light. The device was created using a 3D printer at the UCLA Samueli School of Engineering. Numerous devices in everyday life today use computerized cameras to identify objects -- think of automated teller machines that can "read" handwritten dollar amounts when you deposit a check, or internet search engines that can quickly match photos to other similar images in their databases.