Diffractive Deep Neural Network Identifies Objects at Speed of Light – Info Robotic
The device does not need advanced computing programs to process an image of the object and decide what the object is after its optical sensors pick it up. And no energy is consumed to run the device because it only uses diffraction of light.
New technologies based on the device could be used to speed up data-intensive tasks. For example, the researchers say a driverless car using the technology could react instantaneously to a stop sign. According to the engineers, with a device based on the UCLA system, the car would see the sign as soon as the light from the sign hits it, as opposed to having to wait for the car’s camera to image the object and then use its computers to figure out what the object is.
Technology based on the invention could also be used in microscopic imaging and medicine, for example, to sort through millions of cells for signs of disease.
“This work opens up fundamentally new opportunities to use an artificial intelligence-based passive device to instantaneously analyze data, images and classify objects,” said Aydogan Ozcan, the study’s principal investigator and the UCLA Chancellor’s Professor of Electrical and Computer Engineering. “This optical artificial neural network device is intuitively modeled on how the brain processes information. It could be scaled up to enable new camera designs and unique optical components that work passively in medical technologies, robotics, security or any application where image and video data are essential.”
The process of creating the artificial neural network began with a computer-simulated design. Then the researchers used a 3D printer to create very thin, 8-centimeter-square polymer wafers. Each wafer has uneven surfaces, which help diffract light coming from the object in different directions. The layers look opaque to the eye but submillimeter-wavelength terahertz frequencies of light used in the experiments can travel through them. And each layer is composed of tens of thousands of artificial neurons – in this case, tiny pixels that the light travels through.
Together, a series of pixelated layers functions as an “optical network” that shapes how incoming light from the object travels through them. The network identifies an object because the light coming from the object is mostly diffracted toward a single pixel that is assigned to that type of object.
“This is intuitively like a very complex maze of glass and mirrors,” Ozcan said. “The light enters a diffractive network and bounces around the maze until it exits. The system determines what the object is by where most of the light ends up exiting.”
In their experiments, the researchers demonstrated that the device could accurately identify handwritten numbers and items of clothing – both of which are commonly used tests in artificial intelligence studies. To do that, they placed images in front of a terahertz light source and let the device “see” those images through optical diffraction.
They also trained the device to act as a lens that projects the image of an object placed in front of the optical network to the other side of it – much like how a typical camera lens works, but using artificial intelligence instead of physics.
Because its components can be created by a 3D printer, the artificial neural network can be made with larger and additional layers, resulting in a device with hundreds of millions of artificial neurons. Those bigger devices could identify many more objects at the same time or perform more complex data analysis. And the components can be made inexpensively – the device created by the UCLA team could be reproduced for less than $50.
While the study used light in the terahertz frequencies, Ozcan said it would also be possible to create neural networks that use visible, infrared or other frequencies of light. A network could also be made using lithography or other printing techniques, he said.
Editor’s Note: This article was reprinted from UCLA’s Samueli School of Engineering.
Article Prepared by Ollala Corp