UCLA introduced an optical generative model, uses light and lenses instead of computational units. It means images are created not on chips, but through physics.
🟢 How it works (with experiment)?
1. A lightweight digital encoder turns random noise into a phase pattern.
2. This pattern is loaded onto an optical light modulator.
3. Light passes through a diffractive decoder and the image is formed directly on the sensor.
Real experiments: using visible light and an SLM, they demonstrated generation results:
- Created digits, faces, butterflies, and even paintings in the style of Van Gogh.
- Quality comparable to modern diffusion models.
- There are two versions: instantaneous (one pass) and iterative (several steps, like diffusion).
🟠 Why this approach is interesting?
- The approach requires no computational load.
- Super-fast generation: the physics of light performs what a GPU does with billions of operations.
- It opens the way to energy-efficient AI for edge devices: AR/VR, mobile cameras, compact sensors.
🔴 Limitations:
- Difficult to align optical systems.
- Limitations on phase mask accuracy.
- Dependence on equipment quality (noise, bit depth).
But even with these challenges, this is the first step toward a new class of AI where computation is replaced by pure optics.
#AI #OpticalComputing #Photonics #GenAI
🤖 Data Science, ML & Big Data with @DataXplore