Creates photo-realistic new perspectives of a scene with just one photo.
🟢 Why it matters?
Predicts 3D scenes in form of Gaussians in a single pass and resulting 3D scene can be:
- rendered in real time
- obtain high-quality images from close perspectives
- move camera in real metric coordinates
Features:
- metric 3D representation with absolute scale is used
- Real camera movements are supported
- the model works zero-shot, without retraining on new datasets
Model sets a new level of quality on several datasets at once:
- LPIPS metric improved by 25–34%
- DISTS metric improved by 21–43% compared to best previous models
At same time, Generation time has been reduced by thousands of times.
SHARP shows How far 3D reconstruction and view synthesis methods have come and How quickly such technologies are starting to work in real time, not just in lab.
Github, HF, Demos #Apple #LLM #AI #ML
🤖 Data Science, ML & Big Data with @DataXplore