Modern LLMs work well with text, but Spatial intelligence is exactly where it's lack. Its about the ability to perceive, understand and reason about space, objects, movement and the interaction of things.
True intelligence cannot exist without perception-action link which is the foundation base of intelligence in living beings. We can't see AGI until we have truly high-quality world models with this properties:
1. GENERATIVITY : Model must be able to create entire coherent and physically plausible scenes or worlds.
2. MULTIMODALITY
3. INTERACTIVITY : Should not be a passive generator but a model that changes the state of world and can predict consequences if an agent performs some action.
Even problem statement is not solved yet: it should be something like predicting the next token, but for space.
••••••••••••••••••••••••••••••••••••••••••••••••••••
🤖 Data Science, ML & Big Data with @DataXplore