🤖 AI can now watch a video and write the physics code behind it.
Video models are often called world simulators.
💫 A new paper tests whether they actually understand physics.
🌏 MPMWorlds is a benchmark of 95,000 rendered 2D simulations.
It covers liquids, snow, sand, and elastic bodies.
Models watch 2.5 seconds of a scene. Then they predict what happens next.
The study compares two approaches:
1. A vision model writes simulation code.
2. A diffusion model predicts raw pixels.
Code generation stays physically stable over long horizons.
Objects never vanish or drift mid sequence.
But it cannot read positions from frames alone.
Withhold coordinates and its accuracy collapses.
Diffusion captures short term geometry straight from video.
Over time, objects fade and motion turns implausible.
Feeding it the exact physics config changes nothing.
It relies almost entirely on visual patterns.
A simple gate combining both beat either alone.
👀 What else could hybrid world models unlock?
@PhysicsStation
Post #1400
876
- 🔥 3