visionOS 27 opens Vision Pro to tracked physical objects and accessories

The new visionOS 27 release expands one of the most important APIs for spatial developers: spatial accessories - previously limited to first-party devices like the Logitech Muse and PS VR2 Sense controllers - can now be built from scratch by third-party manufacturers.

The recipe is simple: a constellation of LEDs plus an IMU (inertial measurement unit) plus a Bluetooth chip inside the device, and Vision Pro tracks it as a full 6DoF object.

Separately, Apple upgraded regular object tracking (for objects with no embedded electronics - just a 3D scan): it now supports tracking moving and handheld items at high frame rate, not just stationary ones.

Apple is also shipping reference hardware from DFRobot and MikroE - ready to use directly in apps, no need to build your own electronics from scratch.

For AR industry an important shift. Digital experiences can now be tied much more tightly to real physical objects - a tool, a controller, a prototype, a toy, a museum exhibit, a piece of equipment.