🔍 DeepMind reinvents the mouse pointer

DeepMind created an AI-powered mouse pointer that acts as a context highlighter for an embedded agent. You can point at a table and ask the agent to make a chart or select a restaurant name in a photo to book it for you.

This pointer shifts some cognitive load from the user by removing the need to write detailed prompts. You just click on something and say commands like “tell me about THIS” or “move THIS HERE.”

The system combines speech with gestures, making interaction more natural. It is already available in Gemini in Chrome and Google AI Studio, and will be integrated into upcoming GoogleBook laptops designed for AI experiences.

📊@tech