Apple is working on a new hand gesture recognition system that could soon let users control Macs, iPhones, and Vision devices with simple motions. A recently filed U.S. patent reveals plans to make gesture use more intuitive by combining it with gaze tracking and context awareness.
Also Read: Apple Unveils New Accessibility Features Ahead of Global Awareness Day
The system can detect when a hand is actively gesturing versus when it’s just resting on a keyboard or mouse—preventing accidental actions. It uses a two-phase model to pause gesture actions and cancel them if a peripheral device is used right after.
Apple also plans to use eye-tracking to know where you’re looking, making gesture commands more precise.
