Sony's New AI Patent Predicts Button Presses Using Finger-Camera Tech

Sony has taken a significant step towards enhancing gaming experiences with a new patent that aims to reduce latency in future hardware. The patent, titled "TIMED INPUT/ACTION RELEASE" and filed under WO2025010132, introduces a method that utilizes an AI model alongside additional sensors to predict and streamline user inputs. This innovative approach could revolutionize responsiveness in gaming, particularly in high-stakes genres like twitch shooters where every millisecond counts.

The introduction of PlayStation Spectral Super Resolution (PSSR) with the PlayStation 5 Pro marked Sony's entry into upscaling technology, enabling games to run at 4K resolution. However, newer graphics technologies such as frame generation can introduce additional latency, which may compromise the responsiveness of gameplay. This issue is not unique to Sony; GPU manufacturers AMD and Nvidia have developed Radeon Anti-Lag and Nvidia Reflex, respectively, to address similar concerns.

Sony's patent details a multifaceted solution that includes a machine-learning AI model to anticipate the next user command. This model works in tandem with external sensors, such as a camera focused on the controller, to detect which button the player is about to press. The patent specifically mentions, "In one particular example, the method may include providing camera input as an input to a machine learning (ML) model. The camera input may indicate the first user command." Another intriguing possibility is the use of sensors within the controller buttons themselves, leveraging Sony's history with analog buttons to further refine input detection.

While it's uncertain whether this exact technology will appear in the PlayStation 6, the patent underscores Sony's commitment to reducing latency and enhancing game responsiveness. This is particularly relevant as technologies like FSR 3 and DLSS 3, which can add frame latency, become more prevalent. By focusing on these advancements, Sony aims to ensure that gamers experience both high framerates and minimal latency, crucial for genres that demand split-second reactions.

Image credit: Sony Interactive Entertainment.

First spotted by Tech4gamers, this patent could mark a game-changing development for PlayStation, signaling a future where gaming feels more immediate and seamless than ever before.