Home > News > Sony's New AI Patent Predicts Button Presses via Finger-Camera Tech

Sony's New AI Patent Predicts Button Presses via Finger-Camera Tech

Apr 17,25(11 months ago)
Sony's New AI Patent Predicts Button Presses via Finger-Camera Tech

Sony's latest patent filing hints at a groundbreaking approach to reducing latency in future gaming hardware, potentially transforming the PlayStation experience. Titled "TIMED INPUT/ACTION RELEASE" (WO2025010132), this patent outlines a method to predict and streamline user commands, thereby enhancing responsiveness in games.

The introduction of PlayStation Spectral Super Resolution (PSSR) with the PlayStation 5 Pro marked Sony's foray into upscaling technology, capable of enhancing smaller resolutions to 4K. However, the adoption of advanced graphics technologies like frame generation often introduces additional latency, which can detract from the game's responsiveness. This issue is not unique to Sony; GPU manufacturers AMD and Nvidia have introduced Radeon Anti-Lag and Nvidia Reflex, respectively, to address similar concerns.

This new Sony patent could be a game-changer for PlayStation. Image credit: Sony Interactive Entertainment.

First highlighted by Tech4gamers, Sony's new patent proposes a solution involving a machine-learning AI model paired with external sensors, such as a camera focused on the controller, to anticipate a player's next move. Sony's documentation explains that "there can be latency between the user's input action and the system's subsequent processing and execution of the command," leading to delays and unintended game outcomes.

The proposed system integrates multiple components: an AI model to predict upcoming inputs and sensors to detect user actions. The patent suggests using a camera to capture controller movements, stating, "In one particular example, the method may include providing camera input as an input to a machine learning (ML) model. The camera input may indicate the first user command." Additionally, Sony explores the possibility of utilizing the controller's buttons as sensors, leveraging their expertise with analog buttons from previous generations.

While it's uncertain whether this technology will appear in the PlayStation 6 as described, Sony's exploration into latency reduction is clear. This move is particularly timely given the rise of rendering technologies like FSR 3 and DLSS 3, which, while improving visual quality, can increase frame latency.

The potential benefits of this technology are significant, especially for genres like twitch shooters that demand both high framerates and minimal latency. Whether Sony's patent will translate into future hardware remains to be seen, but it underscores the company's commitment to enhancing gaming experiences through innovative technology.

Discover
  • Match Two
    Match Two
    Boost Your Brain with a Memory Challenge! Exercise your mind with the timeless Memory card game! Your objective is simple yet challenging: find and match all identical pairs of cards on the board. About This Matching Game This classic memory challe
  • Little Anime Alchemist: CCG
    Little Anime Alchemist: CCG
    Elements Throwdown - Perfect your deck-building skills and dominate the alchemy battlefield in this strategic TCG card game.Step into Little Anime Alchemist: CCG's enchanting world, where stunning anime visuals meet deep card-battle strategy. Gather
  • King of Solitaire by LKDEV
    King of Solitaire by LKDEV
    Viva a emoção do jogo de SOLITÁIRE GRATUITO nº 1 no Android com King of Solitaire by LKDEV! Se você é fã de jogos clássicos de cartas como Solitaire ou Paciência, este aplicativo é perfeito para você. Desenvolvido pela University of Games Sp. z o.o.
  • Glyph predictor
    Glyph predictor
    Need a reliable tool to anticipate glyph sequences for your favorite game? Meet the Glyph Predictor App! Launch the app and turn on overlay mode, tap refresh, choose your glyph count, and sketch your first glyph using the handwriting input overlay.
  • bug smash game
    bug smash game
    Smash, crush, and squish flying and crawling bugs in this incredibly addictive arcade game!Get Ready for the Ultimate Bug-Smashing Adventure!Join the thrilling world of Bug Smash Game, where tapping, smashing, and blasting through swarms of airborne
  • LIPOGRAM
    LIPOGRAM
    App for the board game Lipogram.In Lipogram, your goal is to get others to guess words against the clock.You can say anything—except words containing a specific forbidden letter. Compete in versus mode with two teams, or work together in co-op to tac