Sony patent describes visual cues for in-game audio

A Sony Interactive Entertainment patent application published on October 22 describes a system to turn game audio into visual cues. The technology classifies sounds before they play to determine if they represent environmental descriptions, warnings of danger, or tension. It then displays matching visual elements such as icons, shapes, or words like "Roar!". The system ties visual properties like brightness, color, and transparency to the volume and character of the sound.

The patent also includes directional lighting to indicate sound location. This could use LEDs around a display or LEDs encircling the DualSense controller touchpad. Sony suggests the system could support older games by using an operating system or a helper app to tag sound files and generate cues without changing the game code. There is no guarantee this technology will be included in a shipping product.