Photo credit: venturebeat.com
PlayStation Explores AI Integration in Gaming with New Prototype
Recently, PlayStation and Sony have started to delve into the realm of artificial intelligence, positioning it as a noteworthy enhancement for their users. While Microsoft has prominently showcased its AI initiatives in game development, such as ideation and prototyping, Sony has primarily concentrated its efforts on utilizing AI and machine learning in areas like frame generation and hardware optimization. However, a recently leaked video suggests a potential shift in strategy, hinting at the prospect of AI’s expansion into their renowned software lineup.
A report from The Verge has surfaced, detailing a YouTube video that appears to be part of an internal presentation at Sony. This video has since been removed due to a copyright claim from Muso, a copyright enforcement entity that lists Sony Entertainment among its clients. Within the now-unavailable video, Aloy, the main character from the Horizon series, engages in conversations with players through artificially-generated expressions, writing, and voice responses. The presentation is narrated by Sharwin Raghoebardajal, a director of software engineering at Sony, who specializes in merging gaming technology with AI innovations.
Importantly, Raghoebardajal does not claim that this technology is set for imminent release or integration into existing games. Instead, he notes that it was developed as a prototype in collaboration with Guerilla Games for internal evaluation purposes.
The demonstration utilizes OpenAI’s Whisper for converting speech to text, alongside GPT-4 and Llama 3 for managing conversational interactions. Furthermore, Sony’s proprietary Emotional Voice Synthesis is responsible for generating speech, while Mockingbird technology facilitates facial animations. The Aloy model showcased is based on her appearance from Horizon: Forbidden West. Unlike in the VR title Call of the Mountain, where players conversed with Aloy through another character, this prototype presents a different experience, even though the player in Forbidden West assumes control of Aloy herself.
Aloy’s character is voiced by Ashley Burch, a recognized figure in voice acting known for her role in Mythic Quest and numerous video games. In light of recent developments, including SAG-AFTRA’s ongoing conditional strike regarding AI protections in voice acting, inquiries made to Burch’s publicist have yet to receive a response as of this writing.
Critically, the practical benefits of engaging in continuous dialogue with video game characters remain unclear. Both Horizon titles have garnered acclaim for their storytelling and character development, exploring themes of restoring a world devastated by technological excess. The significant question arises whether the introduction of AI-driven interactions would genuinely enhance the gaming experience for players. It may be that Sony has deeper insights regarding the potential applications of this technology in game design that extend beyond initial appearances.
Source
venturebeat.com