Leaked Internal Sony Video Uses Horizon's Aloy to Show AI-Powered PlayStation Character Prototype

A leaked internal video has unveiled that Sony is exploring the use of AI-powered characters for PlayStation games. The Verge reported on a video created by PlayStation Studios' advanced technology group, featuring Aloy from the Horizon series to showcase this innovative technology. The video was quickly removed from YouTube due to a copyright claim by Muso, a company that lists Sony Interactive Entertainment as a client, indicating its authenticity. IGN has sought comment from Sony on this matter.

In the video, Sharwin Raghoebardajal, Sony Interactive Entertainment's director of software engineering, engages in a conversation with an AI-driven Aloy using voice prompts. The AI utilizes OpenAI’s Whisper for speech-to-text, GPT-4 and Llama 3 for dialogue and decision-making, Sony’s Emotional Voice Synthesis (EVS) system for speech, and Sony’s Mockingbird technology for facial animations. During the demo, Aloy responds to inquiries about her wellbeing and her search for her mother, revealing her identity as a clone of Dr. Elizabeth Sobeck and discussing her feelings about it.

However, the AI-generated voice and facial animations of Aloy are noticeably robotic and lack the natural fluidity of human speech and expressions. The demo transitions into the Horizon Forbidden West game world, where Raghoebardajal continues the conversation while playing, highlighting the unusual experience of interacting with a character the player controls.

This prototype, developed with the assistance of Horizon's Guerrilla Games, is intended to demonstrate the potential of AI in gaming internally at Sony. Raghoebardajal emphasizes that this is just a glimpse of what's possible. However, Sony has not confirmed plans to integrate this technology into any consumer-facing PlayStation products, and its feasibility for PS5 games remains uncertain.

Sony's exploration of AI is not surprising, given the industry-wide interest in this technology. Competitors like Microsoft, with their AI tool Muse for game design, are also heavily invested in AI. Generative AI is a trending topic in the gaming and entertainment sectors, despite facing criticism for ethical concerns, rights issues, and the struggle to create content that resonates with audiences. Notable examples include Keywords Studios' failed attempt to develop a game entirely with AI and EA's assertion that AI is central to their business.

Asad Qizilbash, head of PlayStation Productions and head of product at PlayStation Studios, highlighted the importance of AI in meeting the personalization demands of Gen Z and Gen Alpha gamers. He noted that AI could enhance non-player character interactions, making gaming experiences more meaningful and tailored to individual players. Activision's recent use of generative AI for assets in Call of Duty: Black Ops 6, despite backlash, further underscores the industry's ongoing engagement with this technology.

What's The Best PlayStation 5 Game?

Pick a winner

New duel!1ST2ND3RDSee your ResultsFinish playing for your personal results or see the community’s!Continue playingSee results