Leaked Internal Sony Video Uses Horizon's Aloy to Show AI-Powered PlayStation Character Prototype

A leaked internal video reveals Sony's exploration of AI-powered PlayStation characters. The Verge reported on a PlayStation Studios' advanced technology group video showcasing AI-powered Aloy from the *Horizon* games. The video, subsequently removed from YouTube due to a copyright claim from Muso (a company listing Sony Interactive Entertainment as a client), seemingly confirms its authenticity. IGN has reached out to Sony for comment.

The video, as detailed by The Verge, features Sony Interactive Entertainment's director of software engineering, Sharwin Raghoebardajal, conversing with an AI-powered Aloy. This conversation utilizes OpenAI's Whisper for speech-to-text, GPT-4 and Llama 3 for dialogue and decision-making, Sony's Emotional Voice Synthesis (EVS) for speech, and Sony's Mockingbird technology for facial animation.

The AI Aloy's voice differs from voice actor Ashly Burch's, employing a robotic text-to-speech quality. Her facial animations are stiff and her eyes appear lifeless. In the demo, Raghoebardajal asks Aloy about her well-being and her search for her mother. Aloy's responses, generated by the AI, reflect plot points from the *Horizon* games, such as her discovery of being a clone of Dr. Elizabeth Sobeck.

The demo seamlessly transitions into the *Horizon Forbidden West* game world, continuing the conversation within the game environment. This juxtaposition of player interaction with a controlled AI character is noteworthy, especially considering the thematic irony given the *Horizon* storyline. The demo, a prototype developed with Guerrilla Games, serves as an internal demonstration of Sony's AI capabilities. While showcasing Sony's investment in AI-powered characters, the company hasn't confirmed plans for public implementation.

Sony's exploration isn't surprising, given the industry-wide interest in AI. Microsoft's commitment to AI, including their recently announced Muse AI for game design, exemplifies this trend. Generative AI, while generating excitement, also faces criticism regarding ethical concerns, rights issues, and the challenge of creating consistently enjoyable content. Keywords Studios' failed experiment with an entirely AI-generated game highlights these challenges. Despite this, EA has declared AI "the very core" of its business, and Capcom is experimenting with generative AI for environmental design. Asad Qizilbash, Head of PlayStation Productions and Head of Product at PlayStation Studios, emphasizes the importance of AI for personalization, particularly appealing to Gen Z and Gen Alpha gamers.

Activision's recent admission of using generative AI for some *Call of Duty: Black Ops 6* assets, following criticism of an AI-generated loading screen, further illustrates the complex relationship between AI and game development.

### What's The Best PlayStation 5 Game?

### Pick a winner