Sony Introduces AI-Powered Aloy Character for PlayStation

Sony has recently demonstrated an exciting application of artificial intelligence (AI) by equipping a PlayStation character with the ability to engage in conversation with players. Reportedly, a source shared a video with a demonstration of an AI-enhanced version of Aloy, a character from the popular game Horizon Forbidden West. This video was later removed, but notable publications like Engadget had the opportunity to view it before its deletion.

In the demonstration, Aloy showcased her ability to hold a conversation using voice prompts during gameplay. She responds to player inquiries with a synthesized voice and includes facial movements to enhance the experience. The interaction begins with a slight delay after a player asks how she is, followed by her response: “I’m managing alright, just dealing with a sore throat,” offering a unique twist to the character’s personality. The AI even seems capable of functioning both in a controlled demo setting as well as throughout the actual gameplay of Horizon Forbidden West. When players ask Aloy questions about her surroundings, such as the current time, she replies with vague answers like acknowledging it is afternoon and hot, rather than providing a specific hour.

After gameplay sessions, Aloy transitions back to interview mode where she summarizes recent events, creating a seamless integration of storytelling and interaction.

However, one of the more unsettling moments in the demo arises when Aloy is prompted to bid farewell and express gratitude to the audience. Although she does so, the robotic quality of her voice can create a slightly eerie atmosphere.

To create this AI prototype, Sony has integrated various models, including GPT-4 and Llama 3, to facilitate decision-making and conversations. Additionally, OpenAI’s Whisper technology is utilized for speech-to-text conversions. Sony reportedly mentioned that it is employing its own Emotional Voice Synthesis (EVS) system alongside Mockingbird technology for generating speech and animating audio to facial expressions. Notably, these technologies have not been extensively discussed by the company yet.

It is worth noting that NVIDIA and Microsoft are working on similar AI technologies. NVIDIA, for example, has developed ACE, a suite of tools designed to give life to game characters and allow them to engage in AI-driven conversations. However, some critics, like Engadget's senior editor Devindra Hardawar, have expressed skepticism about the effectiveness of these AI implementations, stating that witnessing multiple NVIDIA ACE demos made him feel uncomfortable.

AI, gaming, Sony