Exploring immersive storytelling for avatars in Realtime gaming: human data capture for AI-driven non-playable character engagement in games

Project partners: University for the Creative Arts (UCA), SKC Games Studio

A new collaboration between the University for the Creative Arts and SKC Games studio is exploring immersive content creation for video games in collaboration with SKC Games Studio. 

Virtual characters in interactive storytelling games interact within a complex environment using different modes of communication, such as speech and gestures. Whilst these virtual characters can be highly realistic, sound and image qualities are often challenged by cross effects and the limitations of real time production requirements. 

The collaboration between UCA and SKC aims to solve this problem by using state-of-the-art AI to develop a system that will produce real-time performance for virtual characters where sound is synchronised with movement to convey emotions. 

The outputs from the project will be used to create real-time virtual characters for a chapter of SKC’s interactive role-playing video game, Project UN – Taradene.

The collaboration brings together SKC games programmers and UCA researchers and students to build links between academia and industry and develop a knowledge-transfer model. UCA students will develop performance capture and games production skills in a real-world setting and SKC programmers will gain access to world-leading research on AI algorithms.

Exploring immersive storytelling for avatars in Realtime gaming is one of five projects supported by the XR Network+ Embedded R&D funding call, with grants of up to £60,000 awarded to researchers at UK universities to explore the transfer of knowledge between academia and industry in areas aligned with Virtual Production. 

Categories: Games, Research, Technology