Investigating full body interactions within public spaces for XR exhibition
Project partners: Teesside University, Ellie Land, Lorent Rezari, Lucy Wheeler (lead artist)
XR Network+ supported a collaboration between Teesside University, Artists Ellie Land and Lucy Wheeler, and immersive technologies developer Lorent Rezari, to investigate interactive and experience design for a real-time immersive installation.
The collaboration formed part of a wider project that is developing an interactive art experience to explore North Shield’s fishing heritage through immersive storytelling.
Researchers and industry partners worked together to develop a prototype performative experience. The team applied digital design techniques, merging digital art and drawn animation to develop interactive creative content including an immersive environment and avatar character for the installation.
Using Teesside University’s facilities, the collaboration explored how game-engine software could be used to interact directly with audiences.
Art direction was provided by Ellie Land and the team worked with shaders to implement this into the game engine.
The team experimented with running Unreal Engine with a specialist depth sensor camera using NUITrack (real-time three-dimensional skeletal tracking software). This setup enabled the partners to sense and track multiple performers and apply their motion-tracked movement to avatars in Unreal Engine.
Using a depth sensor camera to capture real-time input minimised the need for expensive motion capture suits and specialised, complex technology. The outputs were displayed in real-time using a projector, providing another cost-effective and flexible option for the prototype experience.
This arrangement will heighten audience immersion and participation in the experience, something that would not be possible using traditional motion capture techniques because each visitor would need to ‘suit up’ and that would not be practical as part of a public installation.
The project team is seeking funding to further develop the installation ready for public exhibition and in November 2025 will be presenting their work at the Animex International Research Conference, part of the International Festival of Animation, VFX and Games.
This project is one of four initiatives supported by the XR Network+ Prototyping, Impact and Acceleration (PIA) round two funding call. Grants of up to £10,000 were awarded to researchers at UK universities to develop new ideas and complete existing research related to Virtual Production. The projects took place over a six month period, commencing from September 2024.
Categories: Arts, Research, Technology