RAVEN-SCAR: Adaptive Robotics for XR Lighting Effects

Project partners: University of York, Cardiff University

XR Network+ is supporting a collaboration led by the University of York to develop a modular, ceiling-mounted robotic system that delivers dynamic, director-driven lighting and physical effects for LED and extended-reality (XR) virtual production stages. 

Led by Steven Xiaotian Dai in collaboration with Dr Seyed Amir Tafrishi from Cardiff University, the collaboration forms part of the ongoing RAVEN (Real-time Adaptive Virtual-Twin Environment for Next-Generation Robotics in Virtual Production) project.

The RAVEN-SCAR (Studio-Centric Autonomous Robot) project aims to extend real-time adaptive robotics into overhead operations to enable unified planning and playback of camera motion, lighting, and effects for next generation virtual production pipelines.

Each SCAR node, which is part of a collaborative robotic system, can carry quick-swap tools such as an LED light bar, spot light, soft boxes, or fans. Multiple nodes can cooperate as a cable-driven parallel robot, precisely positioning shared payloads with centimetre-level accuracy. 

SCAR integrates seamlessly with Unreal Engine 5 (UE5) for digital-twin synchronisation and the Robot Operating System 2 (ROS2) for real-time control. Using latency-aware planning, the system ensures cues align with camera and LED timing. 

Safety is a core focus, with predictive speed-and-separation monitoring (SSM), fail-safe load holding, and redundant anchoring to enable safe operation above cast and crew. 

By reducing the time, risk, and manual labour associated with traditional rigging, SCAR empowers virtual production teams to re-aim lights or trigger effects on the fly, enhancing creative flexibility and operational efficiency. 

The project team will utilise the Systems-at-Scale (SAS) Lab within the Real-Time and Distributed Systems (RTDS) Group at the University of York to develop and test the multi-robot system at the core of RAVEN-SCAR. The XR Stories immersive research and development (R&D) lab will enable the team to test the prototype in a production-realistic environment. 

The project is one of twelve collaborations that received R&D funding from XR Network+ through the XR Labs Fund. The funding call awarded grants of up to £25,000 for university-led collaborations to develop extended reality prototypes using facilities at UK universities.

Categories: Research, Robotics, Technology