Virtual cameras and physical stages

Project partners: Norwich University of the Arts, Sony Digital Media Production Centre Europe (Pinewood)

A collaboration led by the Norwich University of the Arts is developing a prototype 360-degree virtual camera which will be used in an experimental real-time broadcast scenario working in conjunction with the virtual production studio. 

The adaptive virtual camera will provide a method by which an unusual LED volume would be run as a direct end display from unreal engine in real time, with the geometry of the physical LED structure catered for in the virtual camera.

In most immersive experiences and live context, the use of a media server is the only way to manage significant curvature or 90-degree corners. 

Sony has created a VP Toolset which compliments both VENICE / VENICE2 & The BURANO CINE camera’s creating the way for options that include “offset” or corner shooting in volumes. To date, the immersive world is built of curves, cylinders and increasingly experimental volumes present new challenges for technicians and filmmakers in terms of practicality and cost. Working with the latest developing technology leads to solutions that were previously driven by wall size and scale which bears significant cost. In some cases, this can be managed with the advantage of technologies such as the Sony “offset” or corner shooting tool, thus demanding smaller walls and more cost effective and practical outcomes for film makers. 

The University’s Production Technical Services Team will collaborate with colleagues in the Institute of Creative Technologies and industry partners at Sony to develop a prototype to  enable real-time navigation with direct end display on complex volumes. The collaboration will also explore the creative potential of blending virtual and physical displays in immersive filmmaking, using the prototype to produce a short immersive test film with the University’s  Virtual Production Studio.

As an existing partner to the technician team at Norwich, Sony will bring expertise in technology, innovation and cinema alongside training, support and the loan of resources to the research and development project. 

The project will be based at Havers Road, a Norwich University of the Arts site that hosts the Immersive Visualisation and Simulation Lab and the newly established Virtual Production Studio. 

‘Virtual cameras and physical stages’ is one of eight university-led collaborations awarded up to £25,000 of R&D funding from the XR Network+ XR Labs Fund to develop extended reality prototypes using facilities at UK universities.

 

Categories: Film, Research, Technology, TV