ARQUIMEA develops the technology project “Neural Volumetric Capture”

The objective of the “Neural Volumetric Capture” project is the development of a series of technologies that allow taking the next step in the development of VR (virtual reality) and AR (augmented reality), in addition to providing the audiovisual sector with a new narrative format. To achieve this goal, it will be necessary to develop two systems:

• A VR video capture system using a multi-perspective camera, which will be accompanied by the development of a new VR video format that allows the user not only to change the direction of the camera but also its position, allowing them to move around the scene and create a much more immersive experience.
• A volumetric video capture system, which allows scenes to be scanned in 360º, thus allowing actors, elements, digital doubles, etc. to be included in virtual reality and augmented reality. The goal is to make this system much cheaper than it currently is, reducing the huge number of cameras needed.

The project has developed a new volumetric video capture method as well as a new playback format for this type of content. In addition, a system for capturing objects and people based on a camera rig has been implemented, which allows transferring all kinds of elements to immersive experiences such as virtual reality (VR) or augmented reality (AR).

The project has been carried out between 2020 and 2022 with support of: