When facing an Augmented/Mixed Reality project, the integration between the real and virtual objects and environments becomes essential, so the next step in virtual set production and Augmented Reality applications is to increase the realism of the content. This not only involves high quality rendering, but also requires perfect integration between the different elements of the scene to provide a sense of realism, with precise perspective matching and correct broadcast continuity.
All Brainstorm products run on the eStudio render engine, considered the fastest in the industry, and which already includes advanced imaging and rendering features such as real-time ray tracing, HDR (High Dynamic range) and PBR (Physically Based Rendering). Additionally, with its unique Combined Render Engine, Brainstorm supports gaming render engines such as Epic Games’ Unreal Engine.
Real-time ray tracing
InfinitySet takes full advantage of the latest hardware developments found in NVIDIA RTX GPU technology, to deliver the best rendering quality available in the market. By using NVIDIA Quadro RTX GPUs, InfinitySet can deliver real-time ray tracing, which provides a much more accurate rendering, especially with complex light conditions.
Ray tracing is a rendering technique for generating images by tracing the path of light as pixels in an image plane and simulating the effects of its encounters with virtual objects. It can simulate a wide variety of optical effects, such as reflection and refraction, scattering and dispersion. Ray tracing offers more natural, more realistic rendered images, which is essential for photorealistic content generation.
Render with no ray tracing
Render with ray tracing
PBR – Physically Based Rendering
Physically Based Rendering (PBR) is a photorealistic rendering technique firstly developed for gaming purposes, resulting in an approach for materials and rendering that creates more accurate and predictable results and works very well with dynamic lighting conditions.
As it is defined, it applies what is known about the real physical interactions between light and materials to real-time graphics, that is, it follows the physical behaviour of light as close as possible, instead of applying the intuition of “what it should be”. The eStudio render engine fully supports PBR shaders as materials, and can also be imported from external shader editing software. Also, when using PBR materials that support it, the Brainstorm engine can render in HDR (High Diynamic Range).
HDR – High Dynamic Range rendering
HDR Input reflection mapping – 16 bit per channel rendering – P2020 gamma correction output
Post-rendering exposure control – Extended range filtering
Combined Render Engine with Unreal Engine
Along with advanced rendering features such as PBR, Brainstorm also supports gaming and architectural engines like Unreal Engine. These highly complex engines provide realistic scenes with great possibilities, and played along with the eStudio render engine allows InfinitySet not only to show excellently rendered realistic background scenes, but also to integrate graphics elements in the final scene, like 3D motion graphics, lower-thirds, tickers, CG and many other elements.
Brainstorm’s approach to external render engine support is unique in the industry, as it features such deep integration that allows InfinitySet to control, from its own GUI, different parameters of Unreal Engine’s Scenegraph (World Outliner). Unreal Engine’s render buffers are transferred to the InfinitySet engine in real-time, allowing the combined engine to add the chroma keyed talent, the data-driven graphics and other elements. Most importantly, this approach for merging both engines’ render parameters and buffers to make them work as a single render engine, and working in a single machine.
This technology simplifies the setup as the combined render engine can handle all the scene’s requirements, and it does not need additional hardware such as studio mixers. This means that it can be easily integrated into any broadcaster’s existing installation.
Also, InfinitySet’s TrackFree technology allows for using tracked, fixed cameras or a combination of them, with internal or external chroma keyers.
Beyond game engines
What Brainstorm offers goes far beyond what a game engine can do by itself. Broadcast graphics workflows have specific requirements, like database connections, statistics, tickers, social media or lower-thirds, a variety of hardware and software elements that are alien to the game engine framework but essential for broadcast operation.
InfinitySet can effortlessly integrate Aston graphics as Augmented Reality objects within the scene, with a render quality that matches that of the game engines by using the advanced rendering features mentioned. All the above allows for adding advanced audio-visual aids such as in-context typography, motion graphics, statistics, charts and many more, all of them perfectly integrated in the composition both in animation, tracking, perspective matching and of course image quality.