As LED-based XR is becoming increasingly used, Brainstorm has developed new features that allow for easier, faster and more integrated creation of immersive XR content specifically designed to be displayed on large LED videowalls. With these features, Brainstorm’s clients will see their XR content creation significantly accelerated when creating in-context AR in LED walls, XR Set extensions, or even backgrounds for film and drama production. Suite 5 has a dedicated interface for creating XR installations, which allows for modelling any kind of video wall, including curved, shaped and corner installations, and map the desired 3D content in such model. This facilitates the creation of virtual AR content to be directly displayed and seen by the camera with the correct perspective at all times. Also, by taking advantage of the Layers and Stacking features of InfinitySet, different renders, even with different resolutions and aspect ratios, can be mapped in a canvas of any size and aspect.

In addition, the unique integration of InfinitySet and eStudio with Unreal Engine is now even tighter, allowing for the inclusion of fully editable Brainstorm scenes and templates within an Unreal project, and vice-versa. This is especially useful when creating AR projects within Unreal, which benefit from Brainstorm’s advanced data-driven graphics and broadcast workflows compatibility. This is coupled with the acclaimed UnrealControl feature which supports editing the Unreal Projects directly within InfinitySet’s familiar interface with total ease and control of blueprints, objects and parameters. Suite 5 also features a new, redesigned internal chroma keyer that includes a new mode that embeds the Unreal Engine chroma keyer directly into InfinitySet. Brainstorm Suite 5 is fully compatible with Unreal Engine 4.27 and will be with UE 5.

“Brainstorm has been deeply involved with Augmented Reality and Virtual Production for decades now, and Suite 5 is the result of applying our expertise to the new display methods that broadcasters and filmmakers are introducing into their workflows” says Hector Viguer, Brainstorm’s COO and Engineering Director. “The advanced features of Suite 5 will allow any user to comply with any kind of VR/AR/XR requirement, regardless of how complex it is, and leaving them free to choose the production workflow they feel is best for their production, whether LED walls or chroma keying. We want to be agnostic so we can provide a solution for any requirement.”

Some other features are included, like improved HDR workflows, and better integration with robotic heads from manufacturers such as Panasonic or Sony. Also, Edison, the company’s virtual studio in a box product designed for live events and presentations, will also benefit from some of the above plus its own features as a result of its upgrade to V5.

Brainstorm Suite 5 will be available on March 1st, and will also be demonstrated at NAB 2022 at the Brainstorm booth N2608.

This workflow is the result of the collaboration of Brainstorm and Panasonic in developing the PTZF (Pan, Tilt, Zoom and Focus) tracking data for the AW-UE150W/K camera. Panasonic took advantage of Brainstorm’s extensive experience of more than 25 years in the development of real-time 3D graphics, virtual set and augmented reality solutions to develop a product that allows for creating a comprehensible workflow that brings advanced AR to companies of any size and budget.

According to Héctor Viguer, CTO and COO of Brainstorm, “Our collaboration with Panasonic has been highly successful, demonstrating once again InfinitySet’s openness and ability to interface with any industry-standard protocol. Our presence at the Virtual Reality area at IBC shows how the combination of Panasonic’s AW-UE150 and Brainstorm’s InfinitySet can effortlessly provide amazing AR content that allows broadcasters to significantly enhance their storytelling”.

In combination with InfinitySet, the AW-UE150 is a powerful solution for enhancing storytelling and providing in-context data-driven graphics with ease and full accuracy. At the IBC demonstration, this AR workflow will include automatic tracking of the live performers using Blacktrax tracking beacons to include additional real-time graphics following the artists, further demonstrating the possibilities of AR workflows with additional external tracking data.

Jaume Miró, European Sales Engineer at Panasonic Broadcast & ProAV, said: “Integrating our high end 4K PTZ camera with Virtual and Augmented Reality applications has been a long-term request from our customers. Brainstorm has supported us greatly throughout the development process. Using the UE150 camera with Brainstorm’s InfinitySet is yet another demonstration of our commitment to make the Panasonic PTZ camera range the most effective and easy to integrate on the market.”

The demo will show how the new Panasonic AW-UE150W/K can be seamlessly integrated in a 4K virtual studio and augmented reality workflow in conjunction with InfinitySet, Brainstorm’s acclaimed virtual set and AR solution. Such setup will demonstrate how InfinitySet can create advanced virtual set and augmented reality content using direct tracking data generated by the Panasonic AW-UE150W/K camera, which allows broadcasters of any size to create simple yet powerful AR workflows for any type of content. In combination with Brainstorm’s InfinitySet, Panasonic’s AW-UE150W/K is a powerful bundle for enhancing storytelling and providing in-context data-driven graphics with total ease and full accuracy.

Also, Brainstorm will be part of the Smart Studio Corner at the Panasonic booth. Smart Studio Corner will feature next-generation studio subsystems that realize higher efficiency and labor-saving features. These include automatic tracking of performers using 8K ROI + BlackTrax position information detection system; presentation of augmented reality (AR) using AW-UE150W/K + Tecnopoint S.r.l’s robotics and Brainstorm’s InfinitySet virtual set and augmented reality solution; and the construction of IP network studio using Live Production Suite (LPS), an MoIP system, which Panasonic proposes.

According to Héctor Viguer, Brainstorm’s CTO, “we are very pleased of partnering with Panasonic at NAB 2019, and demonstrate how the combination of Panasonic’s AW-UE150W/K and Brainstorm’s InfinitySet can effortlessly provide amazing AR content that allows broadcasters to significantly enhance their shows.”