How Sony’s new system will revolutionize spatial content creation
Sony Corporation has unveiled development plan of a new system for creating immersive spatial content, which consists of an extended reality (XR) headset with high-quality 4K OLED microdisplays and video see-through capability, and a pair of controllers that enable easy interaction with 3D objects and accurate pointing.
To be released later in 2024, the system works with the latest spatial reality displays that offer realistic 3D content without requiring special glasses or virtual reality (VR) headsets, for creating and reviewing spatial content. Sony hopes to enhance the creative potential of spatial content creators by allowing them to bridge the gap between the physical and virtual worlds with more immersive experiences.
The system is designed to help creators produce sophisticated 3D content. Sony intends to work with developers of various 3D production software, in both the entertainment and industrial design sectors.
The system has video see-through functionality and spatial recognition, with six cameras and sensors in total. It also has a ring controller that lets users manipulate objects in virtual space, and a controller that allows precise pointing. Users can create in virtual space with controllers and keyboards, while wearing the headset.
Sony claims that users can not only view real-scale 3D models in an XR environment with the high-definition display, but also create and modify them. The system also supports remote, real-time review between locations, by integrating with third-party 3D creation applications. The system is an immersive tool for the whole spatial content creation process.
Sony has also launched technologies that improve the workflow and quality of spatial content creation and enable the use of 3D computer graphics in various creative fields. Sony’s mobile motion capture system “mocopi”, which has small and lightweight sensors and a smartphone app, allows full-body motion tracking using Sony’s own technologies.
The device uses the Snapdragon XR2+ Gen 2 Platform processor by Qualcomm Technologies. The platform is said to enable a new generation of mixed reality (MR), by combining premium MR and VR technology in a single chip architecture for thinner and more comfortable headsets.
Qualcomm says the platform can “unleash” a new level of realistic, detailed experiences in MR and VR, with 4.3K spatial computing at 90 frames per second. It also has higher GPU frequency by 15% and CPU frequency by 20%. The platform supports 12 or more concurrent cameras with on-device artificial intelligence (AI), allowing Snapdragon XR2+ Gen 2-powered devices to track the user, their movements and the world around them for navigation and experiences that blend physical and digital spaces.
Sony is partnering exclusively with industrial technology leader Siemens to launch a solution for immersive design and collaborative product engineering using software from the Siemens Xcelerator open digital business platform. The system will be available later in 2024.
“Siemens and Sony are working together to enable immersive engineering, a vital component for the industrial metaverse. We are creating an environment where users can experience the realities of physics, without the limitations of time, to significantly improve how our customers work and collaborate,” said Cedrik Neike, member of the managing board of Siemens AG and CEO of Siemens Digital Industries.
About The Author
