VOLUMETRIC AUDIO FROM ZYLIA MAKES THE SHOW
AT THE 153RD AES CONVENTION IN NEW YORK
POZNAN, Poland, NEW YORK, USA — October 13th, 2022
During the upcoming AES Show in New York, Zylia experts will present their exciting research on computational complexity measurements between object-based audio (OBA) and volumetric scene-based audio (VSBA) techniques for 3D audio renderings. Additionally, the visitors to the exhibition will have a chance to experience remarkable VR productions with 3D volumetric audio on Oculus VR goggles. The demos created with ZYLIA 6 Degrees of Freedom Navigable Audio Solution will be available for watching at the Zylia booth.
|
OBA vs VSBA
The primary purpose of Zylia team research was to investigate how each of the 3D audio representations (OBA and VSBA) influences rendering time and target bitrates with respect to their potential to represent multiple sources with realistic room acoustics. Based on thy Zylia findings, it is possible to recommend VSBA rendering techniques and their overall performance advantages for specific use cases and applications. This can be extremely useful, especially for VR creators and video game developers.
“Our research shows many advantages of volumetric scene-based audio over OBA. Rendering complexity independent of the number of objects in the scene (which decreases CPU usage significantly) or personalised interaction with immersive audio are only examples. As we can imagine, this technique can revolutionise the workflow of various content creators and make their immersive productions available for a much wider audience,” – Tomasz Żernicki, CEO of Zylia and co-author of the research paper.
The presentation of the Zylia research paper: 20th of October, 09:40 am
The full program of the conference: https://aesshow.com/aes-show-fall-2022/program/
The primary purpose of Zylia team research was to investigate how each of the 3D audio representations (OBA and VSBA) influences rendering time and target bitrates with respect to their potential to represent multiple sources with realistic room acoustics. Based on thy Zylia findings, it is possible to recommend VSBA rendering techniques and their overall performance advantages for specific use cases and applications. This can be extremely useful, especially for VR creators and video game developers.
“Our research shows many advantages of volumetric scene-based audio over OBA. Rendering complexity independent of the number of objects in the scene (which decreases CPU usage significantly) or personalised interaction with immersive audio are only examples. As we can imagine, this technique can revolutionise the workflow of various content creators and make their immersive productions available for a much wider audience,” – Tomasz Żernicki, CEO of Zylia and co-author of the research paper.
The presentation of the Zylia research paper: 20th of October, 09:40 am
The full program of the conference: https://aesshow.com/aes-show-fall-2022/program/
Zylia’s volumetric audio on Oculus VR goggles
To show the attendees of the AES Show exhibition real-life applications of volumetric audio, Zylia prepared impressive demos on Oculus VR headsets:
Both productions, which will be available for watching at the Zylia booth, have been created using ZYLIA 6 Degrees of Freedom Navigable Audio Solution (ZYLIA 6DoF), which combines hardware and software based on Higher-Order Ambisonics (HOA) technology. This multi-microphone system allows recording the entire, three-dimensional sound space anywhere and in any environment, which can be particularly useful for Metaverse content creators. The key component of the whole solution is the ZYLIA 6DoF HOA Renderer.
To show the attendees of the AES Show exhibition real-life applications of volumetric audio, Zylia prepared impressive demos on Oculus VR headsets:
- Immersive concert of 2022 Grammy Award winner “Jordan Rudess & Friends in 3D Audio” – a multipoint 360° audio-video experience.
- “The Walk Through the Music” – a life-recorded concert of the grand Philharmonic Orchestra implemented into the virtual concert hall, where the listener can move freely across the VR space.
Both productions, which will be available for watching at the Zylia booth, have been created using ZYLIA 6 Degrees of Freedom Navigable Audio Solution (ZYLIA 6DoF), which combines hardware and software based on Higher-Order Ambisonics (HOA) technology. This multi-microphone system allows recording the entire, three-dimensional sound space anywhere and in any environment, which can be particularly useful for Metaverse content creators. The key component of the whole solution is the ZYLIA 6DoF HOA Renderer.
ZYLIA 6DoF HOA Renderer
The Renderer is a Wwise and MaxMSP plugin that allows the processing and rendering of 3D audio content and interpolates the sound field between 3rd-order Ambisonics spheres. These sources can be synthetic or recorded with multiple ZYLIA ZM-1S microphones. With the Renderer plugin, users can playback synchronised Ambisonics files and changed the listener’s position and orientation between multiple Ambisonics spheres. The result: end users will experience natural and immersive navigable 6DoF sound on their mobile and stationary devices; on the other hand, developers will be able to explore and integrate the computational advantages of volumetric interpolation.
The Renderer is a Wwise and MaxMSP plugin that allows the processing and rendering of 3D audio content and interpolates the sound field between 3rd-order Ambisonics spheres. These sources can be synthetic or recorded with multiple ZYLIA ZM-1S microphones. With the Renderer plugin, users can playback synchronised Ambisonics files and changed the listener’s position and orientation between multiple Ambisonics spheres. The result: end users will experience natural and immersive navigable 6DoF sound on their mobile and stationary devices; on the other hand, developers will be able to explore and integrate the computational advantages of volumetric interpolation.
Some applications of the ZYLIA 6DoF solution include:
More information about the plugin. |
Visit Zylia at the AES Show New York 2022:
153rd Audio Engineering Convention
October 19-20, 2022
Jacob Javits Center
Booth: Level 3 – 451
153rd Audio Engineering Convention
October 19-20, 2022
Jacob Javits Center
Booth: Level 3 – 451
About Zylia
Zylia ( https://www.zylia.co ) develops innovative, world-class 3D audio recording technologies and turns them into products that improve the lives of musicians and audio creatives. With a passionate and dedicated team of experts in music production, audio research, software, business and product development, the company crafts and delivers products with the potential to redefine and revolutionize the way 3D sound and musical performances are recorded and produced. Leveraging their personal experience as musicians and tech gurus, along with input from music and audio communities around the world, Zylia’s experts bring musicians agile recording tools that make it easy to be creative in any environment.
Our solutions are used by musicians and sound engineers who work with Sony, Disney, Game of Thrones, Poznań Philharmonic Orchestra, Red Bull, and many others.
We also love to support artists! Zylia is involved in organizing volunteer efforts including Music CovAid by Zylia.
More information is available at www.zylia.co.
Zylia ( https://www.zylia.co ) develops innovative, world-class 3D audio recording technologies and turns them into products that improve the lives of musicians and audio creatives. With a passionate and dedicated team of experts in music production, audio research, software, business and product development, the company crafts and delivers products with the potential to redefine and revolutionize the way 3D sound and musical performances are recorded and produced. Leveraging their personal experience as musicians and tech gurus, along with input from music and audio communities around the world, Zylia’s experts bring musicians agile recording tools that make it easy to be creative in any environment.
Our solutions are used by musicians and sound engineers who work with Sony, Disney, Game of Thrones, Poznań Philharmonic Orchestra, Red Bull, and many others.
We also love to support artists! Zylia is involved in organizing volunteer efforts including Music CovAid by Zylia.
More information is available at www.zylia.co.