Zylia’s 3D Audio technology contributes
to NYU’s Music and Audio Research Lab project
POZNAN, Poland, NEW YORK, USA — October 26th, 2022
|
The Music and Audio Research Lab at New York University and Zylia, a leader in developing innovative, world-class 3D audio recording solutions, joined forces in a new collaboration exploring how computers can extract spatial information about the environment out of sound. Such information, captured by Zylia’s Higher-Order Ambisonics microphones, can be very useful in areas such as media production, urban monitoring, or security.
|
If a person stands on a city sidewalk with their eyes closed and listens, they will hear the sounds of events happening around them: birds chirping, squirrels scurrying, people talking, doors opening, an ambulance speeding, a truck idling. In addition, they will also likely be able to perceive the location of each sound source, where it’s going, and how fast it’s moving. This rich information about the surrounding environment, if extracted by computers, could deliver a valuable description of the world.
"We are very excited to pursue this collaboration with Zylia. There is great potential in the combination of Zylia's cutting edge technologies for spatial audio capture and the AI-driven solutions for acoustic scene understanding that we are developing as part of the S3D project," said Juan Pablo Bello, professor of Music Technology, Computer Science & Engineering and director of the Music and Audio Research Lab (MARL).
"We are delighted to be collaborating with Zylia on the S3D project. Together, we are significantly advancing the research in building computational models for spatial sound scene analysis and description," added Agnieszka Roginska, music professor of Music Technology.
The Spatial Sound Scene Description (S3D) project is funded by a grant from the National Science Foundation (1955357) and has many real-world applications. For instance, hearing-impaired individuals could use them in their daily life to avoid dangerous situations in outdoor or domestic environments. Ecologists could use them to monitor and study wildlife more accurately. City agencies could better quantify traffic, construction, and other urban activities. What is important in all these use-cases, is that sound can include information about events that are not easily visible, such as sources that are small (e.g., insects), far away (e.g., a distant jackhammer), or simply hidden behind another object (e.g., an incoming ambulance around a building’s corner).
"We are very excited to pursue this collaboration with Zylia. There is great potential in the combination of Zylia's cutting edge technologies for spatial audio capture and the AI-driven solutions for acoustic scene understanding that we are developing as part of the S3D project," said Juan Pablo Bello, professor of Music Technology, Computer Science & Engineering and director of the Music and Audio Research Lab (MARL).
"We are delighted to be collaborating with Zylia on the S3D project. Together, we are significantly advancing the research in building computational models for spatial sound scene analysis and description," added Agnieszka Roginska, music professor of Music Technology.
The Spatial Sound Scene Description (S3D) project is funded by a grant from the National Science Foundation (1955357) and has many real-world applications. For instance, hearing-impaired individuals could use them in their daily life to avoid dangerous situations in outdoor or domestic environments. Ecologists could use them to monitor and study wildlife more accurately. City agencies could better quantify traffic, construction, and other urban activities. What is important in all these use-cases, is that sound can include information about events that are not easily visible, such as sources that are small (e.g., insects), far away (e.g., a distant jackhammer), or simply hidden behind another object (e.g., an incoming ambulance around a building’s corner).
|
“We believe that 3D audio is a very important element in experiencing the ever-evolving modern world. Scientists start to notice, that also in a field of various research can highly benefit from the information contained in a sound, especially now, when the technology for capturing high-quality 3D Audio is easily available,” said Tomasz Żernicki, CEO of Zylia.
|
|
Zylia specializes in developing technologies for recording and post-processing 3D Audio. The flagship of the brand is ZYLIA 6 Degrees of Freedom Navigable Audio solution. The multi-microphone arrays system captures the entire 3D soundscape, including the acoustics and ambient sounds of the recording environment, and allows to uses it in various immersive projects. For instance, the implementation of Zylia’s spatial audio inside virtual reality gives the viewer complete freedom to explore the audio-video content. Like in real life, he or she can choose their path within the 3D space and hear how the intensity, direction, height, and even timbre of each sound shifts with their movement.
|
The technology of Zylia is used by the best audio laboratories around the world.
More information about the project Spatial Sound Scene Description:
https://steinhardt.nyu.edu/marl/research/projects/s3d-spatial-sound-scene-description
More information about the ZYLIA 6 Degrees Of Freedom Navigable Audio solution:
https://www.zylia.co/zylia-6dof.htm
More information about the project Spatial Sound Scene Description:
https://steinhardt.nyu.edu/marl/research/projects/s3d-spatial-sound-scene-description
More information about the ZYLIA 6 Degrees Of Freedom Navigable Audio solution:
https://www.zylia.co/zylia-6dof.htm
About NYU’s Music and Audio Research Lab
NYU’s Music and Audio Research Lab is an interdisciplinary center at the intersection of science, technology, music and sound, with research connecting a wide range of fields from computing and artificial intelligence, immersive experiences and algorithmic composition, to the latest advances in neuroimaging of the human brain. Our work focuses on (a) understanding and modeling the human cognitive and neural mechanism supporting music and sound processing, (b) innovating the analysis, organization and retrieval of acoustic data, and (c) advancing applications of high societal value in health, accessibility, creativity, and education.
About Zylia
Zylia ( https://www.zylia.co ) develops innovative, world-class 3D audio recording technologies and turns them into products that improve the lives of musicians and audio creatives. With a passionate and dedicated team of experts in music production, audio research, software, business and product development, the company crafts and delivers products with the potential to redefine and revolutionize the way 3D sound and musical performances are recorded and produced. Leveraging their personal experience as musicians and tech gurus, along with input from music and audio communities around the world, Zylia’s experts bring musicians agile recording tools that make it easy to be creative in any environment.
Our solutions are used by musicians and sound engineers who work with Sony, Disney, Game of Thrones, Poznań Philharmonic Orchestra, Red Bull, and many others.
We also love to support artists! Zylia is involved in organizing volunteer efforts including Music CovAid by Zylia.
More information is available at www.zylia.co.
NYU’s Music and Audio Research Lab is an interdisciplinary center at the intersection of science, technology, music and sound, with research connecting a wide range of fields from computing and artificial intelligence, immersive experiences and algorithmic composition, to the latest advances in neuroimaging of the human brain. Our work focuses on (a) understanding and modeling the human cognitive and neural mechanism supporting music and sound processing, (b) innovating the analysis, organization and retrieval of acoustic data, and (c) advancing applications of high societal value in health, accessibility, creativity, and education.
About Zylia
Zylia ( https://www.zylia.co ) develops innovative, world-class 3D audio recording technologies and turns them into products that improve the lives of musicians and audio creatives. With a passionate and dedicated team of experts in music production, audio research, software, business and product development, the company crafts and delivers products with the potential to redefine and revolutionize the way 3D sound and musical performances are recorded and produced. Leveraging their personal experience as musicians and tech gurus, along with input from music and audio communities around the world, Zylia’s experts bring musicians agile recording tools that make it easy to be creative in any environment.
Our solutions are used by musicians and sound engineers who work with Sony, Disney, Game of Thrones, Poznań Philharmonic Orchestra, Red Bull, and many others.
We also love to support artists! Zylia is involved in organizing volunteer efforts including Music CovAid by Zylia.
More information is available at www.zylia.co.
