ZYLIA - 3D AUDIO RECORDING & POST-PROCESSING
  • Solutions
    • Live rehearsal recording
    • 360 VR recording
    • Field recording
    • Audio recording for Dolby Atmos
    • Navigable Audio for VR
    • 3D audio streaming
    • Loudspeakers calibration & localization
  • Use cases
    • Music recording with Zylia
    • Immersive 360 audio
    • ZYLIA ZM-1 and Dante
    • 3D audio podcasts
    • Virtual stage with volumetric audio
    • Rendering sound for games
    • Multi-point 360 audio and video
    • Multi-point HOA music and soundscape recordings
  • Products
    • ZYLIA PRO
    • ZYLIA 6DOF
    • Software >
      • Applications >
        • ZYLIA Studio
        • ZYLIA Ambisonics Converter
        • ZYLIA Streaming Application
        • ZYLIA 6DoF Recording Application
      • Plugins >
        • ZYLIA Studio PRO
        • ZYLIA Ambisonics Converter Plugin
        • ZYLIA 6DoF HOA renderer
    • Hardware >
      • ZYLIA ZM-1 microphone
      • ZYLIA ZM-1S microphone
      • ZYLIA ZR-1 Portable Recorder
    • Technology Licensing
  • Support
    • Get Started
    • Register
    • Downloads
    • Tutorials
    • Help Center
    • Contact support
    • Demo
    • Testimonials
    • Referral
    • Ambassadors
  • Blog
  • Company
    • About
    • R&D
    • Jobs
    • Press
    • Distributors
    • Contact
  • Shop

The first release of ZYLIA Ambisonics Converter Plugin

10/24/2018

2 Comments

 

​Zylia announces the first release of ZYLIA Ambisonics Converter plugin.

ZYLIA Ambisonics Converter Plugin is a VST/AU plugin which enables conversion to Ambisonics directly within a Digital Audio Workstation (DAW). Thanks to ZYLIA Ambisonics Converter Plugin the whole recording system becomes even more powerful enabling new features for 3D audio production and surround sound recording.
ZYLIA Ambisonics Converter Plugin transforms a single 19 channel ZM-1 [http://www.zylia.co/zylia-zm-1- microphone.html] recording into Higher Order Ambisonics file that is compatible with top class tools for VR and 360 video production. It enables you to prepare 3D audio recordings for playback on the ‘Facebook 360’ and ‘Youtube 360’ platforms.​
Picture
Picture
​Main features:
​
•    B-format conversion (1st, 2nd and 3rd order of HOA)
•    FuMa or ACN channel ordering & SN3D or N3D normalization
•    ambiX and TBE formats
•    Support for YouTube360 and Facebook360
•    Correction of microphone position in the post-production stage
•    Available as VST, VST3 and AU plugins
•    macOS and Windows versions
•    Compatible with DAW that supports at least 19 channels per track
Picture
Available in ZYLIA PRO Set.
2 Comments

The power of audio in 6 Degrees-of-Freedom (6dof)

10/16/2018

0 Comments

 

Recordings made with 6DOF Development Kit by Zylia

​What would happen if on a rainy and cloudy day, during a walk along a forest path, you could move into a completely different place thousands of kilometers away from you? Putting the goggles on would get you into a virtual reality world, you would find yourself on a sunny island in the Pacific Ocean, you would be on the beach, admiring the scenery and walking among the palm trees listening to the sound of waves and colorful parrots screeching over your head.
​
It sounds unrealistic, but such goals are determined by the latest trends in the development of Augmented / Virtual Reality technology (AR / VR). Technology and content for full VR or 6DoF (6 Degrees-of-Freedom) rendered in real time will give the user the opportunity to interact and navigate through virtual worlds. To experience the feeling of "full immersion" in the virtual world, realistic sound must also follow a high-level image. Therefore, only each individual sound source present in virtual audio landscape provided to the user as a single object signal can reliably reflect both the environment and the way the user interacts with it.

What are Six Degrees of Freedom (6DOF)

"Six degrees of freedom" is a specific parameter count for the number of degrees of freedom an object has in three-dimensional space, such as the real world. It means that there are six parameters or ways that the object can move.

Six degrees of freedom consists of the following movement parameters:
  • Translation – Moving along the different axes X, Y and Z
    • Moving up and down along the Y axis is called heaving.
    • Moving forwards and backwards along the X axis is called surging.
    • Moving left and right along the Z axis is called swaying.
  • Rotation – Turning in order to face a different axis
    • Moving between X and Y is called pitch.
    • Moving between X and Z is called yaw.
    • Moving between Z and Y is called roll.
Picture
​Fig. Six degrees of freedom (Wikipedia Commons).
* Source – techopedia.
There are many possibilities of using a 6DoF VR technology. You can imagine exploring a movie plan in your own pace. You could stroll between the actors, look at the action from different sides, listen to any conversations and paying attention to what is interesting only for you. Such technology would provide really unique experiences.

​A wide spectrum of virtual reality applications drives the development of technology in the audio-visual industry. Until now, image-related technologies have been developing much faster, leaving the sound far behind. We have made the first attempts to show that 6DoF for sound is also achievable.

Read more about 6DOF Development Kit


How to record audio in 6DoF?

​It's extremely challenging to record high-quality sound from many sources present in the sound scene at the same time. We managed to do this using nine ZYLIA ZM-1 multi-track microphone arrays evenly spaced in the room.
Picture
In our experiment the sound field was captured using two different spatial arrangements of ZYLIA ZM-1 microphones placed within and around the recorded sound scenes. In the first arrangement, nine ZYLIA ZM-1 microphones were placed on a rectangular grid. Second configuration consisted of seven microphones placed on a grid composed of equilateral triangles.
Picture
Picture
Fig. ​Setup of 9 and 7 ZYLIA ZM-1 microphone arrays
​Microphone signals were captured using a personal computer running GNU/Linux operating system. Signals originating from individual ZM-1 arrays were recorded with the specially designed software. 
​We recorded a few takes of musical performance with instruments such as an Irish bouzouki (stringed instrument similar to the mandolin), a tabla (Indian drums), acoustic guitars and a cajon.
Picture
Fig. Three ZYLIA ZM-1 mics in a line. ZYLIA ZM-1 with synchronization mechanism attached
Picture
Fig. Recorded musicians – from left – Przemyslaw Sledziuha Sledz, Michal Obrebski and Kasia Mizerny

Unity and 3D audio

To present interesting possibilities of using audio recorded with multiple microphone arrays we have created a Unity project with 7 Ambisonics sources. In this simulated environment, you will find three sound sources (our musicians) represented by bonfires among whom you can move around. Experiencing fluent immersive audio becomes so natural that you can actually feel being inside of this scene.

MPEG Standardization Committee
​

​During exploration experiments, MPEG Standardization Committee has realized that there is a lack of test material for audio and video experiments into MPEG-I Immersive Video. Our recordings have been accepted as a reference material in MPEG Standardization Committee. Each of the experts involved in standardization works on MPEG-I can now use the Zylia recordings to develop and test audio technologies for VR/AR applications. 
​Our informal listening tests prove that it is possible to achieve satisfactory 6DoF effect (with restricted position of listening) by probing space using 3rd order Ambisonics microphones like ZYLIA ZM-1. We are getting closer to make the real VR more real😊
Picture
6DOF Development Kit by Zylia
0 Comments
    Picture

    Categories

    All
    360 Recording
    6DOF
    Ambisonics
    Good Reading
    How To Posts
    Impulse Response
    Interviews
    Live Stream
    Product Review
    Recording
    Software Releases
    Tutorials

    Archives

    February 2023
    November 2022
    October 2022
    July 2022
    June 2022
    May 2022
    February 2022
    January 2022
    August 2021
    July 2021
    May 2021
    April 2021
    March 2021
    January 2021
    December 2020
    November 2020
    October 2020
    September 2020
    August 2020
    July 2020
    June 2020
    April 2020
    March 2020
    February 2020
    January 2020
    December 2019
    November 2019
    October 2019
    September 2019
    August 2019
    July 2019
    June 2019
    May 2019
    April 2019
    March 2019
    January 2019
    December 2018
    October 2018
    September 2018
    June 2018
    May 2018
    April 2018
    March 2018
    February 2018
    January 2018
    December 2017
    October 2017
    September 2017
    August 2017
    July 2017
    June 2017
    May 2017
    March 2017
    February 2017
    January 2017
    December 2016
    November 2016
    October 2016

    RSS Feed

    Authors

    Zylia Team

Picture
Picture

Company

About
R&D
News
Jobs
Press
​Contact

Products

ZYLIA ZM-1 microphone array
ZYLIA ZM-1S microphone array
ZYLIA ZR-1 portable recorder
ZYLIA Studio
ZYLIA Studio PRO plugin
ZYLIA Ambisonics Converter
ZYLIA Ambisonics Converter plugin
ZYLIA Streaming Application
ZYLIA 6DoF Navigable Audio

Shop

​Distributors

Downloads

Support

Blog

Community

Get ZYLIA products:
Picture
Picture
Picture
Picture
Picture
Picture
Picture

Connect with us

Subscribe to ZYLIA Newsletter

I acknowledge that by clicking „Subscribe” I give my permission to receive Zylia Newsletter about Zylia’s products and promotions. By submitting the form I agree with Zylia’s Privacy Policy. ​You can unsubscribe at any time using the link provided in a Newsletter.
Our brands:
Picture
Picture
Our engagement:
Picture
Picture
Terms & Conditions   |   Privacy Policy   |   Contact
© Zylia Sp. z o.o., copyright 2018. ALL RIGHTS RESERVED. 
  • Solutions
    • Live rehearsal recording
    • 360 VR recording
    • Field recording
    • Audio recording for Dolby Atmos
    • Navigable Audio for VR
    • 3D audio streaming
    • Loudspeakers calibration & localization
  • Use cases
    • Music recording with Zylia
    • Immersive 360 audio
    • ZYLIA ZM-1 and Dante
    • 3D audio podcasts
    • Virtual stage with volumetric audio
    • Rendering sound for games
    • Multi-point 360 audio and video
    • Multi-point HOA music and soundscape recordings
  • Products
    • ZYLIA PRO
    • ZYLIA 6DOF
    • Software >
      • Applications >
        • ZYLIA Studio
        • ZYLIA Ambisonics Converter
        • ZYLIA Streaming Application
        • ZYLIA 6DoF Recording Application
      • Plugins >
        • ZYLIA Studio PRO
        • ZYLIA Ambisonics Converter Plugin
        • ZYLIA 6DoF HOA renderer
    • Hardware >
      • ZYLIA ZM-1 microphone
      • ZYLIA ZM-1S microphone
      • ZYLIA ZR-1 Portable Recorder
    • Technology Licensing
  • Support
    • Get Started
    • Register
    • Downloads
    • Tutorials
    • Help Center
    • Contact support
    • Demo
    • Testimonials
    • Referral
    • Ambassadors
  • Blog
  • Company
    • About
    • R&D
    • Jobs
    • Press
    • Distributors
    • Contact
  • Shop