ZYLIA - 3D AUDIO RECORDING & POST-PROCESSING
  • Solutions
    • Live rehearsal recording
    • 360 VR recording
    • Field recording
    • Audio recording for Dolby Atmos
    • Navigable Audio for VR
    • 3D audio streaming
    • Loudspeakers calibration & localization
  • Use cases
    • Music recording with Zylia
    • Immersive 360 audio
    • ZYLIA ZM-1 and Dante
    • 3D audio podcasts
    • Virtual stage with volumetric audio
    • Rendering sound for games
    • Multi-point 360 audio and video
    • Multi-point HOA music and soundscape recordings
  • Products
    • ZYLIA PRO
    • ZYLIA 6DOF
    • Software >
      • Applications >
        • ZYLIA Studio
        • ZYLIA Ambisonics Converter
        • ZYLIA Streaming Application
        • ZYLIA 6DoF Recording Application
      • Plugins >
        • ZYLIA Studio PRO
        • ZYLIA Ambisonics Converter Plugin
        • ZYLIA 6DoF HOA renderer
    • Hardware >
      • ZYLIA ZM-1 microphone
      • ZYLIA ZM-1S microphone
      • ZYLIA ZR-1 Portable Recorder
    • Technology Licensing
  • Support
    • Get Started
    • Register
    • Downloads
    • Tutorials
    • Help Center
    • Contact support
    • Demo
    • Testimonials
    • Referral
    • Ambassadors
  • Blog
  • Company
    • About
    • R&D
    • Jobs
    • Press
    • Distributors
    • Contact
  • Shop

Create your own spatial Ambisonics mix with ZYLIA!

1/18/2018

1 Comment

 
By Jakub Zamojski & Lukasz Januszkiewicz

Recording and mixing surround sound becomes more and more popular. Among the popular multichannel representation of surround sound systems like 5.1, 7.1 or cinematic 22.2, especially worthy of note is an Ambisonics format, which is a full-sphere spatial audio technique allowing to get a real immersive experience of 3D sound. You can find more details about Ambisonics here (What is the Ambisonics format?).

Our previous blog post “2nd order Ambisonics Demo VR” described the process of combining audio and the corresponding 360 video into fine 360 movie on Facebook. Presented approach assumes using of 8-channel TBE signal from ZYLIA Ambisonics Converter and converts audio into the Ambisonics domain. As a result we get a nice 3D sound image which is rotating and adapting together with the virtual movement of our position. However, it is still not possible to adjust parameters (gain, EQ correction, etc.) or change the relative position of the individual sound sources present in the recorded sound scene.
In this tutorial we are going to introduce  another approach of using ZYLIA ZM-1 to create a 3D sound recording, which gives much more flexibility in sound source manipulation. It allows us not only to adjust the position of instruments in recorded 3D space around ZYLIA microphone, but also to control the gain or to apply any additional effects (EQ, Comp, etc.). In this way we are able to create a fancy spatial mix using only one microphone instead of several spot mics!
Picture

Spatial Encoding of Sound Sources – Tutorial

In the end of July 2017, using ZYLIA ZM-1 microphone we have recorded a band called “Trelotechnika”. All band members were located around ZM-1 microphone, 4 musicians and one additional sound source – drums (played from a loudspeaker). During the post-production process, we applied ZYLIA Studio PRO VST plug-in (within Reaper DAW) on recorded 19-channel audio track. This allowed us to separate the previously recorded instruments and transfer them into the individual tracks in the DAW. Those tracks were then directed to the FB360 plug-ins, where encoding to the Ambisonics domain was performed.

“Spatial Encoding of Sound Sources” - a step-by-step description

Below, you will find a detailed description of how to run a demo session presenting our approach of recording and spatial encoding of sound sources. Demo works on Mac Os X and Windows.
DOWNLOAD STAGE

  1. Download and install REAPER software. The evaluation version is fully functional and perfect to run with our demo.
  2. Download and install Facebook 360 Spatial Workstation software. It is a free bundle of spatial audio VST plug‑ins. In the session we used version 3.1 beta1.
  3. Download and install ZYLIA Studio Pro (VST3 Mac, Windows). It’s possible to run the demo in trial mode. In the session we used VST3 plug-in.
  4. Download the REAPER session prepared by Zylia Team. It is already configured with our audio tracks and all required effects. Unzip it.
  5. Download 360 movie – two versions are available: high quality [3840 x 1920] and medium quality [1920 x 960].  High quality version sometimes tends to pause in FB360 Video Player on slower CPUs.
  6. Run REAPER and open the session (ZYLIA-Ambisonics-sources-enc.rpp).
TUTORIAL
 
​After opening the session, you will see several tracks:
1. Very important! Please, ensure that Reaper is working with sample rate of 48 kHz.
​

2. ZS_pro track – contains 19-channel WAVE file recorded with ZYLIA ZM-1. Click on FX button located on the ZS_pro track. If everything is correct, you will see ZYLIA Studio PRO VST plug-in. By default, there will be 5 virtual microphones – each one already assigned to one of the instruments: bass, drums, guitar, synth and pad. By clicking on a specific virtual microphone, you can adjust azimuth, elevation, width, and separation mode. Master send in routing panel for track should be unchecked.
Picture
Picture
3. Separated signals from ZYLIA Studio PRO are passing to 5 individual tracks. You are able to adjust the gain, you can also mute or solo instruments, or you can apply some audio effects. A good practice is to use a high-pass filter for non-bass and low-pass for bass instruments to reduce a spill between them. We applied these filters to our session:
Picture
​4. Spatialiser track – receives 5 signals from tracks with separated instruments. Spatialiser allows to distribute sound sources in desired positions in the 3D space.
​      a) Click on FX and choose FB360 Spatialiser.
   b) Click on Load button placed on the video grid. Choose Slave mode and load the provided video clip. You will see a message box “H264 is not a recommended codec” - click X.
​
Picture
   c) Set the video format to Mono and the display mode to Desktop. In Connect to DAW you should be able to choose your computer’s name. If not, try to restart Reaper and repeat the steps. You are ready to click the Open button. Video box will appear.
Picture
   d) Back to Spatialiser view. You will see an equirectangular picture and five circles with numbers. Each circle represents a sound source position in the space. By default, sources are located in the positions corresponding to the real positions of the instruments in the picture, but it is possible to adjust it by clicking on the circle and dragging it around the picture.
Picture
5. Control track – receives a multichannel signal from Spatialiser. Control provides connection with the Video Player, rotates the audio scene and applies binauralization.

   a) Click on FX and choose FB360 Control.

   b)  Ensure that Listener Roll, Listener Pitch and Listener Yaw are properly received from video – controls should be darkened. Open a video box and try to rotate the image - Pitch and Yaw sliders should follow the image to rotate.

   c) JS: Master Limiter boosts the volume and protects from clipping/distortions.
​
   d) 
Master send in routing panel for track should be checked.
Picture
6. Now video is synchronized with audio. Adjusting the location of play-head in REAPER’s time line will affect the video’s time. Tap space bar to play audio and video. Rotation of the video in the player  is tracked by the decoded and binauralized Ambisonics sound.

7.  A good practice is to play video from the beginning of file to keep the synchronization. In some cases, it is necessary to close the VideoClient + VideoPlayer and load 360 video again to recover the synchronization.
​

8.  Now you are able to rotate video across the pitch and yaw axis. Your demo is ready to run.
1 Comment

Using ZYLIA Studio PRO with ReWire

1/16/2018

2 Comments

 
by Maciej Lenartowicz

Integrating new tools into existing work-flows may be a difficult task, especially when those tools introduce innovative features, such as “virtual microphones” in ZYLIA Studio PRO. 
One of ZYLIA Studio PRO requirements is support for multichannel input for the plugin, which not many DAWs offer. Fortunately, there are ways to combine best of both worlds, and use ZYLIA’s technology with a typical multitrack workflow designed for dedicated microphone recording.
​
Such connection can be achieved thanks to ReWire, which is a software protocol allowing applications to exchange control messages and audio data. ReWire works both on macOS and Windows and requires no prior installation or configuration. Find out more at Wikipedia or Propellerhead website.
"Virtual Microphone" is a spatial audio filtering technique based on advanced beam-forming and sound source separation algorithms. It is defined and created by the ZYLIA software which takes into account both phase and amplitude differences between signals captured by the 19 capsules of the ZM-1. Virtual Microphones can have different spatial characteristics, width or shape depending on recording use cases and user needs. Each can be used as a single spot microphone with super-narrow directivity response, or can be combined with other into a variety of multi‑channel surround recording sets. This technology gives musicians and sound engineers a very flexible recording toolbox which can be used in post‑production phase. Additionally, advanced DSP algorithms allow to reduce room echo or to increase the performance of sound source separation.
More in a ZYLIA white paper.

​This article will guide you through the process of setting up a connection between ZYLIA Studio PRO (running within REAPER) and your DAW of choice (assuming it supports ReWire protocol).
  1. Make sure to run your main DAW in the first place. In case of this tutorial, we will use Ableton Live. It will act as a ReWire master (mixer).
  2. When your DAW is up and running go to its audio settings. Select a proper device, sample rate, and buffer size. Keep in mind that ZS PRO will work only with a sample rate of 48 kHz.
  3. Start REAPER, which will be a host to ZS PRO plugin and act as a ReWire slave (device). If it is configured correctly, you should see “ReWire Slave Audio” in the upper right corner of REAPER window.
    If you don’t see this it means that REAPER is not running as a ReWire slave. To fix this, go to “Edit” menu and select “Preferences”. In the list on the left find “Plug-ins” section and select “ReWire/DX”.  Enable “Check for ReWire mixer/device on startup” option and restart REAPER.
Picture
Example session in REAPER with ZYLIA Studio PRO. Notice that REAPER runs in ReWire mode.
4. Now you can create a new project in REAPER or load existing one. Use ZYLIA Studio PRO as you would otherwise, i.e. create a new track for every virtual microphone, with just one exception – these new tracks won’t be sent to master track. To do so, enter “Routing” menu for a track in REAPER and disable “Master send” option.

​To route audio form virtual microphone out of REAPER, you need to select “hardware” output for a track. These are the very same channels that will be available in Ableton. Click on “Add new hardware output...” menu and select one of the outputs from the list. It is advised to start from “ReWire Output 3” (for Z1 virtual microphone) since first and second outputs are usually associated with a master track
Picture
5. Go back to Ableton and create a new track. You will need “In/Out Section” of the mixer visible – if it’s not, use round “IO” button just right to the master track to turn it on. In “Audio From” section select “REAPER” as an input device, then select “REAPER Output 3” as an input channel. When you press “play” in one of the applications the signal from REAPER (processed by ZYLIA Studio PRO) should appear in Ableton. Set “Monitor” option to “In” to hear the sound produced by REAPER. The signal from virtual microphone now may be recorded and processed in the same way as it would be from a normal microphone connected to your audio interface.
Picture
Picture
Ableton session set to receive audio from REAPER.
2 Comments
    Picture

    Categories

    All
    360 Recording
    6DOF
    Ambisonics
    Good Reading
    How To Posts
    Impulse Response
    Interviews
    Live Stream
    Product Review
    Recording
    Software Releases
    Tutorials

    Archives

    February 2023
    November 2022
    October 2022
    July 2022
    June 2022
    May 2022
    February 2022
    January 2022
    August 2021
    July 2021
    May 2021
    April 2021
    March 2021
    January 2021
    December 2020
    November 2020
    October 2020
    September 2020
    August 2020
    July 2020
    June 2020
    April 2020
    March 2020
    February 2020
    January 2020
    December 2019
    November 2019
    October 2019
    September 2019
    August 2019
    July 2019
    June 2019
    May 2019
    April 2019
    March 2019
    January 2019
    December 2018
    October 2018
    September 2018
    June 2018
    May 2018
    April 2018
    March 2018
    February 2018
    January 2018
    December 2017
    October 2017
    September 2017
    August 2017
    July 2017
    June 2017
    May 2017
    March 2017
    February 2017
    January 2017
    December 2016
    November 2016
    October 2016

    RSS Feed

    Authors

    Zylia Team

Picture
Picture

Company

About
R&D
News
Jobs
Press
​Contact

Products

ZYLIA ZM-1 microphone array
ZYLIA ZM-1S microphone array
ZYLIA ZR-1 portable recorder
ZYLIA Studio
ZYLIA Studio PRO plugin
ZYLIA Ambisonics Converter
ZYLIA Ambisonics Converter plugin
ZYLIA Streaming Application
ZYLIA 6DoF Navigable Audio

Shop

​Distributors

Downloads

Support

Blog

Community

Get ZYLIA products:
Picture
Picture
Picture
Picture
Picture
Picture
Picture

Connect with us

Subscribe to ZYLIA Newsletter

I acknowledge that by clicking „Subscribe” I give my permission to receive Zylia Newsletter about Zylia’s products and promotions. By submitting the form I agree with Zylia’s Privacy Policy. ​You can unsubscribe at any time using the link provided in a Newsletter.
Our brands:
Picture
Picture
Our engagement:
Picture
Picture
Terms & Conditions   |   Privacy Policy   |   Contact
© Zylia Sp. z o.o., copyright 2018. ALL RIGHTS RESERVED. 
  • Solutions
    • Live rehearsal recording
    • 360 VR recording
    • Field recording
    • Audio recording for Dolby Atmos
    • Navigable Audio for VR
    • 3D audio streaming
    • Loudspeakers calibration & localization
  • Use cases
    • Music recording with Zylia
    • Immersive 360 audio
    • ZYLIA ZM-1 and Dante
    • 3D audio podcasts
    • Virtual stage with volumetric audio
    • Rendering sound for games
    • Multi-point 360 audio and video
    • Multi-point HOA music and soundscape recordings
  • Products
    • ZYLIA PRO
    • ZYLIA 6DOF
    • Software >
      • Applications >
        • ZYLIA Studio
        • ZYLIA Ambisonics Converter
        • ZYLIA Streaming Application
        • ZYLIA 6DoF Recording Application
      • Plugins >
        • ZYLIA Studio PRO
        • ZYLIA Ambisonics Converter Plugin
        • ZYLIA 6DoF HOA renderer
    • Hardware >
      • ZYLIA ZM-1 microphone
      • ZYLIA ZM-1S microphone
      • ZYLIA ZR-1 Portable Recorder
    • Technology Licensing
  • Support
    • Get Started
    • Register
    • Downloads
    • Tutorials
    • Help Center
    • Contact support
    • Demo
    • Testimonials
    • Referral
    • Ambassadors
  • Blog
  • Company
    • About
    • R&D
    • Jobs
    • Press
    • Distributors
    • Contact
  • Shop