ZYLIA - 3D AUDIO RECORDING & POST-PROCESSING
  • Solutions
    • Live rehearsal recording
    • 360 VR recording
    • Field recording
    • Audio recording for Dolby Atmos
    • Navigable Audio for VR
    • 3D audio streaming
  • Products
    • ZYLIA MUSIC
    • ZYLIA PRO
    • ZYLIA 6DOF
    • Software >
      • Applications >
        • ZYLIA Studio
        • ZYLIA Ambisonics Converter
        • ZYLIA Streaming Application
        • ZYLIA 6DoF Recording Application
      • Plugins >
        • ZYLIA Studio PRO
        • ZYLIA Ambisonics Converter Plugin
        • ZYLIA 6DoF HOA renderer
    • Hardware >
      • ZYLIA ZM-1 microphone
      • ZYLIA ZM-1S microphone
      • ZYLIA ZR-1 Portable Recorder
    • Technology Licensing
  • Support
    • Get Started
    • Register
    • Downloads
    • Tutorials
    • Help Center
    • Contact support
  • Community
    • Demo
    • Testimonials
    • Affiliate Program
  • Blog
  • Company
    • About
    • R&D
    • Jobs
    • Press
    • Distributors
    • Contact
  • Shop

How to make a perfect 360 movie with a 3D sound?

3/29/2017

5 Comments

 
By Łukasz Januszkiewicz

Some time ago we had a chance to record a big performance at Great Theatre in Poznan (Choir and chamber orchestra of the Grand Theatre, conductor Mariusz Otto, program: Christmas carols). It was a Christmas Concert. We decided to make a 360 movie with 3D sound recorded with ZYLIA. With 360 movies there is always a problem with a sound scene following your eyes. We took the challenge to solve this problem.

Microphone 360 Theatre



Step One - Preparations

We used:
  • Two Kodak PIXPRO SP360, 4K
  • ZYLIA Portable Recording System. We used one ZYLIA ZM-1 placed in the middle of orchestra and three additional ZYLIA ZM-1 mics as the backup.
  • Stands for camera and ZYLIA ZM-1 mics
  • USB cables for ZM-1
  • Macbook to record sound from ZYLIA ZM-1
  • Laptop chargers
Kodak PIXPRO SP360
Stands for camera and ZYLIA ZM-1 mics

Step two - On The Stage

  • Camera placement. 
Both camera and main ZM-1 were located in the middle of the orchestra, in the line with string instruments.
Picture
Picture
  • Microphone placement. ​​
​​Because of the size of a music scene, there were four mics used on the stage.
​The main ZM-1 microphone was positioned approximately 20 cm below the camera.
Backup ZM-1’s were positioned on the right and on the left side of the main ZM-1 (distance of 4-5 meters). There was also one mic just right in front of the choir. 
​
 
  • The final setup 

Scene Great Theatre Poznan

Recordings made with 6DOF Development Kit by Zylia
​Read more ...

Step Three – Recording our perfect 360 movie

​… and hiding behind the curtain :-)
at Great Theatre
Orchestra in the theater
element_settings.Image_30621876.default

Step Four - Video And Audio Post-processing

​Captured video was stitched and processed with Kodak PIXPRO SP360 software. The recorded audio was manually synchronized with the processed video. Then we used our software to convert ZM-1 recorded tracks into 1st, 2nd and even 3rd order HOA (Higher Order Ambisonics) signals. Finally, we merged the video and the 1st order Ambisonics audio track into one MP4 file and uploaded it to YouTube 360 service*.
 
*At this moment YouTube 360 supports only 1st order Ambisonics audio.

360 movie with 3D sound - The final effect


We have recorded a great performance of orchestra and choir with a newest microphone array technology. Final effect is astonishing! Our 360 movie gives you a chance to participate in this beautiful event, and actually be in the middle of the stage.

​Video will be available soon.

How to turn a room into a recording studio?

5 Comments
Angelo Farina link
6/25/2017 17:30:07

Very iteresting...
We are doing the same here in Parma with an Eigemike.
You could post the panoramic H264 video with 16-ch 3rd order Ambisonics (Ambix) soundtrack as a .MOV container, with the audio in 16 bit PCM uncompressed. This format works great with teh free app Jump Inspector from Google, and allow to deliver full third-order...
So please, post some samples (2 minutes long is enough) with full 3rd order signals, Youtube is quite crappy with heavily-compressed 1st order only...

Reply
Peter
1/10/2019 13:02:40

There are almost 2 years gone since this artikel has been written.
Where is the YouTube link?

Reply
Anna
1/10/2019 13:28:20

Hi Peter,
Unfortunately, orchestra members did not give permission to publish their recordings.
You can check our YouTube for different 3D audio recordings - https://www.youtube.com/channel/UCeNdmyaAJfxk7Ut0q2mwEYA

https://www.youtube.com/watch?v=iO3lm69jUcs
https://www.youtube.com/watch?v=MW1xAUNy_X8

Best!

Reply
Hum3d link
5/6/2022 12:59:54

This is the first time I've heard of this technology, and the article is 5 years old! Can you please tell me whether I need a special audio system to listen to this recording in 360 or whether the technology will work with regular headphones?

Reply
Angelo Farina link
5/6/2022 13:18:56

If you watch a 360-video on Youtube using a smartphone with the Youtube app, you do not need any special hardware. When you look around (either tilting the smartphone or panning on the screen), the headphones will convey to your ears directional audio coming from where you are looking.
Same for 360-videos posted on Facebook, Veer, or DeoVR portals, of course using the dedicated app for each of them.
But, for the best results, you should watch these videos with a VR visor: the cheapest is an Android smartphone equipped with hi-res screen fitted in a "cardboard" stereoscopic visor. The best is an Oculus Quest 2 visor. In both cases, as you look around in the 360-degrees spherical space, your headphones will be fed with a binaural rendering of the sound, providing you with a very accurate localisation of the sound sources.

Reply



Leave a Reply.

    Picture

    Categories

    All
    360 Recording
    6DOF
    Ambisonics
    Good Reading
    How To Posts
    Interviews
    Live Stream
    Product Review
    Recording
    Software Releases
    Tutorials

    Archives

    May 2022
    February 2022
    January 2022
    August 2021
    July 2021
    May 2021
    April 2021
    March 2021
    January 2021
    December 2020
    November 2020
    October 2020
    September 2020
    August 2020
    July 2020
    June 2020
    April 2020
    March 2020
    February 2020
    January 2020
    December 2019
    November 2019
    October 2019
    September 2019
    August 2019
    July 2019
    June 2019
    May 2019
    April 2019
    March 2019
    January 2019
    December 2018
    October 2018
    September 2018
    June 2018
    May 2018
    April 2018
    March 2018
    February 2018
    January 2018
    December 2017
    October 2017
    September 2017
    August 2017
    July 2017
    June 2017
    May 2017
    March 2017
    February 2017
    January 2017
    December 2016
    November 2016
    October 2016

    RSS Feed

    Authors

    Zylia Team

Picture
Picture

Company

About
R&D
News
Jobs
Press
​Contact

Products

ZYLIA ZM-1 microphone array
ZYLIA ZM-1S microphone array
ZYLIA ZR-1 portable recorder
ZYLIA Studio
ZYLIA Studio PRO plugin
ZYLIA Ambisonics Converter
ZYLIA Ambisonics Converter plugin
ZYLIA Streaming Application
ZYLIA 6DoF Navigable Audio

Shop

​Distributors

Downloads

Support

Blog

Community

Connect with us

Subscribe to ZYLIA Newsletter

I acknowledge that by clicking „Subscribe” I give my permission to receive Zylia Newsletter about Zylia’s products and promotions. By submitting the form I agree with Zylia’s Privacy Policy. ​You can unsubscribe at any time using the link provided in a Newsletter.
Our brands:
Picture
Picture
Get ZYLIA:
Picture
Picture
Terms & Conditions   |   Privacy Policy   |   Contact
© Zylia Sp. z o.o., copyright 2018. ALL RIGHTS RESERVED. 
  • Solutions
    • Live rehearsal recording
    • 360 VR recording
    • Field recording
    • Audio recording for Dolby Atmos
    • Navigable Audio for VR
    • 3D audio streaming
  • Products
    • ZYLIA MUSIC
    • ZYLIA PRO
    • ZYLIA 6DOF
    • Software >
      • Applications >
        • ZYLIA Studio
        • ZYLIA Ambisonics Converter
        • ZYLIA Streaming Application
        • ZYLIA 6DoF Recording Application
      • Plugins >
        • ZYLIA Studio PRO
        • ZYLIA Ambisonics Converter Plugin
        • ZYLIA 6DoF HOA renderer
    • Hardware >
      • ZYLIA ZM-1 microphone
      • ZYLIA ZM-1S microphone
      • ZYLIA ZR-1 Portable Recorder
    • Technology Licensing
  • Support
    • Get Started
    • Register
    • Downloads
    • Tutorials
    • Help Center
    • Contact support
  • Community
    • Demo
    • Testimonials
    • Affiliate Program
  • Blog
  • Company
    • About
    • R&D
    • Jobs
    • Press
    • Distributors
    • Contact
  • Shop