How to add binaural and Ambisonics sound to a video for YouTube 360?

By Eduardo Patricio

---

​In this post we present two videos in different formats, but edited from the same source material captured on the 20th of June 2018, at Barigui park (Curitiba, Brazil).

The audio was recorded with the ZYLIA ZM-1 3rd order Ambisonics spherical microphone array while the video was captured by a 360-degree camera (Gear 360).
 
Below, you can watch both videos and find some information on how to achieve the two different results, with focus on preparing the audio recorded with the ZM-1 microphone for each scenario.

Scenario A

Interactive, immersive video with full 3D sound 
​(media components: 360-degree video + Ambisonics audio) 

Scenario B

​Non-interactive video with fixed perspective 3D sound
(media components: Tiny planet” video + binaural audio)

Equipment used
 

• ZYLIA ZM-1 microphone
• Samsung Gear 360 camera (2017 model) + micro SD card
• Laptop (software list below)
• Camera stand
• Extension support arm with clamp
• USB cable (for the ZM-1)
• Large microphone windshield 

Software used

• ZYLIA Studio
• ZYLIA Studio PRO
• ZYLIA Ambisonics Converter
• REAPER
• Insta360studio
• Adobe Premiere

The microphone and the camera were placed on a single camera stand with a small clamped extension arm (see picture below). Both devices were aligned vertically with a small horizontal offset. We made sure the microphone and the camera always had the same relative facing direction (front of the microphone aligned with the camera side where the recording button is found).

ZM-1 and Gear 360 placement on a single stand
​with a clamped extension

Camera and microphone alignment

Chosen location at Barigui park

​The exact location at Barigui park was carefully chosen for its proximity to the lake that always attracts various birds, and also for being next to a rather busy highway and a helicopter landing pad. 

​For scenario A, we used the regular stitched video from the Gear 360 and a 1st order Ambisonics audio file.

​Scenario A - Basic steps taken:

• Simultaneously record video footage on Gear 360 and audio on laptop (running ZYLIA Studio);
• Convert the raw 19-channel file from ZYLIA Studio to Ambisonics, using ZYLIA Ambisonics converter;
• Edit 360-degree video and Ambisonics audio on Adobe Premiere.

 
Here are the detailed steps taken for the conversion to Ambisonics:

• Input (ZM-1’s raw) audio file was selected
• Microphone model selected: ZYLIA ZM-1 model 1D
• Orientation selected: Upright, 0 degrees
• Output format selected: AmbiX*

 
* Standard currently (August 2018) used on YouTube.

For scenario B, we used the video from Gear 360 in ‘tiny planet’ format and a binaural audio track.

Since, the source material is the same as the one from scenario A, we’ll list here only the steps that differ.

Scenario B steps:

• Process stereoscopic video from Gear 360 on Insta360 Studio to have the ‘tiny planet’ effect;
• Convert the raw 19-channel file from ZYLIA Studio to binaural, using ZYLIA Studio PRO running in REAPER.
• Edit 360-degree video and Ambisonics audio on Adobe Premiere.

Choosing binaural preset on ZYLIA Studio PRO in REAPER

#ambiencerecording #ambisonics #binaural #soundscapes #immersiveaudio #360recording