3D/360° music production and multi-track recording using the ZYLIA microphone array
Typically 3D audio is reproduced using whether multi loudspeaker setups (5.1, 7.1, 22.2, e.g. Dolby Atmos) or headphones. Therefore, there are also two main recording setups related to 3D audio recording:
There is also a third approach, recording of sound objects or folleys and use them in game engine mixers or 3D audio renderers.
MUSIC AND AUDIO PRODUCTION PROCES
Now you can divide audio production process into four main stages. Pre-production stage is the most engaging. It depends on many factors such as the characteristics of sound sources you are going to record, their position in relation to each other, acoustic conditions or simply your budget for equipment. It requires selection of microphones and their right placement in recording landscape. In many cases, it is connected with multiple test recordings you need to make and microphone placement changes. The more experienced audio engineer you are the less time it should take and the better results you will obtain.
The second stage – recording. It should be straightforward. Start recording, repeat it, record a few takes and that’s it. But what if you had just one chance to record a scene? Or you didn’t notice that there was something wrong with your microphone placement? You go home and then it shows up that your recordings are poor, that some strange noises from a background are noticeable. What can you do? You can repeat a whole recording day or try to mask it in the mixing process. In both cases, it equals additional hours of your extra work.
You never know what happens during a field recording. Being able to correct a “bad” microphone placement after the recording would be a great option!
Felix Andriessens, Sound designer, BERLIN
How to save some time and reduce the risk of bad microphone placement or unwanted noises in your recordings? You can simplify the first two steps by using a ZYLIA microphone array. The system is capable of recording a full 360˚ music scene and representing it in 19-channel ZYLIA format or B-format (Wikipedia). By using one of those formats it is possible to save the whole sound field information in a single recording which can be further (in post-production) decomposed into any number of Virtual Microphones. In this case, you are using one device for recording the whole 360˚ audio scene. You simply capture everything with a high spatial resolution.
HOW IT WORKS? THE TECHNOLOGY BEHIND ZYLIA ZM-1
ZYLIA is a 3rd order Ambisonics microphone array. That is, it records 360˚ audio in the high spatial resolution that further on can be decomposed into different audio layers that represent individual sound sources, instruments or background noises.
Instead of using multiple spot microphones you put ZYLIA in the middle of the audio scene. The recorded audio tracks are processed by the dedicated software which allows creating so-called Virtual Microphones. They provide an adaptive isolation of sound sources. As a result, you receive separated tracks of the recorded sound sources. The software allows for steering a Virtual Microphone at any direction in the 3D space. In post-processing, you can now easily manipulate with recording and select exact sound sources, ambient or room reflections. What is more, you can identify unwanted sounds and remove them from your recording. Virtual Microphones operate in two modes:
The main advantage of this approach is that all those adjustments may be done without repeating the pre-recording and recording step because it is possible to change a spatial characteristic of Virtual Microphone in the post‑production phase
3D AUDIO IN A NEW WAY
ZYLIA ZM-1 microphone array can be used in many applications. Let us name a few: binaural recordings, object recording, Ambisonics 360˚ or multichannel 5.1, 7.1 and 22.2.
Binaural recording is a well-known method of recording sound scene with two microphones, creating a 3D stereo sound sensation for the listener, he can actually hear the effect of being in the middle of the sound scene. This effect is often created using a technique known as "dummy head recording" but you can also prepare a binaural recording with ZYLIA microphone array. There are two options to achieve that effect with ZYLIA:
Fig. Ambient and binaural recordings with ZYLIA ZM-1.
Typical audio mix used for film or game production contains lots of sound objects that are further placed in the 3D space by using dedicated spatialization plugin. However, recording of each object separately is time-consuming and prone to errors such as capturing of unwanted noises.
By using ZYLIA ZM-1 it is possible to record a full 360˚ audio scene and then in the post‑production extract sound objects – instruments, dialogs, etc. Extraction process provides:
3rd order Ambisonics and 360 movies
Ambisonics audio (B-format) can be used directly in many audio and video players such as YouTube or Facebook 360˚. 360˚ players convert Ambisonics audio into binaural (two channel) signal. The higher the microphone order the better the spatial resolution (ability to extract and listen to point sources in the surrounding sound scene) and rotation effect during playback.
It is highly recommended to use the highest possible microphone array, e.g. 3rd order. The high spatial resolution provides a truly immersive experience where the listener is able to easily localize sound sources in the 3D space. On the other hand, using lower order microphones result in fuzzy sounds during binaural or loudspeaker playback.
360˚ audio comes usually with 360˚ videos. For that context, ZYLIA ZM-1 is often combined with a range of popular cameras e.g. Insta360.
3rd order Ambisonics plus objects
There are situations where Ambisonics sound is not enough to fully represents 3D audio space. Usually, it is a scene where there is a lot of sound sources which lead to problems with sound localisation. There are at least two solutions to solve this problem:
Cinematic audio and music production often requires recording a surround sound e.g. 5.1, 22.2 (Dolby Atmos). In that context, it is possible to use ZYLIA ZM-1 and ZYLIA Studio PRO plugin. The latter consists of surround preset demonstrated in the below picture.
Fig. ZYLIA Studio PRO.
A notable example of surround sound production is a cinematic trailer of First Aid Kit band recorded by Sony Music UK. During that production, Sony Music UK (Kris Winter) used a ZYLIA ZM-1 microphone attached to a standard filming equipment.
Music is the universal language
"Music is the only language in the universe that we can all speak and understand" says Basia Galaj our Brand Ambassador, sharing her thoughts in a short interview.
Zylia: Tell us why music is so important for you? When and how it all began?
Basia: Music is the only language in the universe that we can all speak and understand. Even when you don’t necessarily play an instrument or sing, you can feel it. Music makes people emotional, helps go through happy and sad times and that is why I feel like it is the most powerful weapon we have. It is very important to me because it brings hope that humans can unite and create no matter the differences.
When I was about a year old, my grandma started singing to me and playing me different recordings and albums. I would repeat those melodies after her. When she passed away, my mom and grandpa took over. Grandfather played me jazz in the car - lots of Ella Fitzgerald and Louis Armstrong; I still remember the cassettes he used! :-) My mom showed me Michael Jackson, Basia Trzetrzelewska, Kayah and classical music such as Bach and Chopin.
That lead to piano lessons at age of 5 and continues until day on :-)
Zylia: How and when did you firs hear about ZYLIA?
Basia: I heard about ZYLIA from my mentor and friend – Mikolaj Stroinski. It was during the summer of 2017. He called me and said: Basia, you need to meet these incredible guys, They created a mic... and he just kept going and going :-)
Zylia: How do you see the potential of microphone array technology in changing the way musicians record themselves?
Basia: I think and I really hope it will become a necessity for every musician or music passionate that would like to easily record themselves in a great quality. It has so much potential in many areas! It can only grow in the VR world and that is becoming a next step in the music industry. It makes life of bands much easier since it is using only one cable, not 19 for every mic capsule inside the mic.
Zylia: What are your plans for future? Any interesting projects on your mind?
Basia: I am the leader / organizer of the very first TED talk at Berklee that will be happening next semester – Fall 2018. I am hoping to grow my blog and YouTube channel; I have lots of new content coming up very soon! Over the summer I am going to be doing interviews with Polish World War II veterans, asking them about their experiences and memories and I am going to write music to their confessions and stories. Hopefully, I will be able to use ZYLIA mic to record the interviews :-)
Some extra thing that I do is a project I called – Throwback Thursday! Every Thursday I do a video featuring my friends, we play a song from our childhood or just something we have memories of. I put those videos on my YouTube channel and Facebook fan page :-)
Zylia: We definitely need to see them:-) Thank you for your time and good luck with new projects!
Born in Bydgoszcz, Poland, Basia entered the world of music at a very young age. In 2014, she got accepted into the University of North Texas, where she pursued a degree in Jazz Studies. She has had the privilege to share the stage with artists such as ten-time Grammy Award winner Bobby McFerrin.
Currently Basia lives in Boston, MA and attends the prestigious Berklee College of Music where she is pursuing a degree in Contemporary Writing and Production with a minor in Creative Entrepreneurship. On June 19th 2017, Basia released her debut EP called "Day By Day".
She is currently performing around East Coast with her band, playing her original music.