|
|
ZYLIA 6 Degrees of Freedom
|
3D AUDIO EXPERTS
Capture the whole acoustic scene with freedom of movement |
VR / AR CREATORS
Offer a truly immersive virtual experience |
CULTURAL INSTITUTIONS
Virtually reopen theaters and concert halls to the public |
GAMING COMPANIES
Give the players a new immersive sound experience of your games |
RESEARCH TEAMS
Broaden the horizon of your research with navigable audio |
Are you interested in this solution? We will contact you directly
Pass the border between the musicians and the audience
ZYLIA 6 Degrees of Freedom Navigable Audio is the solution that allows recording an entire sound field around and within any performance imaginable. This means for the listener, that while listening to a 6DoF live concert, they can walk through the audio space freely. For instance, they can approach the stage, or even step on the stage to stand next to the musicians. The sound they hear will be different at every listening position, as in the case of a real life sound scene.
|
|
BenefitsRecord, create and stream 3D sound and let your audience experience the most realistic, immersive walk through the sound scene. Created specifically to support the production of 6 Degrees of Freedom (6DoF) and volumetric 3D audio experiences, the ZYLIA 6DoF Navigable Audio solution allows audio engineers and creatives to place multiple ZYLIA ZM-1S devices within a sound scene and to capture audio that leads to a truly immersive experience with unrestricted freedom of movement through the recorded 3D space.
|
|
|
|
|
Put VR goggles and join musicians on stage34 musicians and a world-class Conductor recorded live in the concert hall with ZYLIA 6 DoF Navigable Audio system. Walk through the stage and stand next to any artist. Download the 360 demo for VR goggles and take this immersive journey home where you smoothly navigate through the scene and experience the sound from anyplace – close perspective, the backstage or the audience. You have no VR goggles? No worries! You can also experience the demo without them and move through the virtual concert hall using keyboard and mouse.
|
|
Jordan Rudess & Friends in 3D AudioImmersive concert of Jordan Rudes, Steve Horelick, and Jerry Marotta at the Dreamland Studios, NY. The fantastic performance of three great musicians was captured by several 360° cameras and ZYLIA 360° Ambisonics microphones. This will allow a viewer to watch the concert from several different perspectives and listen to realistic 3D sound at each vantage point.
|
How does the ZYLIA 6 Degrees of Freedom Navigable Audio work?
Scenario I - The 6DoF volumetric audio
Hardware setup - ZM-1S microphone arrays | Recording | 6DoF HOA Renderer | Interactive 3D scene - video or game engine
Scenario II - Multi-point 360 audio and video
Hardware setup - ZM-1S microphone arrays & 360 cameras | Recording | 360 audio & video experience | 6DOF platforms or other services
Recording process
Distribute the ZYLIA ZM-1S microphones of your 6DoF set over the area you plan to record, for example the stage where a group of musicians performs. Connect the microphones to the computer using two types of cables: USB-mini to USB and mini jack to mini jack. Each microphone has 20 audio channels – 19 for recording the signals from microphone capsules (mini-USB output) and 1 for receiving the analogue synchronization impulses (mini jack input). After connecting all the microphones, you can record the audio from each ZM-1S simultaneously using the ZYLIA 6DoF Recorder (MAC OS or Linux).
Synchronization
Recordings from all of the ZYLIA ZM-1S microphone arrays and synchronized.
Encoding
After synchronizing the signals, encode them to Higher Order Ambisonics using the ZYLIA Ambisonics Converter.
Higher-Order Ambisonics (HOA) Rendering
Use the ZYLIA 6DoF HOA Renderer to create and explore a virtual, 3-dimensional audio space comprised of synchronised Ambisonics signals from all the ZYLIA ZM-1S from the recording. The ZYLIA 6DoF HOA Renderer translates the exact positions of the microphones on the stage (with their Ambisonics spheres) into the virtual space.
Implementation
You can use 3D audio content created with the ZYLIA 6DoF system in two ways:
> Playback for virtual or augmented reality
The HOA rendering can be combined in real-time with virtual reality through 3D game engines, like the Unity or Unreal Engine. In such a of virtual environment, a listener can move within the space in 6 Degrees of Freedom: forward and backward (surge), left and right (sway), up and down (heave) or rotate around any axis – turning left and right (yaw), pivoting sideways (roll), or tilting forward and backward (pitch). With every move the sound projected to the listener’s ears change – just as in real life. With ZYLIA 6DoF audio you can accomplish productions like virtual concerts or games with an extremely realistic sound.
> Multipoint 360° audio-video experience
ZYLIA 6DoF audio can be also used to create a multi-point 360° audio-video experience. In such a production you need to add 360° cameras to the ZYLIA microphones. You can set up for instance, a few recording spots on the stage among musicians – each with a ZYLIA ZM-1S and a 360° camera. A listener will be able to choose from which point he or she will watch the concert and experience it in immersive 360 degrees. As in the first option, with every move the sound projected to the listener’s ears will change, corresponding to the position of their head. In order to combine 360° video with 360° audio you will need a video editor (for example Premiere Pro, Final Cut, etc.) and a Digital Audio Workstation supporting 19-channel tracks (we recommend Reaper). This scenario does not require interpolating between Ambisonics positions.
> Playback for streaming services
Multipoint 360° audio-video experience can be also achieved in live-streaming situations (the 6DoF audio content can be streamed to 360 services such as YouTube or Facebook). In this case we need to additionally use OBS (Open Broadcaster Software) – a free software for video recording and live streaming. The operator decides on the trajectory of the listener who can still rotate her/his head and listen to 3D binaural audio.
|
ZYLIA 6 Degrees of Freedom VR / AR set
User Guide, Part 1 - Getting started |
ZYLIA 6 Degrees of Freedom VR / AR set
User Guide, Part 2 - Software installation |
ZYLIA 6 Degrees of Freedom VR / AR set
User Guide, Part 3 - Hardware setup and recording |
Hardware & Software Package
ZYLIA ZM-1S microphones
The ZYLIA ZM-1S is a 3rd order Ambisonics microphone array with 19 calibrated capsules (MEMS sensors) which offers a high-end 24-bit recording resolution including a timecode input channel allowing for the synchronization of multiple ZM-1S microphones.
Read more > |
ZYLIA 6 DEGREES OF FREEDOM RECORDING APPLICATION
The ZYLIA 6 DoF Recording Application is an application available for macOS and Linux. It enables simultaneous 6dof audio recordings from all ZYLIA ZM-1S microphones connected to the computer (input). It also performs a synchronization process of recorded audio files.
The application offers several convenience functions that help during live recording and post-production like – identification of the microphones, saving the layout of their position in space, turning the LED ring on and off, taking notes about the recorded take, as well as monitoring individual ZM-1S microphones over headphones during the recording. ZYLIA AMBISONICS CONVERTER
ZYLIA Ambisonics Converter converts ZM-1S multi-channel recordings to Higher Order Ambisonics (HOA). The conversion is required since ZYLIA 6DoF HOA Renderer works in the Ambisonics domain. During the transformation process, the A format recordings, which are an output of the synchronization stage are converted to 3rd order Ambisonics (AMBIX).
Read more > ZYLIA 6 DEGREES OF FREEDOM HIGHER ORDER AMBISONICS RENDERER
ZYLIA 6 Degrees of Freedom Higher Order Ambisonics Renderer is a MAX/MSP plugin available for MAC OS and Windows. It allows processing and rendering ZYLIA Navigable 3D Audio content. With this plugin users can playback the synchronized Ambisonics files, change the listener’s position, and interpolate multiple Ambisonics spheres. The plugin is also available for Wwise, allowing developers to use ZYLIA Navigable Audio technology in various game engines.
Read more > |
Zylia’s 6DOF system of multiple synchronized ZM-1S microphone arrays puts serious unprecedented sound capture capabilities in the hands of audio practitioners across many disciplines. What emerges is a new capacity for 3D processing and rendering of the music. We are pleased to be involved in this exciting development towards the enriched experience of listening to music. Immersive Media Lab McGill University, Canada
Working with the Zylia 6DoF VR set was an amazing adventure and journey into the future of audio. It fitted perfectly the concept of Perspective Control Ambisonic Microphone Array (PCAMA) built from four ZYLIA ZM-1S microphones. Using this workflow brings a whole new range of possibilities in the recording postproduction. Przemysław Danowski, The Fryderyk Chopin University of Music
We are trusted by a lot of clients, but here's a few...
|
|
|
|
|
|
|
|
|
|
|
|
Media Library
|
ZYLIA 6 Degrees of Freedom Navigable Audio Streaming with Poznan Philharmonic Orchestra "Making of". On August 13, 2020, we were honored to record the Poznan Philharmonic Orchestra during their performance in Adam Mickiewicz University’s Concert Hall. Using our ZYLIA six degrees of freedom navigable audio recording solution (ZYLIA 6DoF VR/AR set) we captured the sounds of beautiful classical music. Here are some behind the scenes photos we made during the recordings.
|
Take a walk with Zylia around a virtual concert hall filled with fully navigable live-recorded music from Mozart with 11 musicians and 30 Ambisonics spheres capturing the soundscape. See for yourself how the listener can navigate smoothly around the scene and experience the sound from anyplace – close perspectives, the backstage or the audience. Notice how the sound changes while passing by the musicians.
|
Multipoint 360 music experience with the Poznan Philharmonic Orchestra
Performance of the Poznan Philharmonic Orchestra recorded with multiple ZM-1S microphones and 360 cameras. |
|
What you are about to experience is a fully immersive concert brought to you in 360-degrees. With Zylia, you can engage with my music more closely and deeply than ever before! - Jordan Rudess
|
Multipoint 360 music experience - Jordan Rudess & Friends in 3D Audio, Dreamland Recording Studion, NY.
|
|
|
Zylia Webinars
|
Audio Library
> Two sets of audio recordings made with multiple ZYLIA ZM-1 3rd order HOA microphones: "Zylia-Sledz-Island" and "Zylia-Sledz-Tense".
> Two sets of audio recordings made with multiple ZYLIA ZM-1 3rd order HOA microphones: "Zylia-Locked-Room1" and "Zylia-Locked-Room2".
Tutorial Library
Featured in:
|
|
|
|
|
Zylia: a new approach to 6DoF audio technology in VR/AR ProVideoCoalition, 2019
|
|
|
|
Bringing 6DoF to Live Recorded Audio and Video, AudioXpress, October 2019
Read more > |
|
ZYLIA 6 Degrees of Freedom Navigable Audio is provided in a basic 5-microphone set. The system can be expanded by adding more ZM-1S microphones (custom setup depending on the size of the recorded venue). We also provide flexible payment options.
|
What is included in ZYLIA 6DoF VR/AR set:Hardware
Software
|
