CAMBRIDGE CORN EXCHANGE

AUGMENTED REALITY PROJECT PROPOSAL

MAIN ROOM DIMENSIONS

Width — 16,85m

Length — 18,27m

ROOM ADAPTATION

· Totem 2,5mx1mx1m in the center of the room

· 5 stand-shaped objects surrounding the totem

OUR DEVICE

Microsoft Hololens 2: augmented reality/mixed reality headset.

CREATIVE PROPOSAL

We visualize 5 interaction points/5 capsules linked to each of the 5 stand-shaped structures distributed throughout the space. The 5 structures correspond to 5 different aspects related to our experience, the Cambridge Corn Exchange, and the city of Cambridge.

Each interactive capsule will be a content unit covering different themes surrounding the past, present, and future of the City and the Corn Exchange.
 

Our immersive proposal is divided into 4 blocks:

— 0. Reception

— 1. Introduction

— 2. Capsules

— 3. Final

— 0. RECEPTION

Upon entering the main hall, users are equipped with the HoloLens device. They are asked if they feel comfortable, if the audio is adequate, and finally, they are invited to visualize our main scenic element, our guide. A lead actor, a personalized guide throughout the experience, will help us follow the next steps and maintain the appropriate pace. Once the user is equiped with the holographic glasses, comfortable with the visualization and audio, the system proceeds to start the experience.

— 1. INTRODUCTION

Our personalized guide is introduced to us, and the user perceives the first hologram floating in this grand hall. Our guide invites us to view the space calmly and omnidirectionally. It will suggest the user to check their hands through this new system; later on, the interaction will be essential. Once the experience and space are introduced, it indicates that we have 5 Zones (5 capsules) to discover. To start, we will begin with the first capsule, a brief introduction to the immersive space and this new technology that is Mixed Reality. Our guide moves and suggests that we follow her to the first capsule.

— 2.1. TUTORIAL

What can the user do with the device? How can the user interact with the objects? Hand movement tutorial. The guide will invite us to learn how to perform the first 3 interaction actions, such as look and activate objects, touch them, and move elements. Using structural elements of the Corn Exchange space, she will suggest to perform those 3 steps using virtual props in the room. Finally, once the 3 steps of the tutorial are completed, she will ask us to finish this capsule in the center of the room, where the grand totem is located. The totem is a central element that allows us to conclude each capsule, providing visualization of contents in video format. The totem is a large multi-screen displaying photo and video content related to each of the capsules.

Once all contents of the current capsule are consumed, our guide invites us to move forward – we will follow her to reach the next capsule.

— 2.2. THE CITY OF CAMBRIDGE

We begin with a capsule focusing an overview of the city, its culture, and traditions. Our guide narrates the various points of interest in the city, taking us on a whirlwind journey through its past, present, and how it shapes the future through knowledge and technology. Our guide invites us to conduct our first Mixed Reality experiment. Different floating elements appear around the user inviting them to interact and, using their fingers to "drag and drop", match pairs of those elements; a small exercise that will surprise users.

Once the elements are matched, our guide invites us to visit the totem to view content related to the city. This is a great way to connect with the city's knowledge through an interactive explanation, complemented by unique visuals for the users.

— 2.3. CAMBRIDGE CORN EXCHANGE

As we begin this capsule, our guide suggests that we observe and listen to this legendary space. She asks us to pay close attention, and at that precise moment, the entire room fills with energy balls. These balls emit small particles, as if it was energy trying to connect with us. They vary in size: some are small while others are massive, gigantic balls floating throughout the room. Our guide encourages us to "chase" those balls, and the user observes that the most interesting ones are the gigantic ones, which tend to move upwards, disappearing into the ceiling as if they were large balloons. Our guide suggests that we use our hands to attract the energy objects. The user discovers that through hand gestures, they can slowly lower a ball. Upon reaching eye level, the energy dissipates from the ball, covering the totem and giving way to unique content about the history of the Corn Exchange, while letting the user uncover the different singular moments of the room.

— 2.4. ARCHITECTURE

At the start of this capsule, a unique building appears above the current stand-shaped structure. Our guide accompanies us, providing explanations about the displayed building. She indicates that with our hands, we can rotate or even scale the building to get a better view of what we're observing. We'll pass over different buildings and singular constructions in the city. It's a different way to understand the relevance of the city's architecture, grasping the various constructional and architectural aspects, all through a virtual but large-scale 3D perspective. Finally, our guide asks us to gather in the center of the room where our totem displays different blocks of construction stone, challenging us to build the iconic Mathematical Bridge, a perfect way to conclude this capsule by recalling Isaac Newton and combining history, knowledge, and technology from past and present.

— 2.5. MUSIC

We conclude with a very special capsule for the city and specifically for this legendary space. Our guide informs us that the entire room has transformed into a large musical instrument. The 5 stand-shaped structures and the totem interconnect to become a single musical instrument, similar to a DJ controller, providing a combination of energy, rhythm, and music from different musical groups that have played at the venue. Our guide suggests that we experiment, move around the room, and activate the different "musical notes" to create our own piece. Upon finishing our musical experiment, we culminate in the area of the totem with a compilation of the best moments lived at the venue.

— 3. FINAL

Our guide asks us to approach the totem. She thanks us for being part of this immersive experience about culture and knowledge. But before concluding, she requests that we sign our unique "hall of fame". Using our fingers, as if holding a black marker, we paint our virtual signature on the totem, leaving our mark on this virtual/physical space. It's a way to conceptualize that the memory of this immersive experience, just like in the real world, will persist forever at the Corn Exchange.

SPATIAL COMPUTING PROPOSAL

This Immersive experience requires the latest generation Mixed Reality glasses. This type of Mixed Reality refers to various human-computer interaction techniques perceived by users as occurring in the real world, in and around their natural bodies and physical environments, rather than confined to and perceived behind computer screens or tablets.

However, we want to make a special mention of the three unique elements that will be part of this experience:

— Multi-user interaction: Our unique user interactions will be shared in real-time among users. Users entering as a group can have a collective experience. All holograms are perceived as real elements in the room.

— Hand and finger interaction: This experience requires the user to use their hands and fingers to perform gestural actions that will make interaction very natural, similar to gestures made when using real objects.

— Exclusive asset creation > 5G connectivity: In the final part, the user will create this final and unique message. An asset that we will store on the server via 5G connectivity. This exclusive way enables users to create new elements available to the future community attending the experience.

ASSETS PROPOSAL

To make the proposed experience possible, we will have 15 Hololens2 glasses to support the proposed traffic of 15 people in a smooth circuit. The system includes 5 additional glasses to ensure the entry of new users and expedite the waiting queue, always ensuring 15 users are constantly circulating through the installation. Additionally, we equip the proposal with 2 additional glasses as "spares" to address any immediate incidents.

Server Assets for streaming video content and data persistence: We provide a server with 5G connectivity to download assets in real-time. The 15 glasses connect to the server to notify the current status of the device, position in the current capsule, and asset download requests. The same server will store all persistent data and will be updated with messages from all users.

EXPERIENCE TIMING: 19min.

Intro

Guide presentation

Tutorial

The City

of Cambridge

Corn Exchange

History

Architecture

Music

Ending

2min

1min

2min

3min

3min

3min

3min

2min

GLASSWORKS

LA PEDRERA 'MAGICAL VISION'

From concept design and script to software, coding and visual development – we delivered an entire Mixed Reality experience for La Pedrera, the iconic building by Antoni Gaudí. 

Wearing the Microsoft HoloLens 2 glasses, the visitor can explore a previously closed-off floor of the magnificent 1910s building. The nonintrusive technology seamlessly integrates holograms with the actual physical space, ensuring that the monumental architecture remains the centre of attention. Additional features, such as the 3D audio, tie the experience to the space even more, increasing interaction and turning the visitors into more than simple spectators.

Finding the right balance between the expressive storytelling and the Mixed Reality technology was essential for creating a unique connection between visitors and building. Some of the elements featured in this permanent exhibition include a holographic window showing the historical context, sound seemingly coming out from an old radio, and the animals that inspired Gaudi fluttering around the space.

AUDI 'E-TRON ROOM: THE FUTURE PARADOX'

Xavi's Lab presented Audi's futuristic technology to the public through the world's most advanced hyper-reality experience, the 'e-tron room: the Future Paradox’. In this experience participants traveled through time, going through different challenges until they reach their final destination: the future.

To overcome the challenges, the participants were equipped with the latest technology, such as motion sensors and the VivePro virtual reality headset, which allowed the players' activity and the positions of different objects in the room to be transposed into the virtual world. The system has 36 cameras and 28 sensors in total. The algorithm created let recreates user physical pose to virtual avatar poses to allow a perfect confusion between reality and the virtual world of Audi’s Ambitious Mixed-Reality Game which pushed the limits of Branded VR.

FUNDACIÓ LA CAIXA 'SYMPHONY'

Symphony is an immersive audiovisual experience that takes spectators on a journey through emotions and music. Guided by the great conductor Gustavo Dudamel and the prestigious Mahler Chamber Orchestra, spectators can experience and understand music as never before.

The project widens the access to classical music through a unique combination of creativity and technology. 360° headsets coupled with 3D sound transport the spectators to the heart of music, entering the interior of an instrument or joining the musicians in the orchestra.

At Glassworks, we created and directed the computer graphics and visual effects, bringing the magic of classical music closer to all audiences.