FR

Cinematographic · Interactive · Experiential · Augmented Reality

Life-size augmented reality cinema

A Miralupa division · Montreal & Québec City

CieAR put life-size, motion-captured 3D actors into real places and let visitors walk among them with a tablet or phone in hand. Part game, part cinema: you weren’t watching the story, you were standing in it.

Ahead of its time, and built for real rooms

In 2016, most mobile augmented reality meant a 3D logo floating over a printed page. CieAR set out to do something much harder: stage full scenes, with actors at human scale, perfectly aligned with the walls, doors and furniture of a real building, complete with spatial sound, on the phones and tablets people already owned.

The flagship: Necropolis: City of Ghosts

It is the turn of the 20th century, and you are in the middle of a criminal investigation. Your spectroscope (the tablet in your hands) reveals the ghosts around you and helps you solve the mystery surrounding the death of La Stilla, one of the most famous sopranos of the Belle Époque.

A story of ghosts and technology, driven by suspense and hard-boiled intrigue, that takes players through many locations over the course of a few hours. Each chapter can take place somewhere different: a theatre, a museum, a bank, a shopping mall, an office.

Necropolis scene: a man kneels over La Stilla on an opera stage Necropolis environment: a riveted iron cell door in a dim stone corridor La Stilla appears as a ghost, wrapped in smoke

Real footage, recorded on an iPad

It ran, for real: Phantasmagorie, Shawinigan

In 2019, Necropolis opened to the public as Phantasmagorie in Shawinigan, Québec. Visitors carried an iPad through a real church and a real theatre, and the ghosts appeared exactly where the story needed them: by the altar, in the pulpit, behind the bars of a cell.

The real church in Shawinigan, empty
The church, as it really is
An iPad held in the same church shows La Stilla's blue ghost beside the altar
The same church through the iPad: La Stilla appears

One minute inside Phantasmagorie

The game starting up, La Stilla at the altar, Jeanne behind the asylum bars and the priest in his floating pulpit. Short excerpts from recordings made on site, joined together, with no added effects.

Meet the cast

Each character was played by a real actor, captured and rebuilt in 3D. The cast also lived on a deck of augmented reality cards: point a phone at a card and its character steps out.

Card: La Stilla Card: The Barron Card: One Mad Scientist Card: Jealous Ex Lovers Card: See Ghostly Apparitions Card: The Mechanism Behind

How it worked

Visitors used a phone, a tablet or video glasses. Arriving at certain spots, they saw life-size 3D characters appear around them in a fully animated scene, placed in real space and lined up with the real objects in the room.

Characters could stand behind a real doorway, sit in a real chair or point at a real painting on the wall, and they stayed there as you walked around them.

A visitor's tablet shows La Stilla standing in a real room lined with portraits

Life-size characters

Real actors, captured in motion and recreated in 3D at human scale.

Locked to the real place

Miralupa’s MARGE™ platform aligned every virtual element precisely with the real venue, in real time.

Many locations, one story

Geolocation triggered each chapter as players moved from one venue to the next.

Sound and language

Spatialized audio placed voices where the characters stood, and the platform supported multilingual experiences.

A platform, not just one show

Museums, cities, event organizers, theme parks and film studios could personalize and build on the CieAR platform to create new revenue streams and give new life to the places and stories they already had.

Watch the City of Ghosts platform video >

Real venues considered for the experience: a stone manor and a timber-framed hall set up as a stage

How it was made

CieAR brought together people from games, film and design, and combined motion-captured real actors with real-time graphics. Every step of the pipeline was done in-house or with Québec partners.

An artist's hand sketching a character design01

Story & concept art

Script, characters and sets designed by hand before anything was built in 3D.

Two actors in motion-capture suits on a capture stage02

Performance capture

Actors performed every scene on a full-body motion-capture stage.

Director and actress reviewing a facial-capture take03

Faces & voices

Facial capture and studio voice recording kept every expression and line of dialogue.

An actor in costume inside a photogrammetry camera rig04

3D scanning

Photogrammetry rigs scanned actors in costume so their 3D doubles looked like them.

Behind the scenes

From the motion-capture stage to the tablet. 1 min.

The process, as shown at SXSW

Voice, face and body capture in 40 seconds.

The artwork

Sculpting the characters and props, from sketch to 3D. 1 min 40.

Augmented reality storytelling

The experience, filmed on real tablets in real rooms. 40 sec.

Where CieAR went

In the news

Links open archived copies on the Internet Archive, since some of the original pages are no longer online.

What CieAR proved

Life-size performances, locked to real rooms, running on the devices in people’s pockets. CieAR showed that years before it became commonplace.

The division is gone, but the know-how isn’t. The precise alignment, tracking and live-character pipeline CieAR pushed forward lives on in MARGE™ and in Miralupa’s work today, from museums and events to retail and the operating room.

Bring a story to life

A tablet held over a red carpet shows a fully furnished virtual laboratory with a seated character

Reach out

Have a museum, festival, venue or story that deserves to come to life? Send us a message and get the conversation started.

Prefer email? info@miralupa.com

MIRALUPA INC.
MONTREAL + QUÉBEC CITY – CANADA
info@miralupa.com
514 552-1512