Tech Core | CAPLA
I was the primary developer for this project with Tech Core and our client was Beth Weinstein from the College of Architecture, Planning and Landscape Architechture (CAPLA) at the University of Arizona. The purpose of this project was to create an Augmented Reality application running on a mobile browser which would allow users to explore a virtual landmark in real time.
I used a SLAM Engine to keep the augment in place as a person moves around and created a user interface with functions to adjust the saturation of the augment based on lighting conditions and surroundings as well as the ability to take pictures and record video within the application.
Click the video above to see the application in action. I used an API from a company called 8th Wall. Their library, which is a modified Three.js and Aframe library, allowed me to create easy-to-access WebAR applications and their Simultaneous Localization and Mapping (SLAM) engine was perfect for this purpose. The primary challenge was maintaining correct positioning and scale of the the 3D model.
Normally this kind of WebAR is meant for small scale 3D models and therefore, a good deal of calibration and optimization was involved both from the coding side and the 3D design side. Shout out to Sam Owen, a student from CAPLA who alongside Beth Weinstein designed the beautiful scale 3D model of the complex and Nick Bigalke, a former Tech Core intern who helped me with this project.
I modified 8th Wall's recenter component by doing a lot of testing to find the optimum setting as well as my own javascript function all of which was to ensure that the camera was identifying details from the ground surface properly and hence make the experience more lifelike. I created a simple javascript user interface complete with instructions in both English and French as this application was meant to be deployed in Paris (read background section for details). I used 8th Wall's camera pipeline to record video and take images and used Three.js and Aframe to change saturation of the 3D model.
You can find some of my other AR projects in my Github (linked below). I primarily like using 8th Wall's API, but have worked with Unity, AR.js, Zappar, and ARCore as well.
The landmark in question was the Centre d’Identification de Vincennes, an internment camp within Paris from the Algerian War period. This application brought the demolished complex back to life to raise awareness regarding it's grim past so that the unfortunate people who once occupied the site are not forgotten.
The location now houses an equestrian ground and since there are hardly any detailed images of the site, a good deal of research went into developing the 3D model led by Beth Weinstein. I believe such applications and their ease of access will help give tourists, curiuos visitors and researchers an amazing opportunity to experience forgotten historical landmarks across the world.
Official CIV Website Museum of the History of Immigration Article