Since the start of Mercedes-Benz interactive showrooms I have led development of digital solutions for retail stores, popup shops and events.
Working with a hardware and remote-management partner, we deployed offline solutions to over 130 outlets — configurators, product education, digital brochures, car search and campaign content, kept current with as much automation as possible.
Most builds ran in Chromium on a custom JavaScript OOP framework (HTML5, Node.js, Handlebars, OpenCV, Express, WebSockets, Canvas, Web Audio and DMX lighting).
Research and Development
We have always strived to deliver engaging and innovative solutions to Mercedes-Benz to enhance showroom experience, below are some some examples using various technologies.
Clear screen
For an interactive window display I experimented with back projection onto a glass window fitted with a touch foil allowing users to treat the window are as an input device, In the example to the left you will see the projector pointing to the glass, this was well worth doing however this approach comes with logistical headaches, more than others. For example lighting conditions determine the clarity, mounting the projector will not always be feasible and using the touch fold will have restricted sizes. This solution may not have gone out to retailers but was used in office spaces.
3D Car configurator with Web sockets
In this demonstration I have developed a simple 3D interactive car configurator developed using THREE.js, I obtained a 3D model of the AMG GT Coupé and made some modification in 3DMax, mainly removing unseen geometry, grouping meshes, creating materials and naming them logically. I set up a Node Express server which hosted the views and created routes to the controller and the views.
This demo was a proof of concept demonstrating how we can control content on a video wall from different touch points within a retail showroom. To interact with the viewing angle a leap motion controller was used which is not shown in this video.
Interior Tour Example
Here is a preview of an interior tour example developed inline with an interactive feature in some of the Mercedes-Benz iOS app. This was developed with THREE.js and designed to run across multiple devices and used on the national website and to run in kiosk mode. The kiosk mode feature would be activated when the app became idle for a set interval. Once active, it would go through each feature hotspot and animate the camera to point at that feature, then launch the feature viewer. All the content including imagery and data is loaded dynamically so this feature can be templated and used across other model ranges.
The demo was packed with features including a VR mode for google cardboard or any VR headset, device motion control for a for tablet viewing, I had referred back to this project for many other future projects I developed at Your Favourite Story.
Phillips Hue & DMX Controllers
Here is a demonstration showing how I’ve integrated ambient lighting into one of the Mercedes-Benz POS projects for the Dream Car range. In this example I am using a Phillips Hue lighting controller and animating the hues from one to another. We later moved on to use more industry standard DMX controller and developed a server to receive HTTP requests to change the hue and animate the lighting.
AR Fun
Here are few few screenshots from some texture and lighting experiments with ARKit.
Lewis Hamilton AR demo
This is a work in progress demo developing an idea for a AR feature for an interactive Pop up. I purchased some model assets from Turbosquid and made some geometry modifications and optimisations in 3D Studio max, we modified the textures so they were up to date with the latest outfit Lewis is using. I then used Maximo to apply motion capture data to our geometry, something inline with Lewis jumping off the F1 car. This model was then imported to SceneKit in XCode and finalised the preparation for use in our AR scene, this work is part of a series of AR experiences.