Martin Sanders, LEGO’s Director of Innovation took the stage to showcase LEGO’s integration with Apple’s new revelation of ARKit 2 during the 2018 World Wide Developers Conference in San Jose earlier this week. ARKit 2 is a platform that allows developers like LEGO to integrate shared experiences, bringing together a virtual experienced tied to a physical play set.

Martin showcased the physical Assembly Square Creator Modular Set as the main centrepiece. The ARKit featured integration into the LEGO Application detected the build and automagically built a virtual version of the Downtown Diner Modular and Brick Bank side by side with virtual sidewalks, grass and roads and other city accessories, combining the digital and physical set. The science behind it is about detecting and tracking where the real physical Assembly Square as a starting point and building everything else around with the capability to continuously track and update all players with the iPad as a navigation window into the virtual world.

The demonstration featured the ability to drop minifigures and vehicles into the virtual world and interact with other characters that come to life. The player would be expected to complete the gameplay given the pre-programmed scenarios.