This year’s The One Show after party in New York included Fracture.io, an installation experience allowing guests to enter the digital space, using Microsoft Kinect technology to to scan partygoers and generate beautifully abstracted, full body 3D renderings.
Fracture.io took the form of a 12x16ft room (built with fabrication and AV partner SenovvA) with four Microsoft Kinects aimed at the center, where guests were invited to pose for the cameras. An OpenFrameworks application, designed by MPC Digital, was used instantly capture full image and depth data. A custom modified version of PCL then stitched this data into a smooth mesh and calculated the normal – a scanning solution that allowed the team to dial exposure time up or down, more effectively balancing accuracy and speed.
Once the mesh was created, it could be used as the basis for generative 3D visualizations of guests’ forms. The mesh could then be imported into Unity, which wrapped the form in splines bearing custom 3D objects. All of this occurred near instantaneously, displayed on massive screens both within and outside of the booth. On these screens the camera panned over the guest’s form and surrounding environment, utilizing a custom dynamic rack focus system driven by the same sort of 3×3 matrix found in high-end autofocus cameras. The end result is an animated generative artwork of both striking precision and abstract beauty.
Animations and meshes were then exported and automatically assigned unique URLs on the Fracture.io website gallery, allowing guests to view and share their portraits.