Fracture IO

This year’s The One Show after party in New York included Fracture.io, an installation experience allowing guests to enter the digital space, using Microsoft Kinect technology to to scan partygoers and generate beautifully abstracted, full body 3D renderings.

Fracture IO Installation


Fracture.io took the form of a 12x16ft room (built with fabrication and AV partner SenovvA) with four Microsoft Kinects aimed at the center, where guests were invited to pose for the cameras. An OpenFrameworks application, designed by MPC Digital, was used instantly capture full image and depth data. A custom modified version of PCL then stitched this data into a smooth mesh and calculated the normal – a scanning solution that allowed the team to dial exposure time up or down, more effectively balancing accuracy and speed.

Fracture IO Installation

Once the mesh was created, it could be used as the basis for generative 3D visualizations of guests’ forms. The mesh could then be imported into Unity, which wrapped the form in splines bearing custom 3D objects. All of this occurred near instantaneously, displayed on massive screens both within and outside of the booth. On these screens the camera panned over the guest’s form and surrounding environment, utilizing a custom dynamic rack focus system driven by the same sort of 3×3 matrix found in high-end autofocus cameras. The end result is an animated generative artwork of both striking precision and abstract beauty.

Fracture IO Installation

Animations and meshes were then exported and automatically assigned unique URLs on the Fracture.io website gallery, allowing guests to view and share their portraits.

Credits

The Fracture IO booth was commissioned by JWT, New York, and produced at MPC Digital, New York, by creative director David Estis, technical director Adam Chapman, executive producer Tim Dillon, managing director Justin Lane, developers Aaron Meyers (Unity, OpenFrameworks), Jeff Crouse (OpenFrameworks, Python, Network, Web Server) and Will Adams (javaScript), designers Will Adams, Colin Hess, Tim Regan, modelers Stu Schwartz, Colin Hess. AV and fabrication was by SenovvA. Production was supported by Claudia Guevara, Alliah Morad, Ariella Amrami, Lindsey Neyman. Editor was Adam Epstein. Filming was shot by Sean Mattison and Reginald Emvula.

Filed under: Ambient, Interactive

Tagged: , ,

Location: