Augmented reality, 3D measurement, and thermal imagery for computer-assisted manufacturing

One of the challenges in high-precision manufacturing is constant inspection as well as efficient communication of the inspection results to the workers. In this context, we are presenting a multi-modal 3D imaging system designed for computer-assisted assembly manufacturing using augmented reality. The three-dimensional measurement subsystem is a structured-light system based on a digital micro-mirror device (DMD). The augmented reality imagery is displayed on the components being manufactured using another DMD-based color projector that uses wavelengths that do not interfere with the 3D measurements. A thermal camera is also part of the system and calibrated with respect to the measurement and projection subsystems. In typical target usage, the system can display localized shape deviation with respect to nominal values, or the surface temperature across the component, or any information obtained or derived from the subsystems. Moreover, it can be used to display assembly instructions and validate the compliance of the final manufactured component.