Soft Human–Machine Interface Sensing Displays: Materials and Devices

Abstract The development of human‐interactive sensing displays (HISDs) that simultaneously detect and visualize stimuli is important for numerous cutting‐edge human–machine interface technologies. Therefore, innovative device platforms with optimized architectures of HISDs combined with novel high‐performance sensing and display materials are demonstrated. This study comprehensively reviews the recent advances in HISDs, particularly the device architectures that enable scaling‐down and simplifying the HISD, as well as material designs capable of directly visualizing input information received by various sensors. Various HISD platforms for integrating sensors and displays are described. HISDs consist of a sensor and display connected through a microprocessor, and attempts to assemble the two devices by eliminating the microprocessor are detailed. Single‐device HISD technologies are highlighted in which input stimuli acquired by sensory components are directly visualized with various optical components, such as electroluminescence, mechanoluminescence and structural color. The review forecasts future HISD technologies that demand the development of materials with molecular‐level synthetic precision that enables simultaneous sensing and visualization. Furthermore, emerging HISDs combined with artificial intelligence technologies and those enabling simultaneous detection and visualization of extrasensory information are discussed.