计算机科学
点云
人工智能
计算机视觉
迭代重建
计算机图形学(图像)
导播室
三维重建
帧速率
电信
作者
Hirofumi Morioka,Teruhisa Misu,Taichi Suginoshita,Hideki Mitsumine
出处
期刊:IEEE Transactions on Broadcasting
[Institute of Electrical and Electronics Engineers]
日期:2023-03-01
卷期号:69 (1): 2-9
被引量:1
标识
DOI:10.1109/tbc.2022.3210367
摘要
Many studies have been conducted on the 3D reconstruction of subjects using multiple fixed cameras. Accepting the trade-off between the number of cameras and reconstruction quality, our studio is designed to capture high-quality models of one or two subjects for TV program use. Several cameras are mounted on a hemispherical dome with the stage in the center and a cloth cover on the frame for chroma-keying. The optimal camera numbers and placements for reconstruction were determined by simulation, and the 3D reconstruction was performed as a point cloud by a combination of visual hull and stereo matching. The quality was still not high enough, however, so we also added a surface light field to the point cloud to obtain the weighted average of rays from camera images close to the viewpoint. In the final stage, the images were then combined to the video, and errors generated during the reconstruction were compensated for by use of a deep neural network (DNN) for video translation. An offline processing studio has been built as a preliminary step towards real-time processing, and the reconstructed 3D images have been evaluated subjectively for a number of subjects. These studies confirm the effectiveness of this studio design.
科研通智能强力驱动
Strongly Powered by AbleSci AI