Markerless Motion Capture for Humans Through a Multi-UAV System

Capturing the motion of humans without any markers in a moving scene is a challenging issue. Typical methods, such as those based on fixed cameras or wearable sensors, have limits on the measurement range and the number of targets. Therefore, we propose a markerless motion capture technique to estimate the 3D pose of humans through a multi-UAV system. By utilizing the advantage of the large observation baselines between UAVs in the system, an algorithm to estimate the pose of airborne cameras and establish the sparse points cloud of background in overlapping view simultaneously was presented. A 3σ rule based on reprojection error is employed to eliminate the incorrect conjugate keypoint pairs, enhancing the precision of pose estimation for airborne cameras. To verify the accuracy of the developed technique, an indoor test was conducted to compare it with a commercial capture system, the results show that the average measurement error of the 3D joints of humans is less than 30mm. Furthermore, we demonstrate the feasibility of our approach in outdoor scenes, including multi-person scenarios and moving scenarios.