To capture multiple people interacting, sports activities, or human interactions with 3D scenes, we exploit marker-based motion capture (mocap). This technology captures human movement at high frame rate and our capture volume allows us flexible movements.

Our facility contains a high-resolution optical motion capture system, with 54 Vicon V-16 cameras that are able to accurately track markers at above 500 Hz with a size as small as 3mm in diameter in a capture volume of 8x6x3m. The system provides us with accurate 3D locations of sparse markers that are strategically placed on the subject’s body to recover the original shape and pose of the body.

The facility offers the highest capture density in Europe, enabling us to capture multiple people, the facial motions, and hands motions simultaneously. The high number of cameras helps minimized problems due to occlusion.

To process the raw mocap data, we have developed custom, state-of-the-art, technologies to compute the parameters of a meshed statistical body model, SMPL, from the sparse markers. Our approach is able to extract realistic performances, including soft-tissue movement, without tedious manual "cleaning" of the data.

In addition to synchronizing the system with our multi-camera video system, we synchronize it with eye trackers and audio capture.