Multi-view video capture enables us to capture information about the 3D scene and human motion that is challenging to capture with marker-based mocap. For example, we capture facial expressions, hand-object interaction, and the movement of clothing.

Our custom multi-camera system consists of 16 cameras, produced by IOI Industries, each with a maximum resolution of 12 megapixels, all controlled through 4 FPGA-base DVR recorders with a recording rate of 2240MB/s and a capacity of 88TB. The system provides multiple interfaces for synchronization and integration: TTL, LTC, IRIG and GPS (for large distance applications outdoors). To support various configurations of the cameras, we have a collection of high-quality prime lenses with a focal length range of 8mm to 50mm. Set up on tripods, the cameras can be used at any location, indoors and outdoors.

We also use the Multi-Camera Setup integrated within our Motion Capture facility. Here we precisely calibrate and synchronize the video system with the mocap system and with other capture equipment. This unique combination allows us to capture high-resolution multi-camera footage and consistently track motion capture markers as small as 3 mm in diameter simultaneously, with frame-to-frame correspondence.

Together with Norka Automation, we developed a unique lighting solution that delivers 12K lux of light to the capture volume and enables data recording at a high frame rate while minimizing motion blur. The bright light is tolerable because we pulse it such that it is synchronized with the cameras’ shutter open times. The light setup is operating at a frequency of 240Hz, making the light appear dim and less disturbing to the human eye.