Human feet exhibit a wide range of appearance changes due the complex deformations it can perform. Existing full body scanners fails to capture the feet accurately due to the limited number of cameras focused on the feet, in addition the bottom of the foot is not captured.

In order to study feet deformations, we recently installed a custom built 4D foot scanner built for us by 3dMD (Atlanta, GA), the system uses 10 pairs of stereo, including dedicated cameras capturing the bottom of the foot through glass in addition to custom speckle projectors. The speckle patterns allows accurate stereo reconstruction of the 3D shape and the subtle dynamic soft tissue deformation of the foot when in contact with a surface. With an even higher resolution compared to our full body scanner, we are able to obtain a more realistic digital reconstruction fitted to the smaller scale and complexity of the foot.

We use this unique data to build predictive models for the human feet deformation, these model allows us to reason about the state of the human foot in a myriad of settings such as 2D images and noisy 3D scans.