Bullinger S. Image-Based 3D Reconstruction of Dynamic Objects...2019 torrent

Textbook in PDF format

Computing three-dimensional reconstructions of dynamic scenes is one of the fundamental problems in computer vision. For many applications this task can be reduced to the determination of three-dimensional object motion trajectories w.r.t. mainly static environment structures. This approach simplifies the reconstruction problem by constraining projective ambiguities of different scene components.
Image-based reconstruction approaches such as Multibody Structure from Motion (MSfM) represent an appealing choice to reconstruct dynamic scenes given suitable conditions like sufficiently textured surfaces and non-degenerated camera trajectories. The underlying assumption of MSfM is that the scene may be represented by a multibody system, i.e., that the scene consists of multiple non-deformable components, which may undergo independent translational and rotational displacements.
Existing MSfM approaches use epipolar constraints or motion segmentation to determine component specific feature correspondences to reconstruct independently moving components. Such methods are agnostic to semantics and fail in certain scenarios like stationary or parallel moving objects. It is difficult to identify capabilities and limitations of existing approaches, because of the lack of image-based dynamic object reconstruction baseline algorithms and benchmark datasets