This paper investigates a deep learning framework that integrates geometric constraints for depth estimation and related vision tasks based on stereophotogrammetry. We introduce the history of stereophotogrammetry and existing shape estimation (Stereo) techniques dating back to the 1800s, and compare and analyze them with approaches that utilize deep learning without geometric modeling. In particular, we present a new taxonomy of geometric constraints used in state-of-the-art deep learning frameworks, and provide insightful observations and future research directions.