This paper emphasizes the importance of not only physical agility but also the ability to predict an opponent's intentions and secure reaction time for competitive table tennis. While previous studies have developed real-time table tennis game systems, they either lack predictive capabilities or are limited by the size and diversity of their datasets. This paper proposes (1) a scalable system for 3D reconstruction of monocular videos of table tennis matches and (2) an uncertainty-aware controller that predicts an opponent's actions. Simulation results show that the proposed policy improves the ball return rate for high-speed hits from 49.9% to 59.0% compared to existing non-predictive policies.