This paper evaluates the performance of breast MRI image registration using a pre-trained base model on a large-scale image dataset. Unlike previous studies targeting rigid bodies or relatively simple structures (e.g., the brain, abdominal organs), we focused on image registration of highly deformable breast tissue. Using five pre-trained encoders—Dino-v2, SAM, MedSAM, SSLSAM, and MedCLIP—we performed breast image registration under various conditions, including year, sequence, modality, and lesion presence, and compared their performance. Our results show that base model-based algorithms, such as SAM, outperform existing algorithms in overall breast alignment performance, but struggle with aligning the fine structures of fibrous tissue. Furthermore, we found that additional pre-training or fine-tuning with medical or breast-specific images did not improve performance and, in some cases, actually reduced it. The code is publicly available.