This paper presents the research results submitted to the MM-ArgFallacy2025 shared challenge. It aims to advance the research of multimodal argument mining focusing on logical fallacies in political debates. It uses a pre-trained Transformer-based model and suggests a context-exploiting method. In the error classification subtask, the macro F1 scores of text, audio, and multimodal models are 0.4444, 0.3559, and 0.4403, respectively. The multimodal model shows similar performance to the text-only model, suggesting the possibility of improvement.