This paper proposes TolerantECG, a noise-tolerant, operational-ready baseline model that addresses the issues of noise and lead absence in electrocardiogram (ECG) signals. Combining contrastive learning and self-supervised learning frameworks, TolerantECG learns ECG signal representations, corresponding knowledge-retrieval-based textual descriptions, and signals with damaged or missing leads. Experimental results demonstrate excellent performance across a variety of ECG signal conditions and class levels on the PTB-XL dataset and the MIT-BIH arrhythmia database.