AmpLyze is a novel model that predicts the erythrocyte hemolysis 50 (HC50) value of antimicrobial peptides (AMPs) solely based on sequence information and accounts for residues that induce hemotoxicity. Unlike existing models that simply classify AMPs as "toxic" or "non-toxic," AmpLyze quantitatively predicts actual HC50 values. It combines residue-level ProtT5/ESM2 embeddings with sequence-level descriptors to construct local and global branches, aligns them through a cross-attention module, and trains them using a log-cosh loss function. The optimized AmpLyze model achieves a PCC of 0.756 and an MSE of 0.987, outperforming existing regression models and state-of-the-art models. Ablation experiments demonstrate that both branches are essential, with cross-attention providing additional performance improvements. Expected-Gradients attribution identifies known toxicity hotspots and suggests safer substitutions. AmpLyze accelerates AMP design by converting hemolysis assessments into quantitative, sequence-based, and interpretable predictions, providing a practical tool for early-stage toxicity screening.