This paper evaluates the performance of specialized multi-task optimizers (SMTOs) and reexamines their utility through comparative analysis with the uniform loss function. Addressing criticisms raised in previous studies that SMTOs overestimate their performance due to a lack of proper hyperparameter optimization and regularization, we conduct extensive experimental evaluations using more complex multi-task problems. Our results demonstrate that while SMTOs outperform the uniform loss function in some cases, the uniform loss function can also achieve comparable performance to SMTOs. Specifically, we analyze why the uniform loss function achieves comparable performance to SMTOs in some cases. The source code is publicly available.