Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

The ML.ENERGY Benchmark: Toward Automated Inference Energy Measurement and Optimization

Created by
  • Haebom

Author

Jae-Won Chung, Jeff J. Ma, Ruofan Wu, Jiachen Liu, Oh Jun Kweon, Yuxuan Xia, Zhiyu Wu, Mosharaf Chowdhury

Outline

This paper presents the ML$.$ENERGY Benchmark, a benchmark tool for measuring the inference energy consumption of generative AI in real-world service environments. This benchmark was developed to address energy consumption, a frequently overlooked issue when building ML systems, and is based on four core design principles. The benchmark results, published in early 2025, measure the energy consumption of 40 widely used model architectures, demonstrating the impact of ML design choices on energy consumption and the energy savings achieved through automated optimization recommendations. The ML$.$ENERGY Benchmark is open source and can be easily applied to a variety of models and application scenarios.

Takeaways, Limitations

Takeaways:
Providing a measurement and analysis framework for energy consumption issues in generative AI services.
Analyzing the impact of ML model architecture and design choices on energy consumption.
Provides potential energy savings (up to 40% or more) through automated optimization recommendations.
Applicable to various models and scenarios through open source benchmarks.
Limitations:
Benchmark results may be limited to the model and environment at a specific point in time.
The accuracy and reliability of energy consumption measurements depend on the measuring equipment and settings.
The results presented in this paper are initial benchmark results and require continuous updates and improvements.
👍