Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

A Causal Framework for Aligning Image Quality Metrics and Deep Neural Network Robustness

작성자
  • Haebom

Author

Nathan Drenkow, Mathias Unberath

Outline

This paper addresses the significant impact of image quality on the performance of deep neural networks (DNNs). DNNs are widely known to be sensitive to changes in imaging conditions. While traditional image quality assessment (IQA) attempts to measure and align quality with human perceptual judgments, metrics that are sensitive to imaging conditions and also align well with DNN sensitivity are often needed. This paper first questions how informative existing IQA metrics are for DNN performance. We demonstrate theoretically and experimentally that existing IQA metrics are weak predictors of DNN performance for image classification. Using a causal framework, we develop metrics that exhibit strong correlations with DNN performance, enabling effective estimation of the quality distribution of large-scale image datasets for target vision tasks.

Takeaways, Limitations

Takeaways: We present a new image quality assessment metric with a strong correlation with DNN performance, demonstrating its ability to effectively estimate the quality distribution of large-scale image datasets. This overcomes the limitations of existing IQA metrics and presents a more effective method for predicting DNN performance.
Limitations: Further research is needed to determine the generalization performance of the proposed new metric and its applicability to various DNN architectures and tasks. In-depth discussion of the assumptions and limitations of the causal framework may be lacking. The results may be limited to specific vision tasks.
👍