Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

Synthetic History: Evaluating Visual Representations of the Past in Diffusion Models

Created by
  • Haebom

Author

Maria-Teresa De Rosa Palmini, Eva Cetinic

Outline

This paper presents a benchmark for evaluating the historical contextualization capabilities of text-to-image (TTI) diffusion models. Using the HistVis dataset, we evaluate how TTI models represent specific eras in terms of implicit stylistic associations, historical consistency, and demographic representation. Our results demonstrate that TTI models exhibit systematic inaccuracies in depicting historical topics, overuse certain styles, include anachronistic elements, and fail to reflect realistic demographic patterns.

Takeaways, Limitations

Takeaways:
Provides a reproducible benchmark to evaluate the historical representation accuracy of the TTI model.
We specifically identify the problems that arise when the TTI model describes historical topics and suggest ways to improve them.
It emphasizes the importance of developing a TTI model that takes historical context into account.
Limitations:
Limited to evaluation of three specific TTI models, generalizability may be limited.
Since it relies on a synthetic image dataset, there may be differences from real images.
Further review of the evaluation criteria and the objectivity and comprehensiveness of the dataset is needed.
👍