Sign In

PlotChain: Deterministic Checkpointed Evaluation of Multimodal LLMs on Engineering Plot Reading

Created by
  • Haebom
Category
Empty

์ €์ž

Mayank Ravishankara

๐Ÿ’ก ๊ฐœ์š”

๋ณธ ๋…ผ๋ฌธ์€ ๊ณตํ•™์šฉ ํ”Œ๋กฏ์—์„œ ์ •๋Ÿ‰์  ๊ฐ’์„ ์ถ”์ถœํ•˜๋Š” ๋ฉ€ํ‹ฐ๋ชจ๋‹ฌ ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ(MLLMs)์„ ํ‰๊ฐ€ํ•˜๊ธฐ ์œ„ํ•œ ๊ฒฐ์ •๋ก ์  ๋ฒค์น˜๋งˆํฌ์ธ PlotChain์„ ์ œ์•ˆํ•ฉ๋‹ˆ๋‹ค. PlotChain์€ 15๊ฐœ์˜ ํ”Œ๋กฏ ๊ณ„์—ด๊ณผ 450๊ฐœ์˜ ๋ Œ๋”๋ง๋œ ํ”Œ๋กฏ์œผ๋กœ ๊ตฌ์„ฑ๋˜๋ฉฐ, ๊ฐ ํ•ญ๋ชฉ์€ ์•Œ๋ ค์ง„ ํŒŒ๋ผ๋ฏธํ„ฐ์—์„œ ์ƒ์„ฑ๋˜๊ณ  ์ •ํ™•ํ•œ ์ •๋‹ต๊ณผ ์Œ์„ ์ด๋ฃน๋‹ˆ๋‹ค. ์ฃผ์š” ๊ธฐ์—ฌ๋Š” ์ฒดํฌํฌ์ธํŠธ ๊ธฐ๋ฐ˜ ์ง„๋‹จ ํ‰๊ฐ€๋กœ, ์ค‘๊ฐ„ ๋‹จ๊ณ„์˜ ํ•˜์œ„ ๊ธฐ์ˆ ์„ ๋ถ„๋ฆฌํ•˜์—ฌ ์‹คํŒจ ์ง€์ ์„ ํŒŒ์•…ํ•  ์ˆ˜ ์žˆ๋„๋ก ํ•ฉ๋‹ˆ๋‹ค.

๐Ÿ”‘ ์‹œ์‚ฌ์  ๋ฐ ํ•œ๊ณ„

โ€ข
PlotChain์€ MLLMs์˜ ๊ณตํ•™ ํ”Œ๋กฏ ํ•ด์„ ๋Šฅ๋ ฅ์„ ์ •๋Ÿ‰์ ์ด๊ณ  ๊ฒฐ์ •๋ก ์ ์œผ๋กœ ํ‰๊ฐ€ํ•  ์ˆ˜ ์žˆ๋Š” ์ƒˆ๋กœ์šด ๋ฒค์น˜๋งˆํฌ๋ฅผ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.
โ€ข
์ฒดํฌํฌ์ธํŠธ ๊ธฐ๋ฐ˜ ํ‰๊ฐ€๋Š” ๋ชจ๋ธ์˜ ํŠน์ • ํ•˜์œ„ ๊ธฐ์ˆ ๋ณ„ ์„ฑ๋Šฅ์„ ์ง„๋‹จํ•˜๊ณ  ๊ฐœ์„  ๋ฐฉํ–ฅ์„ ์ œ์‹œํ•˜๋Š” ๋ฐ ์œ ์šฉํ•ฉ๋‹ˆ๋‹ค.
โ€ข
ํ˜„์žฌ ๋ชจ๋ธ๋“ค์€ ์ฃผํŒŒ์ˆ˜ ์˜์—ญ ์ž‘์—…(๋Œ€์—ญํญ ์‘๋‹ต, FFT ์ŠคํŽ™ํŠธ๋Ÿผ)์—์„œ ์—ฌ์ „ํžˆ ์ทจ์•ฝ์„ฑ์„ ๋ณด์ด๋ฉฐ, ์ด๋Š” ํ•ด๋‹น ๋ถ„์•ผ์˜ MLLM ๋ฐœ์ „์— ๋Œ€ํ•œ ๊ณผ์ œ๋ฅผ ์‹œ์‚ฌํ•ฉ๋‹ˆ๋‹ค.
๐Ÿ‘
Made with Slashpage