Sign In

AQUA-Bench: Beyond Finding Answers to Knowing When There Are None in Audio Question Answering

Created by
  • Haebom
Category
Empty

μ €μž

Chun-Yi Kuan, Hung-yi Lee

πŸ’‘ κ°œμš”

κΈ°μ‘΄ μ˜€λ””μ˜€ μ§ˆμ˜μ‘λ‹΅ λ²€μΉ˜λ§ˆν¬λŠ” λ‹΅λ³€ κ°€λŠ₯ν•œ μ§ˆλ¬Έμ— 치우쳐 μžˆμ–΄, μ˜€λ””μ˜€μ—μ„œ μ‹ λ’°ν•  수 μžˆλŠ” 닡변을 μΆ”λ‘ ν•  수 μ—†λŠ” "λ‹΅λ³€ λΆˆκ°€λŠ₯ν•œ" μ§ˆλ¬Έμ— λŒ€ν•œ 평가가 λΆ€μ‘±ν–ˆμŠ΅λ‹ˆλ‹€. 이λ₯Ό ν•΄κ²°ν•˜κΈ° μœ„ν•΄ λ³Έ μ—°κ΅¬λŠ” λ‹΅λ³€ λΆˆκ°€λŠ₯ν•œ μ‹œλ‚˜λ¦¬μ˜€λ₯Ό μ²΄κ³„μ μœΌλ‘œ ν‰κ°€ν•˜λŠ” AQUA-Benchλ₯Ό μ œμ•ˆν•˜λ©°, λͺ¨λΈμ˜ 신뒰성을 μΈ‘μ •ν•˜κ³  κ°•κ±΄ν•œ μ˜€λ””μ˜€-μ–Έμ–΄ μ‹œμŠ€ν…œ κ°œλ°œμ„ μ΄‰μ§„ν•©λ‹ˆλ‹€. μ‹€ν—˜ κ²°κ³Ό, λͺ¨λΈλ“€μ΄ λ‹΅λ³€ κ°€λŠ₯ν•œ μ§ˆμ˜μ—λŠ” λ›°μ–΄λ‚˜μ§€λ§Œ λ‹΅λ³€ λΆˆκ°€λŠ₯ν•œ μ§ˆμ˜μ—λŠ” 어렀움을 κ²ͺλŠ”λ‹€λŠ” 것을 보여주며 ν˜„μž¬ μ˜€λ””μ˜€-μ–Έμ–΄ μ΄ν•΄μ˜ μ‚¬κ°μ§€λŒ€λ₯Ό μ§€μ ν•©λ‹ˆλ‹€.

πŸ”‘ μ‹œμ‚¬μ  및 ν•œκ³„

β€’
μ˜€λ””μ˜€ μ§ˆμ˜μ‘λ‹΅ λͺ¨λΈμ˜ μ‹ λ’°μ„±κ³Ό 강건함을 ν‰κ°€ν•˜κΈ° μœ„ν•œ μƒˆλ‘œμš΄ 벀치마크 AQUA-Benchλ₯Ό μ œμ‹œν•©λ‹ˆλ‹€.
β€’
λͺ¨λΈμ΄ λ‹¨μˆœνžˆ 닡을 μ°ΎλŠ” 것을 λ„˜μ–΄, 닡이 μ—†μŒμ„ μΈμ§€ν•˜λŠ” λŠ₯λ ₯을 ν‰κ°€ν•˜λŠ” 것이 μ€‘μš”ν•¨μ„ μ‹œμ‚¬ν•©λ‹ˆλ‹€.
β€’
λ‹΅λ³€ λΆˆκ°€λŠ₯ν•œ μ‹œλ‚˜λ¦¬μ˜€μ— λŒ€ν•œ λͺ¨λΈμ˜ 어렀움을 λ“œλŸ¬λ‚΄λ©°, ν–₯ν›„ μ—°κ΅¬μ—μ„œ 이 뢀뢄을 보완해야 ν•  ν•„μš”μ„±μ„ μ œμ‹œν•©λ‹ˆλ‹€.
πŸ‘
Made with Slashpage