Sign In

How Far Are VLMs from Privacy Awareness in the Physical World? An Empirical Study

์ž‘์„ฑ์ž
  • Haebom
์นดํ…Œ๊ณ ๋ฆฌ
Empty

์ €์ž

Junran Wang, Xinjie Shen, Zehao Jin, Pan Li

๐Ÿ’ก ๊ฐœ์š”

๋ณธ ์—ฐ๊ตฌ๋Š” ๊ฐ€์ •์ด๋‚˜ ๋ณ‘์›๊ณผ ๊ฐ™์ด ์‹ค์ œ ๋ฌผ๋ฆฌ์  ํ™˜๊ฒฝ์—์„œ ์ž‘๋™ํ•˜๋Š” ๋น„์ „-์–ธ์–ด ๋ชจ๋ธ(VLM)์˜ ํ”„๋ผ์ด๋ฒ„์‹œ ์ธ์‹ ๋Šฅ๋ ฅ์„ ํ‰๊ฐ€ํ•˜๋Š” ๊ฒƒ์ด ์ค‘์š”ํ•˜๋‹ค๊ณ  ๊ฐ•์กฐํ•ฉ๋‹ˆ๋‹ค. ๊ธฐ์กด์˜ ํ…์ŠคํŠธ ๊ธฐ๋ฐ˜ ํ‰๊ฐ€ ๋ฐฉ์‹์˜ ํ•œ๊ณ„๋ฅผ ๊ทน๋ณตํ•˜๊ธฐ ์œ„ํ•ด, ํ˜„์‹ค์ ์ธ ๋ฌผ๋ฆฌ์  ํ™˜๊ฒฝ์„ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ํ•˜๋Š” ๋Œ€ํ™”ํ˜• ์‹œ์ฒญ๊ฐ ํ‰๊ฐ€ ํ”„๋ ˆ์ž„์›Œํฌ์ธ ImmersedPrivacy๋ฅผ ์ œ์•ˆํ•ฉ๋‹ˆ๋‹ค. ์ด ํ”„๋ ˆ์ž„์›Œํฌ๋Š” 12๊ฐœ์˜ ์ตœ์‹  VLM ๋ชจ๋ธ์„ ํ‰๊ฐ€ํ•œ ๊ฒฐ๊ณผ, ๋ณต์žกํ•œ ์žฅ๋ฉด ์ธ์‹, ์‚ฌํšŒ์  ๋งฅ๋ฝ ์ ์‘, ๋ช…๋ น ์ถฉ๋Œ ํ•ด๊ฒฐ ๋“ฑ์—์„œ ์ผ๊ด€๋œ ๋ถ€์กฑํ•จ์„ ๋ฐœ๊ฒฌํ–ˆ์Šต๋‹ˆ๋‹ค.

๐Ÿ”‘ ์‹œ์‚ฌ์  ๋ฐ ํ•œ๊ณ„

โ€ข
VLM์€ ๋ณต์žกํ•œ ๋ฌผ๋ฆฌ์  ํ™˜๊ฒฝ์—์„œ ๋ฏผ๊ฐํ•œ ์ •๋ณด๋ฅผ ์ธ์ง€ํ•˜๊ณ  ์ฒ˜๋ฆฌํ•˜๋Š” ๋ฐ ์žˆ์–ด ์ธ์‹์  ์ทจ์•ฝ์„ฑ์„ ๋ณด์ด๋ฉฐ, ํ”„๋ผ์ด๋ฒ„์‹œ ๊ด€๋ จ ์ง€์‹์ด ์‹ค์ œ ํ–‰๋™์— ๋ฏธ์น˜๋Š” ์˜ํ–ฅ์ด ์ œํ•œ์ ์ž…๋‹ˆ๋‹ค.
โ€ข
ํ˜„์žฌ VLM์€ ํ”„๋ผ์ด๋ฒ„์‹œ ๊ด€๋ จ ํ•™์Šต ๋‚ด์šฉ์„ ์‹ค์ œ ์ƒํ™ฉ์— ์ ์šฉํ•˜์—ฌ ํ–‰๋™์„ ์ œ์–ดํ•˜๋Š” ๋ฐ ์–ด๋ ค์›€์„ ๊ฒช๊ณ  ์žˆ์œผ๋ฉฐ, ์‚ฌํšŒ์  ๋งฅ๋ฝ ๋ณ€ํ™”์— ๋Œ€ํ•œ ์ ์‘๋ ฅ ๋˜ํ•œ ๋ถ€์กฑํ•ฉ๋‹ˆ๋‹ค.
โ€ข
ํ–ฅํ›„ ์—ฐ๊ตฌ์—์„œ๋Š” VLM์˜ ์ธ์‹ ๋Šฅ๋ ฅ ํ–ฅ์ƒ๊ณผ ํ”„๋ผ์ด๋ฒ„์‹œ ์ œ์•ฝ ์กฐ๊ฑด์„ ๊ณ ๋ คํ•œ ํ–‰๋™ ๊ฒฐ์ • ๋ฉ”์ปค๋‹ˆ์ฆ˜ ๊ฐœ๋ฐœ์— ์ดˆ์ ์„ ๋งž์ถฐ์•ผ ํ•ฉ๋‹ˆ๋‹ค.
๐Ÿ‘
Made with Slashpage