Sign In

Vision-Based Hand Shadowing for Robotic Manipulation via Inverse Kinematics

์ž‘์„ฑ์ž
  • Haebom
์นดํ…Œ๊ณ ๋ฆฌ
Empty

์ €์ž

Hendrik Chiche, Antoine Jamme, Trevor Rigoberto Martinez, Gabriel Gomes

๐Ÿ’ก ๊ฐœ์š”

๋ณธ ์—ฐ๊ตฌ๋Š” ๋‹จ์ผ RGB-D ์นด๋ฉ”๋ผ๋ฅผ ํ™œ์šฉํ•˜์—ฌ ์ธ๊ฐ„์˜ ์† ์›€์ง์ž„์„ ๋กœ๋ด‡ ๊ด€์ ˆ ๋ช…๋ น์œผ๋กœ ์žฌ๋งคํ•‘ํ•˜๋Š” ๋น„์ „ ๊ธฐ๋ฐ˜ ์† ์„€๋„์ž‰ ์—ญ๊ธฐ๊ตฌํ•™(IK) ํŒŒ์ดํ”„๋ผ์ธ์„ ์ œ์•ˆํ•ฉ๋‹ˆ๋‹ค. MediaPipe Hands๋ฅผ ํ†ตํ•ด 3D๋กœ ๋ณต์›๋œ ์† ๋žœ๋“œ๋งˆํฌ๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ ๋กœ๋ด‡์˜ SO-ARM101์— ๋Œ€ํ•œ ๊ด€์ ˆ ๋ช…๋ น์„ ์ƒ์„ฑํ•˜๋ฉฐ, ๋ฌผ๋ฆฌ ์‹œ๋ฎฌ๋ ˆ์ด์…˜์„ ํ†ตํ•ด ๋™์ž‘์„ ๋ฏธ๋ฆฌ ํ™•์ธํ•ฉ๋‹ˆ๋‹ค.

๐Ÿ”‘ ์‹œ์‚ฌ์  ๋ฐ ํ•œ๊ณ„

โ€ข
์ €๋น„์šฉ ๋กœ๋ด‡ ๋งค๋‹ˆํ“ฐ๋ ˆ์ดํ„ฐ๋ฅผ ์œ„ํ•œ ๋น„์ „ ๊ธฐ๋ฐ˜ ํ…”๋ ˆ์˜คํผ๋ ˆ์ด์…˜์˜ ๊ฐ€๋Šฅ์„ฑ์„ ๋ณด์—ฌ์ค๋‹ˆ๋‹ค.
โ€ข
๋‹ค์–‘ํ•œ ํ™˜๊ฒฝ์—์„œ 86.7%์˜ ๋†’์€ ์„ฑ๊ณต๋ฅ ์„ ๋‹ฌ์„ฑํ•˜๋ฉฐ, ๊ธฐ์กด Vision-Language-Action (VLA) ์ •์ฑ… ๋Œ€๋น„ ๊ฒฝ์Ÿ๋ ฅ ์žˆ๋Š” ์„ฑ๋Šฅ์„ ์ž…์ฆํ–ˆ์Šต๋‹ˆ๋‹ค.
โ€ข
์†์ด ์ฃผ๋ณ€ ๊ฐ์ฒด์— ๊ฐ€๋ ค์ง€๋Š” ๊ฒฝ์šฐ(hand occlusion) ์„ฑ๊ณต๋ฅ ์ด ๊ธ‰๊ฒฉํžˆ ๊ฐ์†Œํ•˜๋Š” ํ•œ๊ณ„๊ฐ€ ์žˆ์œผ๋ฉฐ, ์ด๋ฅผ ๊ฐœ์„ ํ•˜๊ธฐ ์œ„ํ•ด WiLoR๊ณผ ๊ฐ™์€ ๋Œ€์ฒด ์† ํƒ์ง€๊ธฐ ํ†ตํ•ฉ์„ ํƒ์ƒ‰ํ–ˆ์Šต๋‹ˆ๋‹ค.
๐Ÿ‘
Made with Slashpage