Sign In

M$^2$-Miner: Multi-Agent Enhanced MCTS for Mobile GUI Agent Data Mining

Created by
  • Haebom
Category
Empty

์ €์ž

Rui Lv, Juncheng Mo, Tianyi Chu, Chen Rao, Hongyi Jing, Jiajie Teng, Jiafu Chen, Shiqi Zhang, Liangzi Ding, Shuo Fang, Huaizhong Lin, Ziqiang Dang, Chenguang Ma, Lei Zhao

๐Ÿ’ก ๊ฐœ์š”

๋ณธ ๋…ผ๋ฌธ์€ ๊ธฐ์กด์˜ ๋†’์€ ๋น„์šฉ, ๋‚ฎ์€ ๋ฐ์ดํ„ฐ ํ’ˆ์งˆ ๋ฐ ํ’๋ถ€ํ•จ ๋ถ€์กฑ ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ•˜๊ธฐ ์œ„ํ•ด ๋ชฌํ…Œ์นด๋ฅผ๋กœ ํŠธ๋ฆฌ ํƒ์ƒ‰(MCTS) ๊ธฐ๋ฐ˜์˜ ์ €๋น„์šฉ ์ž๋™ํ™” ๋ชจ๋ฐ”์ผ GUI ์—์ด์ „ํŠธ ๋ฐ์ดํ„ฐ ๋งˆ์ด๋‹ ํ”„๋ ˆ์ž„์›Œํฌ์ธ M$^2$-Miner๋ฅผ ์ œ์•ˆํ•ฉ๋‹ˆ๋‹ค. ์ด๋ฅผ ์œ„ํ•ด ์ถ”๋ก , ์กฐ์œจ, ํ‰๊ฐ€๋ฅผ ๋‹ด๋‹นํ•˜๋Š” ๋‹ค์ค‘ ์—์ด์ „ํŠธ ํ˜‘์—… ํ”„๋ ˆ์ž„์›Œํฌ๋ฅผ ๊ตฌ์ถ•ํ•˜๊ณ , ์˜๋„ ์žฌํ™œ์šฉ ์ „๋žต๊ณผ ์ ์ง„์  ๋ชจ๋ธ-์ธ-๋ฃจํ”„ ํ•™์Šต ์ „๋žต์„ ํ†ตํ•ด ๋ฐ์ดํ„ฐ ๋งˆ์ด๋‹ ํšจ์œจ์„ฑ๊ณผ ๋‹ค์–‘์„ฑ์„ ๋†’์˜€์Šต๋‹ˆ๋‹ค. ์‹คํ—˜ ๊ฒฐ๊ณผ, M$^2$-Miner๋กœ ๋งˆ์ด๋‹๋œ ๋ฐ์ดํ„ฐ๋กœ ๋ฏธ์„ธ ์กฐ์ •๋œ GUI ์—์ด์ „ํŠธ๊ฐ€ ๋ชจ๋ฐ”์ผ GUI ๋ฒค์น˜๋งˆํฌ์—์„œ ์ตœ์ฒจ๋‹จ ์„ฑ๋Šฅ์„ ๋‹ฌ์„ฑํ–ˆ์Šต๋‹ˆ๋‹ค.

๐Ÿ”‘ ์‹œ์‚ฌ์  ๋ฐ ํ•œ๊ณ„

โ€ข
์‹œ์‚ฌ์  1: MCTS ๊ธฐ๋ฐ˜์˜ ๋‹ค์ค‘ ์—์ด์ „ํŠธ ํ˜‘์—… ํ”„๋ ˆ์ž„์›Œํฌ๋Š” ๋ชจ๋ฐ”์ผ GUI ์—์ด์ „ํŠธ ๋ฐ์ดํ„ฐ ๋งˆ์ด๋‹์˜ ํšจ์œจ์„ฑ๊ณผ ํ’ˆ์งˆ์„ ํฌ๊ฒŒ ํ–ฅ์ƒ์‹œํ‚ฌ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
โ€ข
์‹œ์‚ฌ์  2: ์˜๋„ ์žฌํ™œ์šฉ ๋ฐ ์ ์ง„์  ๋ชจ๋ธ-์ธ-๋ฃจํ”„ ํ•™์Šต ์ „๋žต์€ ๋ฐ์ดํ„ฐ์˜ ํ’๋ถ€ํ•จ๊ณผ ๋งˆ์ด๋‹ ์„ฑ๊ณต๋ฅ ์„ ๋†’์ด๋Š” ํšจ๊ณผ์ ์ธ ๋ฐฉ๋ฒ•์ž…๋‹ˆ๋‹ค.
โ€ข
ํ•œ๊ณ„์  ๋˜๋Š” ํ–ฅํ›„ ๊ณผ์ œ: ์ œ์•ˆ๋œ ํ”„๋ ˆ์ž„์›Œํฌ์˜ ์ผ๋ฐ˜ํ™” ๊ฐ€๋Šฅ์„ฑ ๋ฐ ๋ณต์žกํ•œ GUI ํ™˜๊ฒฝ์—์„œ์˜ ์„ฑ๋Šฅ ๊ฒ€์ฆ์ด ํ•„์š”ํ•ฉ๋‹ˆ๋‹ค.
๐Ÿ‘