1ebec223e0dc2bae61ab96e74683707027f14aff891be72e495291dd316c30456508f100998a8ad6e1712569e9f978eec9a6fd3f


์ƒ์„ฑ ๋ชจ๋ธ์˜ ์žฅ์ , ์ด์ œ ์‹ค์ œ ๋ฌผ๋ฆฌํ•™์œผ๋กœ ๊ตฌํ˜„๋ฉ๋‹ˆ๋‹ค!

20๊ฐœ ์ด์ƒ์˜ ์—ฐ๊ตฌ์‹ค์ด ์ฐธ์—ฌํ•œ 24๊ฐœ์›”๊ฐ„์˜ ๋Œ€๊ทœ๋ชจ ์—ฐ๊ตฌ ํ˜‘๋ ฅ ๋์—, ๋ฒ”์šฉ ๋กœ๋ด‡ ๊ณตํ•™ ๋ฐ ๋ฌผ๋ฆฌ์  AI ์‘์šฉ ๋ถ„์•ผ๋ฅผ ์œ„ํ•œ ๋ฌผ๋ฆฌ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ํ”Œ๋žซํผ ๊ธฐ๋ฐ˜์˜ 4D ๋™์  ์„ธ๊ณ„ ์ƒ์„ฑ ์—”์ง„์„ ๊ณต๊ฐœํ•ฉ๋‹ˆ๋‹ค.

์ด ๋ฌผ๋ฆฌ ์—”์ง„์€ ์ˆœ์ˆ˜ Python์œผ๋กœ ๊ฐœ๋ฐœ๋˜์—ˆ์œผ๋ฉฐ, Isaac Gym ๋ฐ MJX์™€ ๊ฐ™์€ ๊ธฐ์กด GPU ๊ฐ€์† ์Šคํƒ๋ณด๋‹ค 10~80๋ฐฐ ๋น ๋ฅธ ์†๋„๋ฅผ ์ž๋ž‘ํ•ฉ๋‹ˆ๋‹ค. ์‹ค์‹œ๊ฐ„๋ณด๋‹ค ์•ฝ 43๋งŒ ๋ฐฐ ๋น ๋ฅธ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์†๋„๋ฅผ ์ œ๊ณตํ•˜๋ฉฐ, ๋‹จ์ผ RTX4090์—์„œ ์‹ค์ œ ์„ธ๊ณ„๋กœ ์ „์ด ๊ฐ€๋Šฅํ•œ ๋กœ๋ด‡ ์ด๋™ ์ •์ฑ…์„ ํ›ˆ๋ จํ•˜๋Š” ๋ฐ ๋‹จ 26์ดˆ๋ฐ–์— ๊ฑธ๋ฆฌ์ง€ ์•Š์Šต๋‹ˆ๋‹ค. (ํŠœํ† ๋ฆฌ์–ผ ์ฐธ์กฐ)

์ด ๋ฌผ๋ฆฌ ์—”์ง„ ๋ฐ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ํ”Œ๋žซํผ์€ https://github.com/Genesis-Embodied-AI/Genesis ์—์„œ ์™„์ „ํ•œ ์˜คํ”ˆ ์†Œ์Šค๋กœ ์ œ๊ณต๋ฉ๋‹ˆ๋‹ค. ์ƒ์„ฑ ํ”„๋ ˆ์ž„์›Œํฌ์— ๋Œ€ํ•œ ์ ‘๊ทผ ๊ถŒํ•œ์€ ๊ฐ€๊นŒ์šด ์‹œ์ผ ๋‚ด์— ์ ์ง„์ ์œผ๋กœ ํ™•๋Œ€๋  ์˜ˆ์ •์ž…๋‹ˆ๋‹ค.

์ตœ์ฒจ๋‹จ ๋ฌผ๋ฆฌ ์†”๋ฒ„๋ฅผ ํ†ตํ•ฉํ•˜์—ฌ ์ฒ˜์Œ๋ถ€ํ„ฐ ๊ตฌ์ถ•๋œ ํ†ตํ•ฉ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ํ”„๋ ˆ์ž„์›Œํฌ๋ฅผ ํ†ตํ•ด ๊ฐ€์ƒ ํ™˜๊ฒฝ์—์„œ ์‹ค์ œ์™€ ๊ฐ€์žฅ ๊ฐ€๊นŒ์šด ๋ฌผ๋ฆฌ ์„ธ๊ณ„๋ฅผ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ํ•  ์ˆ˜ ์žˆ๋„๋ก ํ•ฉ๋‹ˆ๋‹ค.

์ €ํฌ๋Š” ์ƒ์œ„ ์ˆ˜์ค€์˜ ์ƒ์„ฑ ํ”„๋ ˆ์ž„์›Œํฌ๋ฅผ ํ™œ์šฉํ•˜์—ฌ ๋ฌผ๋ฆฌ์  ์„ธ๊ณ„๋ฅผ ์ž์œจ์ ์œผ๋กœ ์ƒ์„ฑํ•˜๋Š” ๋ฒ”์šฉ ๋ฐ์ดํ„ฐ ์—”์ง„์„ ๊ตฌ์ถ•ํ•˜๊ณ ์ž ํ•ฉ๋‹ˆ๋‹ค. ์—ฌ๊ธฐ์—๋Š” ํ™˜๊ฒฝ, ์นด๋ฉ”๋ผ ์›€์ง์ž„, ๋กœ๋ด‡ ์ž‘์—… ์ œ์•ˆ, ๋ณด์ƒ ํ•จ์ˆ˜, ๋กœ๋ด‡ ์ •์ฑ…, ์บ๋ฆญํ„ฐ ์›€์ง์ž„, ์™„์ „ํ•œ ์ƒํ˜ธ์ž‘์šฉ์ด ๊ฐ€๋Šฅํ•œ 3D ์žฅ๋ฉด, ์˜คํ”ˆ ์›”๋“œ ๊ด€์ ˆํ˜• ์ž์‚ฐ ๋“ฑ ๋‹ค์–‘ํ•œ ํ˜•ํƒœ์˜ ๋ฐ์ดํ„ฐ๊ฐ€ ํฌํ•จ๋ฉ๋‹ˆ๋‹ค. ๊ถ๊ทน์ ์œผ๋กœ ๋กœ๋ด‡ ๊ณตํ•™, ๋ฌผ๋ฆฌ์  AI ๋ฐ ๊ธฐํƒ€ ์‘์šฉ ๋ถ„์•ผ๋ฅผ ์œ„ํ•œ ์™„์ „ ์ž๋™ํ™”๋œ ๋ฐ์ดํ„ฐ ์ƒ์„ฑ์„ ๋ชฉํ‘œ๋กœ ํ•ฉ๋‹ˆ๋‹ค.

์˜คํ”ˆ ์†Œ์Šค ์ฝ”๋“œ: https://github.com/Genesis-Embodied-AI/Genesis
ํ”„๋กœ์ ํŠธ ์›นํŽ˜์ด์ง€: https://genesis-embodied-ai.github.io




Nvidia๋Š” GPU ๊ฐ€์†์„ ๋กœ๋ด‡ ์‹œ๋ฎฌ๋ ˆ์ด์…˜์— ๋„์ž…ํ•˜์—ฌ CPU ๊ธฐ๋ฐ˜ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ๋Œ€๋น„ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์†๋„๋ฅผ 10๋ฐฐ ์ด์ƒ ํ–ฅ์ƒ์‹œ์ผฐ์Šต๋‹ˆ๋‹ค. ์ด๋Š” ๋Œ€๊ทœ๋ชจ GPU ๋ณ‘๋ ฌํ™” ์‹œ๋ฎฌ๋ ˆ์ด์…˜์„ ํ™œ์šฉํ•˜์—ฌ ์ˆ˜๋งŽ์€ ๋†€๋ผ์šด ๋กœ๋ด‡ ๊ธฐ์ˆ ์„ ํ˜„์‹คํ™”ํ–ˆ์Šต๋‹ˆ๋‹ค. ์ €ํฌ๋Š” ์—ฌ๊ธฐ์„œ ํ•œ ๋‹จ๊ณ„ ๋” ๋‚˜์•„๊ฐ€ ์†๋„๋ฅผ 10๋ฐฐ ๋” ๋Œ์–ด์˜ฌ๋ ธ์Šต๋‹ˆ๋‹ค. ์ฃผ๋ชฉํ•  ์ ์€ ์ด๋Ÿฌํ•œ ์†๋„ ํ–ฅ์ƒ์ด ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์ •ํ™•๋„์˜ ์†์‹ค ์—†์ด ๋‹ฌ์„ฑ๋˜์—ˆ๋‹ค๋Š” ๊ฒƒ์ž…๋‹ˆ๋‹ค.




์ €ํฌ๋Š” ๋‹ค์–‘ํ•œ ๋ฌผ๋ฆฌ์  ํ˜„์ƒ ์‹œ๋ฎฌ๋ ˆ์ด์…˜์„ ์ง€์›ํ•ฉ๋‹ˆ๋‹ค. ๋‹ค์–‘ํ•œ ์ตœ์ฒจ๋‹จ ๋ฌผ๋ฆฌ ์†”๋ฒ„(MPM, SPH, FEM, ๊ฐ•์ฒด, PBD ๋“ฑ)๋ฅผ ํ†ตํ•ฉํ•œ ํ†ตํ•ฉ ๋ฌผ๋ฆฌ ์—”์ง„์„ ์ฒ˜์Œ๋ถ€ํ„ฐ ๊ฐœ๋ฐœํ•˜์—ฌ ๊ฐ•์ฒด, ๊ด€์ ˆ์ฒด, ์ฒœ, ์•ก์ฒด, ์—ฐ๊ธฐ, ๋ณ€ํ˜•์ฒด, ๋ฐ•๋ง‰ ์žฌ๋ฃŒ, ํƒ„์„ฑ/์†Œ์„ฑ์ฒด, ๋กœ๋ด‡ ๊ทผ์œก ๋“ฑ ๊ด‘๋ฒ”์œ„ํ•œ ์žฌ๋ฃŒ ์‹œ๋ฎฌ๋ ˆ์ด์…˜์„ ์ง€์›ํ•ฉ๋‹ˆ๋‹ค.




์ €ํฌ๋Š” ์—ฐ์„ฑ ๊ทผ์œก ๋ฐ ์—ฐ์„ฑ ๋กœ๋ด‡๊ณผ ๊ฐ•์„ฑ ๋กœ๋ด‡ ๊ฐ„์˜ ์ƒํ˜ธ ์ž‘์šฉ์„ ํฌ๊ด„์ ์œผ๋กœ ์ง€์›ํ•˜๋Š” ์ตœ์ดˆ์˜ ํ”Œ๋žซํผ์ž…๋‹ˆ๋‹ค. ๋˜ํ•œ URDF์™€ ์œ ์‚ฌํ•œ ์—ฐ์„ฑ ๋กœ๋ด‡ ๊ตฌ์„ฑ ์‹œ์Šคํ…œ๋„ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.




์ €ํฌ์˜ ์ƒ์„ฑ ํ”„๋ ˆ์ž„์›Œํฌ๋Š” ๋กœ๋ด‡ ๊ธฐ์ˆ  ํ›ˆ๋ จ์„ ์œ„ํ•œ 3D ๋ฐ ์™„์ „ ์ƒํ˜ธ์ž‘์šฉ ์žฅ๋ฉด ์ƒ์„ฑ์„ ์ง€์›ํ•ฉ๋‹ˆ๋‹ค.




์ €ํฌ์˜ ์ƒ์„ฑ ์—์ด์ „ํŠธ๋Š” ๋กœ๋ด‡ ์ž‘์—…์„ ์ž์œจ์ ์œผ๋กœ ์ œ์•ˆํ•˜๊ณ , ํ™˜๊ฒฝ์„ ์„ค๊ณ„ํ•˜๊ณ , ๋ณด์ƒ ํ•จ์ˆ˜๋ฅผ ์ž‘์„ฑํ•˜๋ฉฐ, ๊ถ๊ทน์ ์œผ๋กœ ๋กœ๋ด‡ ์ •์ฑ…์˜ ์ž๋™ ์ƒ์„ฑ์„ ์ด๋Œ์–ด๋ƒ…๋‹ˆ๋‹ค.




์ €ํฌ์˜ ์ƒ์„ฑ ํ”„๋ ˆ์ž„์›Œํฌ๋Š” ๋กœ๋ด‡ ๊ณตํ•™์„ ๋„˜์–ด ์บ๋ฆญํ„ฐ ์›€์ง์ž„๊ณผ ๊ฐ™์€ ๋ฐ์ดํ„ฐ ์ƒ์„ฑ๋„ ์ง€์›ํ•ฉ๋‹ˆ๋‹ค.




์ €ํฌ์˜ GPU ๋ณ‘๋ ฌํ™” IK ์†”๋ฒ„๋Š” 2ms ์ด๋‚ด์— 10,000๊ฐœ์˜ Franka ํŒ”์— ๋Œ€ํ•œ IK๋ฅผ ๋™์‹œ์— ํ•ด๊ฒฐํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.




์ €ํฌ๋Š” ๋น„๋ณผ๋ก ์ถฉ๋Œ ์ฒ˜๋ฆฌ๋ฅผ ๊ธฐ๋ณธ์ ์œผ๋กœ ์ง€์›ํ•ฉ๋‹ˆ๋‹ค.




์ €ํฌ๋Š” ๋ฌผ๋ฆฌ์ ์œผ๋กœ ์ •ํ™•ํ•œ ์ด‰๊ฐ ๊ฐ์ง€ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ๋ชจ๋“ˆ์„ ์ง€์›ํ•ฉ๋‹ˆ๋‹ค: https://github.com/Genesis-Embodied-AI/DiffTactile (ํ–ฅํ›„ ๋ฆด๋ฆฌ์Šค์—์„œ ๋ฉ”์ธ ๋ธŒ๋žœ์น˜์— ํ†ตํ•ฉ๋  ์˜ˆ์ •์ž…๋‹ˆ๋‹ค.)

7ced9e36ebd518986abce8954e89706fa0



๋งˆ์ง€๋ง‰์œผ๋กœ, ์ €ํฌ๊ฐ€ ๋งŒ๋“  ๊ท€์—ฌ์šด ์ƒํ˜ธ์ž‘์šฉ ๋ฌผ๋ฆฌ ํ…ŒํŠธ๋ฆฌ์Šค ๊ฒŒ์ž„์ž…๋‹ˆ๋‹ค :)

์ง€๋‚œ 2๋…„๊ฐ„ ๋ชจ๋“  ๊ฒƒ์„ ๊ฐ€๋Šฅํ•˜๊ฒŒ ํ•ด์ค€ ๋†€๋ผ์šด ํ˜‘๋ ฅ์ž๋“ค๊ป˜ ๊ฐ์‚ฌ๋“œ๋ฆฝ๋‹ˆ๋‹ค! ๋ชจ๋“  ๋ถ„๋“ค์„ ์ผ์ผ์ด ์–ธ๊ธ‰ํ•  ๊ณต๊ฐ„์€ ์—†์ง€๋งŒ, ์ „์ฒด ํŒ€์—๊ฒŒ ํฐ ์ฐฌ์‚ฌ๋ฅผ ๋ณด๋ƒ…๋‹ˆ๋‹ค!

์˜คํ”ˆ ์†Œ์Šค ์ปค๋ฎค๋‹ˆํ‹ฐ์˜ ๋ชจ๋“  ๋ถ„๋“ค์„ ํ™˜์˜ํ•˜๋ฉฐ, ํ•จ๊ป˜ ์ €ํฌ์™€ ํ•จ๊ป˜ ๋งŒ๋“ค์–ด๋‚˜๊ฐ€๊ธฐ๋ฅผ ๋ฐ”๋ž๋‹ˆ๋‹ค!




1ebec223e0dc2bae61ab96e74683707027f14aff891be72e495f91d93f6c314f6180e21f8ad7f2635b90b84ae84b2b0283f6fc2df4