https://nvlabs.github.io/genvs/

GeNVSGeNVSnvlabs.github.io


๊ทธ๋ฆฌ๊ณ  ์ € ์‚ฌ์ดํŠธ์— ๋“ค์–ด๊ฐ€๋ฉด ๋ณผ์ˆ˜์žˆ๋Š” ๋…ผ๋ฌธ์„


GPT4 32K์— ์š”์•ฝ์‹œ์ผœ๋‹ฌ๋ผ ํ•ด๋ด„



a04424ad2c06782ab47e5a67ee91766dc288f1ecd7acc5cebf13d1c75dd5d521cb6a4a726a71af3157bec542db

๋…ผ๋ฌธ ๋ณต์‚ฌํ•˜๊ณ  ๋ถ™์—ฌ๋„ฃ๊ธฐํ•œ๋‹ค์Œ์— ์š”์•ฝํ•ด์ค˜๋ผ๊ณ  ํ–ˆ๋Š”๋ฐ


26867ํ† ํฐ ์ณ๋จน์Œ



a04424ad2c06782ab47e5a67ee91766dc288f1ecd7acc5cebf13d1c753d2d0218ed70ce750a1af60e491f39bb79b

์ด๊ฑธ ์š”์•ฝํ•ด์ฃผ๋„ค? 32K ํผ ๋ฏธ์ณฃ๋‹ค....


์˜์–ด๋กœ ์š”์•ฝํ•ด๋‹ฌ๋ผ ํ–ˆ์„๋•


This paper presents a diffusion-based model for 3D-aware generative novel view synthesis from as few as a single input image. The proposed method incorporates geometry priors in the form of a 3D feature volume and neural rendering, which improves the ability to generate view-consistent novel renderings. The model is trained end-to-end and can handle both individual objects and complex scenes. Experiments on various datasets, including ShapeNet, Matterport3D, and Common Objects in 3D, demonstrate state-of-the-art results for novel view synthesis. The proposed method can generate realistic novel views with as little as a single input image and can autoregressively synthesize 3D-consistent sequences. The authors plan to make the code and pre-trained models available. ์ด๋ ‡๊ฒŒ ํ•ด์คŒ


deepl๋กœ ๋ฒˆ์—ญํ•ด๋ณด์ž๋ฉด



์ด ๋…ผ๋ฌธ์—์„œ๋Š” ์ตœ์†Œ ํ•˜๋‚˜์˜ ์ž…๋ ฅ ์ด๋ฏธ์ง€๋กœ 3D ์ธ์‹ ์ƒ์„ฑ ์‹ ๊ทœ ๋ทฐ ํ•ฉ์„ฑ์„ ์œ„ํ•œ ํ™•์‚ฐ ๊ธฐ๋ฐ˜ ๋ชจ๋ธ์„ ์ œ์‹œํ•ฉ๋‹ˆ๋‹ค. ์ œ์•ˆ๋œ ๋ฐฉ๋ฒ•์€ 3D ํ”ผ์ฒ˜ ๋ณผ๋ฅจ๊ณผ ์‹ ๊ฒฝ ๋ Œ๋”๋ง์˜ ํ˜•ํƒœ๋กœ ์ง€์˜ค๋ฉ”ํŠธ๋ฆฌ ์„ ํ–‰์„ ํ†ตํ•ฉํ•˜์—ฌ ๋ทฐ ์ผ๊ด€์„ฑ ์žˆ๋Š” ์ƒˆ๋กœ์šด ๋ Œ๋”๋ง์„ ์ƒ์„ฑํ•˜๋Š” ๊ธฐ๋Šฅ์„ ํ–ฅ์ƒ์‹œํ‚ต๋‹ˆ๋‹ค. ์ด ๋ชจ๋ธ์€ ์—”๋“œํˆฌ์—”๋“œ ๋ฐฉ์‹์œผ๋กœ ํ•™์Šต๋˜๋ฉฐ ๊ฐœ๋ณ„ ์˜ค๋ธŒ์ ํŠธ์™€ ๋ณต์žกํ•œ ์žฅ๋ฉด์„ ๋ชจ๋‘ ์ฒ˜๋ฆฌํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์…ฐ์ดํ”„๋„ท, ๋งคํ„ฐํฌํŠธ3D, 3D ๊ณตํ†ต ์˜ค๋ธŒ์ ํŠธ ๋“ฑ ๋‹ค์–‘ํ•œ ๋ฐ์ดํ„ฐ ์„ธํŠธ์— ๋Œ€ํ•œ ์‹คํ—˜์„ ํ†ตํ•ด ์ƒˆ๋กœ์šด ๋ทฐ ํ•ฉ์„ฑ์„ ์œ„ํ•œ ์ตœ์ฒจ๋‹จ ๊ฒฐ๊ณผ๋ฅผ ๋ณด์—ฌ์ค๋‹ˆ๋‹ค. ์ œ์•ˆ๋œ ๋ฐฉ๋ฒ•์€ ๋‹จ ํ•˜๋‚˜์˜ ์ž…๋ ฅ ์ด๋ฏธ์ง€๋งŒ์œผ๋กœ๋„ ์‚ฌ์‹ค์ ์ธ ์ƒˆ๋กœ์šด ๋ทฐ๋ฅผ ์ƒ์„ฑํ•  ์ˆ˜ ์žˆ์œผ๋ฉฐ 3D ์ผ๊ด€๋œ ์‹œํ€€์Šค๋ฅผ ์ž๋™ ํšŒ๊ท€์ ์œผ๋กœ ํ•ฉ์„ฑํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์ €์ž๋“ค์€ ์ฝ”๋“œ์™€ ์‚ฌ์ „ ํ•™์Šต๋œ ๋ชจ๋ธ์„ ๊ณต๊ฐœํ•  ๊ณ„ํš์ž…๋‹ˆ๋‹ค.