7fef807fab826df33be898a518d604036a395e1997f5407f52


7fef807fab826df33be8e9b31fd675732a6473477baa2df6c9c974712ab7c1

์–ด์ œ ์†Œ๊ฐœํ•œ soft diffusion๊ณผ ๋งˆ์ฐฌ๊ฐ€์ง€๋กœ Google Research์˜ ์—ฐ๊ตฌ ๊ฒฐ๊ณผ์ž…๋‹ˆ๋‹ค.

์š”์ฆ˜ vision์—์„œ์˜ generative model ์—ฐ๊ตฌ๋Š” diffusion model์ด ์ฃผ๋ฅ˜๊ฐ€ ๋œ ๊ฒƒ ๊ฐ™์Šต๋‹ˆ๋‹ค.


Blurring diffusion model์€ ์˜ฌํ•ด ๋‚˜์˜จ ๋‹ค๋ฅธ ์—ฐ๊ตฌ์—์„œ ์ œ์•ˆํ•œ heat dissipation ๊ณผ์ •๊ณผ ์ผ๋ฐ˜์ ์ธ Gaussian noise๋ฅผ ์ด์šฉํ•œ forward process๋ฅผ ์ž˜ ์„ž์€ ๋ฐฉ์‹์„ ์ œ์•ˆํ–ˆ๋‹ค๊ณ  ํ•ฉ๋‹ˆ๋‹ค.


๋…ผ๋ฌธ์„ ํ›‘์–ด๋ณด๋‹ค ์‹คํ—˜ ๋ถ€๋ถ„์„ ๋ดค๋Š”๋ฐ 32x32 ํฌ๊ธฐ์˜ย CIFAR 10๊ณผ 128x128 ํฌ๊ธฐ์˜ LSUN churches ๋‘ ๊ฐ€์ง€ ๋ฐ์ดํ„ฐ ์…‹์— ๋Œ€ํ•ด์„œ๋งŒ ์‹คํ—˜์„ ํ–ˆ๊ณ , ๋‘ ์ด๋ฏธ์ง€ ๋ชจ๋‘ ๋น„๊ต์  ํ•ด์ƒ๋„๊ฐ€ ๋‚ฎ์€ ์ด๋ฏธ์ง€์— ๋Œ€ํ•ด์„œ๋งŒ ์‹คํ—˜์„ ํ–ˆ๋„ค์š”.ย ๋ฆฌ์†Œ์Šค๊ฐ€ ๋ถ€์กฑํ•ด์„œ ๊ณ ํ•ด์ƒ๋„ ์ด๋ฏธ์ง€๋กœ๋Š” ์‹คํ—˜์„ ํ•˜์ง€ ๋ชปํ•œ ๊ฒƒ์ธ์ง€ ์•„๋‹ˆ๋ฉด ๋‚ฎ์€ ํ•ด์ƒ๋„์—์„œ๋งŒ denoising diffusion process ๋ณด๋‹ค ์šฐ์ˆ˜ํ•œ ๊ฒƒ์ธ์ง€ ๊ถ๊ธˆํ•˜๋„ค์š”.


๋” ํ›‘์–ด๋ณด๋‹ˆ 7. Limitations ~ ๋ถ€๋ถ„์—ย "Such as regularizing effect isย often beneficial, and can lead to improved sample quality as we showed in Section 6, but may notย be desirable when very large quantities of training data are available." ์™€ ๊ฐ™์ด ๋ญ”๊ฐ€ ์˜๋ฏธ์‹ฌ์žฅํ•œ ๋ง์„ ๋‚จ๊ฒจ๋†“๊ธด ํ–ˆ๋„ค์š” ใ…Žใ…Ž


๊ด€์‹ฌ ์žˆ์œผ์‹  ๋ถ„๋“ค์€ ์ž์„ธํžˆ ์ฝ์–ด๋ณด์„ธ์š”~


์ œ๋ชฉ:ย BLURRING DIFFUSION MODELS

arXiv:ย https://arxiv.org/abs/2209.05557

GitHub:ย https://github.com/w86763777/pytorch-ddpm