Skip to document
pieroot log

---

view: category

filter: ๐Ÿ“„ Research Paper

count: 3

---

#๐Ÿ“„ Research Paper

// 3 entries in this category.

๐Ÿ“„ RESEARCH PAPER#deep learning ยท #paper

The Forward-Forward Algorithm ์ •๋ฆฌ

Forward-Forward ์•Œ๊ณ ๋ฆฌ์ฆ˜์€ ๋ ˆ์ด๋ธ”์ด ์žˆ๋Š” positive์™€ negative ์ƒ˜ํ”Œ์„ ๋‘ ๋ฒˆ์˜ ์ˆœ์ „ํŒŒ๋งŒ์œผ๋กœ ๊ฐ€์ค‘์น˜๋ฅผ ์—…๋ฐ์ดํŠธํ•˜๋ฉฐ, ๊ฐ ์ธต์ด ์ž์ฒด์ ์ธ goodness๋ฅผ ์ตœ์ ํ™”ํ•˜๋„๋ก ์„ค๊ณ„๋œ๋‹ค. ์ด๋ฅผ ํ†ตํ•ด ๋ ˆ์ด์–ด๋ณ„ ๋…๋ฆฝ์ ์ธ ํ•™์Šต, ์ •๊ทœํ™” ๊ธฐ๋ฒ•, RNN ํ˜•ํƒœ์˜ ์ƒํ•˜์ธต ์ƒํ˜ธ์ž‘์šฉ ๋“ฑ ๋‹ค์–‘ํ•œ ๋ณ€ํ˜•๊ณผ ์‹คํ—˜์„ ์ˆ˜ํ–‰ํ–ˆ์œผ๋ฉฐ, MNIST์™€ CIFARโ€‘10์—์„œ ์—ญ์ „ํŒŒ ๋Œ€๋น„ ์•ฝ๊ฐ„ ๋‚ฎ์€ ์ •ํ™•๋„์ด์ง€๋งŒ ๋น„์Šทํ•œ ์„ฑ๋Šฅ์„ ๋ณด์ด๊ณ , ํ•™์Šต ์†๋„์™€ ์ˆ˜๋ ด ๋ฉด์—์„œ ์ฐจ์ด๊ฐ€ ์žˆ์Œ์„ ํ™•์ธํ–ˆ๋‹ค.

2025-09-26

โ†’
๐Ÿ“„ RESEARCH PAPER#speech synthesis ยท #text-to-speech ยท #end-to-end model

์Œ์„ฑ ํ•ฉ์„ฑ์„ ํ˜์‹ ํ•˜๋Š” ํƒ€์ฝ”ํŠธ๋ก : ์—”๋“œ ํˆฌ ์—”๋“œ ์ ‘๊ทผ ๋ฐฉ์‹

Tacotron์€ ๊ธฐ์กด TTS ์‹œ์Šคํ…œ์˜ ๋ณต์žกํ•œ ํŒŒ์ดํ”„๋ผ์ธ์„ ๋‹จ์ˆœํ™”ํ•˜์—ฌ ํ…์ŠคํŠธ ์ž…๋ ฅ๋งŒ์œผ๋กœ ์Œ์„ฑ์„ ์ƒ์„ฑํ•˜๋Š” end-to-end ์Œ์„ฑ ํ•ฉ์„ฑ ๋ชจ๋ธ์ด๋‹ค. Tacotron 1์€ attention ๊ธฐ๋ฐ˜ seq2seq ๋ชจ๋ธ์„ ์‚ฌ์šฉํ•˜๊ณ  Griffin-Lim ์•Œ๊ณ ๋ฆฌ์ฆ˜์œผ๋กœ ์Œ์„ฑ์„ ์ƒ์„ฑํ•˜๋ฉฐ, Tacotron 2๋Š” LSTM๊ณผ Location-Sensitive Attention์„ ๋„์ž…ํ•˜์—ฌ ์Œ์งˆ์„ ํ–ฅ์ƒ์‹œ์ผฐ๋‹ค. Tacotron 2๋Š” MOS ์ ์ˆ˜ 4.526์„ ๊ธฐ๋กํ•˜๋ฉฐ, ์ž์—ฐ์Šค๋Ÿฌ์šด ์Œ์„ฑ์„ ์ƒ์„ฑํ•˜๋Š” ๋ฐ ์„ฑ๊ณตํ–ˆ์ง€๋งŒ ๋А๋ฆฐ ์ถ”๋ก  ์†๋„์™€ attention ๋ถˆ์•ˆ์ •์„ฑ ๋“ฑ์˜ ํ•œ๊ณ„๊ฐ€ ์žˆ๋‹ค.

2024-10-22

โ†’
๐Ÿ“„ RESEARCH PAPER#deep learning ยท #Computer Vision

PixelRNN & PixelCNN

PixelRNN๊ณผ PixelCNN์€ autoregressive ๋ฐฉ์‹์œผ๋กœ ํ”ฝ์…€์„ ์ˆœ์ฐจ ์˜ˆ์ธกํ•ด ์ด๋ฏธ์ง€๋ฅผ ์ƒ์„ฑํ•˜๋Š” ๋ชจ๋ธ์ด๋ฉฐ, PixelRNN์€ LSTM ๊ธฐ๋ฐ˜์œผ๋กœ ๋†’์€ ์„ฑ๋Šฅ์„ ์ œ๊ณตํ•˜์ง€๋งŒ ํ•™์Šต์ด ๋А๋ฆฌ๊ณ , PixelCNN์€ ๋งˆ์Šคํฌ๋œ ์ปจ๋ณผ๋ฃจ์…˜์œผ๋กœ ๋ณ‘๋ ฌ ํ•™์Šต์ด ๊ฐ€๋Šฅํ•˜์ง€๋งŒ ์˜ค๋ฅธ์ชฝ ์œ„ ๋ธ”๋ผ์ธ๋“œ ์ŠคํŒŸ ๋ฌธ์ œ๊ฐ€ ์žˆ๋‹ค. ์ด๋ฅผ ํ•ด๊ฒฐํ•˜๊ธฐ ์œ„ํ•ด Vertical/Horizontal ์Šคํƒ๊ณผ ๊ฒŒ์ดํŠธ ํ™œ์„ฑํ™”๋ฅผ ๋„์ž…ํ•œ Gated PixelCNN์ด ์ œ์•ˆ๋˜์–ด ๋ธ”๋ผ์ธ๋“œ ์ŠคํŒŸ์„ ์ œ๊ฑฐํ•˜๊ณ  ํ•™์Šต ์†๋„๋Š” ์œ ์ง€ํ•˜๋ฉด์„œ ์„ฑ๋Šฅ์„ ํ–ฅ์ƒ์‹œํ‚จ๋‹ค.

2024-10-17

โ†’