Course Study with CSC321
[2021.06.26]
Topic
: Gated Recurrent Units (James)
Notes
:
Links
:
- https://wiserloner.tistory.com/1112 (Why GRU was developed? , KR)
- https://yjjo.tistory.com/18 (introduction to gates in GRU , KR)
- https://m.blog.naver.com/PostView.naver?isHttpsRedirect=true&blogId=winddori2002&logNo=221992543837 (Computation flow details , KR)
- https://medium.com/@mihirkhandekar/forward-and-backpropagation-in-grus-derived-deep-learning-5764f374f3f5 (BPTT in GRU , EN)
- https://wikidocs.net/106473 (Recurrent Network code tutorial, KR)
Covered through study
- LSTM review & QnA
- 1.Introduction
- background - complex structure of LSTM
- introduction to 2 gates - Reset gate, Update gate
- 2.GRU forward computation flow
- what is calculated at each gate (how is it diff from LSTM?)
- understanding flow as human language
Gated Recurrent Units part1