TIL on SUN about DLS

momentum
exponentially weighted average
RMSprop
Adam
bias correction
moment
learning rate dacay
local optima
saddle point
plateaus
Published

February 18, 2024

Deep Learning Specialization[Course2]

  • Coursera - Professor Andrew Ng, Stanford Univ.

momentum,exponentially weighted averagemy-gallery

Note

momentum,exponentially weighted average

RMSprop,Adam,bias correction

RMSprop,Adam,bias correction
Note

RMSprop,Adam,bias correction

moment,learning rate dacay

moment,learning rate dacay
Note

moment,learning rate dacay

local optima,saddle point,plateaus

local optima,saddle point,plateaus
Note

local optima,saddle point,plateaus