提交 8152266a authored 作者: Arnaud Bergeron's avatar Arnaud Bergeron

More typos.

上级 361bd2d3
...@@ -1023,8 +1023,8 @@ result, updates = theano.scan( ...@@ -1023,8 +1023,8 @@ result, updates = theano.scan(
\begin{frame} \begin{frame}
\frametitle{Motivation} \frametitle{Motivation}
RNN gradient signal end up being multiplied a large number of times (as many as the number of timesteps RNN gradient signal end up being multiplied a large number of times (as many as the number of timesteps).
This means that, the magnitude of weights in the transition matrix can have a strong impact on the learning process. This means that, the magnitude of the weights in the transition matrix can have a strong impact on the learning process.
\begin{itemize} \begin{itemize}
\item \begin{bf}vanishing gradients\end{bf} \item \begin{bf}vanishing gradients\end{bf}
If the weights in this matrix are small (or, more formally, if the leading eigenvalue of the weight matrix is smaller than 1.0). If the weights in this matrix are small (or, more formally, if the leading eigenvalue of the weight matrix is smaller than 1.0).
......
Markdown 格式
0%
您添加了 0 到此讨论。请谨慎行事。
请先完成此评论的编辑!
注册 或者 后发表评论