提交 90a1a0c5 authored 作者: Frederic Bastien's avatar Frederic Bastien

Pre merge bn grad.

上级 2553b8fd
...@@ -23,10 +23,12 @@ class BNComposite(Composite): ...@@ -23,10 +23,12 @@ class BNComposite(Composite):
def grad(self, inps, grads): def grad(self, inps, grads):
x, mean, std, gamma, beta = inps x, mean, std, gamma, beta = inps
top, = grads top, = grads
dx = (top * gamma) / std top_gamma = top * gamma
dmean = -(top * gamma) / std x_mean = x - mean
dstd = -(top * gamma * (x - mean)) / (std * std) dx = top_gamma / std
dgamma = top * (x - mean) / std dmean = -dx
dstd = -(top_gamma * x_mean) / (std * std)
dgamma = top * x_mean / std
return [dx, dmean, dstd, dgamma, top] return [dx, dmean, dstd, dgamma, top]
......
Markdown 格式
0%
您添加了 0 到此讨论。请谨慎行事。
请先完成此评论的编辑!
注册 或者 后发表评论