提交 81cfecf3 authored 作者: Frederic's avatar Frederic

Make elemwise operation on small tensor first

上级 ad4e2a09
......@@ -66,8 +66,7 @@ def batch_normalization(inputs, gamma, beta, mean, std,
elm_bn = theano.tensor.elemwise.Elemwise(scalar_op=BNComposite(dtype=inputs.dtype))
rval = elm_bn(inputs, mean, std, gamma, beta)
elif mode == 'high_mem':
rval = (inputs - mean) / std
rval = rval * gamma + beta
rval = (inputs - mean) * (gamma / std) + beta
else:
raise ValueError(
'mode must be either "low_mem", "high_mem"')
......
Markdown 格式
0%
您添加了 0 到此讨论。请谨慎行事。
请先完成此评论的编辑!
注册 或者 后发表评论