In some cases it was causing an error in the grad related to
broadcasting. In the test it case bad shape.