Sum with a complex input and scalar output doesn't work because of the
ambiguity of casting complex to scalar.  The reverse doesn't work
because of the ambiguity of the casting in the gradient.  Therefore
disallow both.