The replacement was not correct when there were explicitly broadcastable
dimensions, or if the dtype changed.