Notes on this change: 1) I needed to replicate the inplace optimization, to
make a version that can handle ops moved on the gpu. I've also added a
replica of the reconstruct_graph function from scan_utils that again does
not replace CudaNdarray with TensorTypes ..