This is a significant speed up with the gc as most of the time, we
don't need it and allocating on the GPU is slow.