control over where it is allocated.

This allows allocating shared variables on the CPU while the default
is GPU or choosing which GPU to allocate on when doing multi-gpu.