SGE_GPU
Patch to SGE 2011.p1,Son of Grid Engine, multiple GPU, Linux
...Also, you need to set a consumable, named "ngpus". And assign value of it to each node.
When submit GPU job, run:
>qsub -l ngpus=1 ...
This also works for parallel jobs.
>qsub -pe openmpi 4 -l ngpus=1 ...
Here, "-l ngpus=1" request 1 GPU for 1 process.
It supports multiple GPU scheduling on nodes as well. For example, if node001 has 4 GPUs installed. JobA uses GPU0, JobB uses GPU2, and then JobC requestes 2 GPUs, it can dispatch GPU1 and GPU3 to JobC, and set the environment for the job on node001:
CUDA_VISIBLE_DEVICES=1,3
For non-GPU jobs, it is set to empty.
...