Nvidia NVLink in MATALB using multiple Geforce 2080 ti cards

Illustration
Lykke Kempfne - 2022-04-01T09:25:35+00:00
Question: Nvidia NVLink in MATALB using multiple Geforce 2080 ti cards

The NVLink yields a high bidirectional bandwidth between the cards (the Geforce 2080 ti offers 100 GB/, while the GeForce RTX 2080 offers 50GB/s). When fully utilized, the NVLink will minimize inter-GPU traffic over the PCI Express interface and also allows the memory on each card to behave more as a single, shared resource. This opens up the possibility for new multi-GPU modes for scientific analysis and big dataworkloads as well.   Will Matlab take advantage of the nvlinks ability to share resources between cards in future releases (R2019a/R2019b)?

Related Questions

  • How to create an attention layer for deep learning networks?
  • Nvidia NVLink in MATALB using multiple Geforce 2080 ti cards
  • How can I fit a Gumbel Maximum distribution using both
  • How to predict next value using time series?
  • How are the functions "train" and "trainNetwork" different underneath?

    • Expert Answer

    Profile picture of John Williams John Williams answered . 2025-11-20

    I understand that you want to use Nvidia NVLink with MATLAB to leverage multiple Nvidia Geforce 2080 ti graphic cards.
     
    Currently, there is no straightforward way to utilize the high bidirectional bandwidth to distribute the computations across the available GPUs. This would be possible with the introduction of distributed GPU arrays which can use all GPUs and gather the results back automatically. Distributed GPU arrays are currently not supported in MATLAB.
     
    Our development teams are aware of this and are currently considering "distributed GPU Arrays" for future releases of MATLAB.
     
    Currently, there are no commands to enable NVLink in MDCS. As a workaround to leverage NVlink, you can use "gop" function as in example given below that does the computation in each gpu and get the result back :
     
     
    >> gop(@plus, gpuArray(X), 'gpuArray');

    Open a parpool and issue local and/or communicating instructions via spmd that will allow to do distributed computation between the GPUs.


    Not satisfied with the answer ?? ASK NOW

    Get a Free Consultation or a Sample Assignment Review!

    Upload Assignment Talk to Expert