Diagnostics fail expecting NvLink on non-NvLink systems about dcgm HOT 3 OPEN

Hi, as of DCGM 2.4.7, you can turn off this check by adding '-p pcie.test_nvlink_status=false' to your dcgmi diag line. As for now, can you paste the output of nvidia-smi -q ?

from dcgm.

@dbeer Thank you for your reply. Here is the output of nvidia-smi -q:

nvidia-smi-q.txt

I have a hunch that this call to nvmlDeviceGetLinkState is showing the link as disabled instead of unsupported. This theory is consistent with the output of "dcgmi nvlink -s" on my systems.

As an aside, I have found that I can add "NVreg_NvLinkDisable=1" to the nvidia kernel module parameters to convince these tests to pass. This is perhaps not the best solution, though.

Out of curiosity, are you able to reproduce this?

from dcgm.

Adding that parameter is a good workaround if you do not have NVLinks on the board. If it's okay with you, then it should be alright. As I said before, 2.4.7 has the option to simply skip this test as well.

We have been able to reproduce this on certain systems that are meant to have NVLinks, but do not, because as you noticed they are reported as disabled instead of unsupported, and DCGM relies on NVML for this information. Internally, we use the option to skip this test.

from dcgm.