[Build] MoE related unit tests fail for older architectures such as Pascal when building dev debug about onnxruntime HOT 4 OPEN

@wangyems, In MoeGemmRunner::dispatch_to_arch, I saw it dispatch for SM from 70 to 89. We shall skip MOE tests for other GPUs (< 70, and >= 90).

BTW, could you test MOE in V100 to see whether it could run in SM=70? I saw some feature required SM>=80:

I think the requirements are like:
float: sm 70 to 89 (In theory, it shall support all GPUs, just a limitation of MoeGemmRunner::dispatch_to_arch)
float16: sm 70 to 89
bfloat16: sm 80 to 89

from onnxruntime.

I tested it on V100 on Linux with CUDA 11.8.

[==========] 4 tests from 1 test suite ran. (10758 ms total)
[  PASSED  ] 3 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] MoETest.QMoETest_Mixtral_Int4

from onnxruntime.

Our Linux training GPU machine pools use V100. Why they didn't catch this error?

from onnxruntime.

checking..

from onnxruntime.