[torch-ort-infer] Aten fallback doesn't work about ort HOT 6 OPEN

@askhade Yes, sure

from ort.

Can you please try with the latest PyTorch nightly?

from ort.

With PyTorch nightly, Aten Fallback is no longer valid since numpy_T converts to Transpose(pytorch/pytorch#79269).

from ort.

Thanks @saipj. Do you have another model we can test with?

from ort.

@saipj I had a play with this with the triu op that we talked about this morning and got it working. There were a couple of work arounds that I had to make, specifically add a custom symbolic as ORT could not infer the shape and type info for this op, as well as loading the aten cpp executor (this can be moved into ORTInferenceModule). Have a look at: https://github.com/natke/aten_snippet/blob/main/aten_model.py

from ort.

@natke : Can you add this example in this repo? Explaining how to set the type when type inference fails in ORT.

from ort.