[Performance] Increased memory usage when loading from bytes about onnxruntime HOT 4 OPEN

Version 1.15.1 is rather old. Is this still an issue with the latest release?

from onnxruntime.

Hello again, I have just taked some memory profiles of different executions for each case.
This is the memory usage if I load the model from the file path directly:

And this one is loading from the vector of bytes:

The only change in the code is that I call:
session = std::make_shared<Ort::Session>(env, model_bytes.data(), model_bytes.size(), session_options);
instead of
session = std::make_shared<Ort::Session>(env, "/path/to/model.onnx", session_options);
The rest of the code is the same, I am still reading the file, creating the vector, etc, just calling the other constructor

As you suggested I tried it again with the newer 1.18.0 release, simply by replacing the release files in my deps folder, and while when loading from the file path I get the same behaviour, when loading from the vector it performs even worse:

from onnxruntime.

That is a pretty sizable regression in terms of memory usage in any case! Was there a particular version between 1.15.1 and 1.18.0 that caused the even worse memory usage?

from onnxruntime.

Well, we jumped directly from the 1.15.1 we were using to the 1.18.0 for this test, but I just did a quick check and I can already see this increased memory usage with 1.16.1
I was unable to compile with 1.16.0 due to some missing headers in the includes/ folder, btw

from onnxruntime.