Can't release memory via del model after model.generate() about bigdl HOT 4 OPEN

test.py.txt
The demo python code

from bigdl.

It's the right behavior of Python virtual machine, we can't force Python VM releasing it's memory on CPU. After you del the model, the memory is empty in VM. If you load a new model, python process won't apply new memory.

from bigdl.

Hi Qiuxin,

Based on my observations, if you do this step(load model+model.generate+del model) for multiple times(in the same process), the process' vm usage will become huge, then system oom will kill this process.
Maybe you guys can try to reproduce this case, to see if we can improve this situation, or not.

Thanks
Gang

from bigdl.

I can't reproduce after 20 times, on current nightly 2.1.0b20240701+ oneapi 2024.0 + intel-extension-for-pytorch 2.1.10+xpu

from bigdl.