Issues in running GPU device on MTL iGPU in notebook 261-fast-segment-anything about openvino_notebooks HOT 4 CLOSED

I obtained the same result as you when inferencing with iGPU.

Inferencing on CPU:

Inferencing on iGPU:

We'll investigate the issue and update you as soon as possible.

from openvino_notebooks.

@xiangyang-95 could you please try to apply configuration changes proposed in this PR #1829? Fast-Segment-Anything is based on yolov8, it is known limitation that it may requires to disable some optimization for GPU to get accurate result on some platforms

from openvino_notebooks.

@eaidova I am still having the same issue after applying the configurations in the PR.
Based on some tests, I found that when we export the model to a static shape, then it works.
Using a dynamic shape has no detections on the result when the accuracy is high, if the accuracy threshold is tuned down to very low (0.01), the results can be seen.
I also find that the tensor data between the static and dynamic shapes are different as well.

from openvino_notebooks.

@xiangyang-95 thank you for your findings, I updated notebook to use static input shapes

from openvino_notebooks.