Tensorflow lite GPU delegate can't work well and NNAPI can't make the model faster about tensorflow HOT 7 OPEN

Hi @Raphaelzrf ,

I don't have a vivo x100 to replicate this issue , but i have vivo x80 and the GPU delegate works fine on that device. What i can suggest you is to use is tflite benchmark tool tflite benchmark tool and see if there is a difference between the timings on NNAPI and GPU delegate. This will confirm the GPU support on your device. Let me know once you are able to do it.

from tensorflow.

@sawantkumar Thank you for your reply. I have tried to use tflite benchmark tool to run Mobilenet and there was a difference between the timings on NNAPI and GPU delegate. So I 'm sure that there is the GPU supported on my device. But compatList.isDelegateSupportedOnThisDevice() return false. How did you use the GPU delegate works on vivo x80? tflite benchmark tool? Have you tried the GPU delegate on an App?If you have, can you share your code?

from tensorflow.

Hi @Raphaelzrf ,

Yes i was able to access the GPU delegate in an android app , also i was able to access the neuron delegate which is an AI accelerator for your int8 models . The reason behind no speedup could be model specific also. Maybe you can try out any of examples and see for yourself if you are able to access the GPU delegate in these examples.

from tensorflow.

@sawantkumar As I said above, compatList.isDelegateSupportedOnThisDevice() return false. So it has nothing to do with the model. Neuron delegate? I don't konw that. Do you mean using NNAPI to access NPU？

from tensorflow.

@Raphaelzrf Yes, i meant using NNAPI to access NPU . Looking at all the sources x100 has a relatively powerful gpu as you can see from here . Can you please check if you have any updates available on your phone ?

from tensorflow.

@sawantkumar My device is already up to date. Can you tell me the version of tensorflow-lite and tensorflow-lite-gpu that you use?

from tensorflow.

@Raphaelzrf i can't recall very clearly what version of tflite it was, but i think it was 2.4.0 . I am looking into your issue btw and will let you know if i come up with something .

from tensorflow.