Giter Club home page Giter Club logo

Comments (7)

github-actions avatar github-actions commented on September 26, 2024

This issue has been automatically marked as stale due to inactivity and will be closed in 30 days if no further activity occurs. If further support is needed, please provide an update and/or more details.

from onnxruntime.

kthur avatar kthur commented on September 26, 2024

Did you push the qnn libraries to the device?
The onnxruntime needs the qnn library to execute models.

from onnxruntime.

bibekanandaburagohain avatar bibekanandaburagohain commented on September 26, 2024

no, I haven't pushed anything. I just added the libQnnHtp.so in jnilibs folder in android. Can you share a little more details about which libraries are needed and what would be the absolute path to push these in?

from onnxruntime.

HectorSVC avatar HectorSVC commented on September 26, 2024

https://docs.qualcomm.com/bundle/publicresource/topics/80-63442-50/backend.html

from onnxruntime.

June1124 avatar June1124 commented on September 26, 2024

Did you push the qnn libraries to the device? The onnxruntime needs the qnn library to execute models.

Hi, under which path of the device does the library need to be placed?

from onnxruntime.

DakeQQ avatar DakeQQ commented on September 26, 2024

I used the following official demo code to push the library, but encountered the error with HTP backend Android 8Gen2 device. "QNN SetupBackend failed: Failed to create device. Error: 14001".
std::vector<const char*> options_keys = {"backend_path"};
std::vector<const char*> options_values = {"/data/user/0/com.example.myapplication/cache/libQnnHtp.so"};

However, the official demo run_qnn_ep_sample.bat file includes multiple libraries:

  1. libQnnHtp.so
  2. libQnnHtpV73Stub.so
  3. libQnnHtpV73Skel.so
  4. libQnnHtpPrepare.so
  5. libqnnhtpv73.cat
  6. libQnnCpu.so
  7. libQnnSystem.so

I also tried using options_values.push_back("/data/user/0/com.example.myapplication/cache/*.so"), or copied these *.so files to the cache folder (the same folder as libQnnHtp.so), but it still failed.

How can I provide these libraries to the device to successfully run the HTP backend on Android device?

Build Info:

  • libonnxruntime.so = 1.18
  • QNN SDK = 2.22*

from onnxruntime.

kthur avatar kthur commented on September 26, 2024

I used the following official demo code to push the library, but encountered the error with HTP backend Android 8Gen2 device. "QNN SetupBackend failed: Failed to create device. Error: 14001". std::vector<const char*> options_keys = {"backend_path"}; std::vector<const char*> options_values = {"/data/user/0/com.example.myapplication/cache/libQnnHtp.so"};

However, the official demo run_qnn_ep_sample.bat file includes multiple libraries:

1. libQnnHtp.so

2. libQnnHtpV73Stub.so

3. libQnnHtpV73Skel.so

4. libQnnHtpPrepare.so

5. libqnnhtpv73.cat

6. libQnnCpu.so

7. libQnnSystem.so

I also tried using options_values.push_back("/data/user/0/com.example.myapplication/cache/*.so"), or copied these *.so files to the cache folder (the same folder as libQnnHtp.so), but it still failed.

How can I provide these libraries to the device to successfully run the HTP backend on Android device?

Build Info:

* libonnxruntime.so = 1.18

* QNN SDK = 2.22*

I just export the library path using the LD_LIBRARY_PATH.
Linux(android) occurs the fault without the libary, they are searching some folders. such as /vendor/lib64, /sytem/lib64 ....
It depends on the systems. As I set the LD_LIBARY_PATH, it also search the library in LD_LIBRARY_PATH.

$ export LD_LIBRARY_PATH="/data/user/0/com.example.myapplication/cache/"

from onnxruntime.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.