Comments (7)
This issue has been automatically marked as stale due to inactivity and will be closed in 30 days if no further activity occurs. If further support is needed, please provide an update and/or more details.
from onnxruntime.
Did you push the qnn libraries to the device?
The onnxruntime needs the qnn library to execute models.
from onnxruntime.
no, I haven't pushed anything. I just added the libQnnHtp.so in jnilibs folder in android. Can you share a little more details about which libraries are needed and what would be the absolute path to push these in?
from onnxruntime.
https://docs.qualcomm.com/bundle/publicresource/topics/80-63442-50/backend.html
from onnxruntime.
Did you push the qnn libraries to the device? The onnxruntime needs the qnn library to execute models.
Hi, under which path of the device does the library need to be placed?
from onnxruntime.
I used the following official demo code to push the library, but encountered the error with HTP backend Android 8Gen2 device. "QNN SetupBackend failed: Failed to create device. Error: 14001".
std::vector<const char*> options_keys = {"backend_path"};
std::vector<const char*> options_values = {"/data/user/0/com.example.myapplication/cache/libQnnHtp.so"};
However, the official demo run_qnn_ep_sample.bat file includes multiple libraries:
- libQnnHtp.so
- libQnnHtpV73Stub.so
- libQnnHtpV73Skel.so
- libQnnHtpPrepare.so
- libqnnhtpv73.cat
- libQnnCpu.so
- libQnnSystem.so
I also tried using options_values.push_back("/data/user/0/com.example.myapplication/cache/*.so"), or copied these *.so files to the cache folder (the same folder as libQnnHtp.so), but it still failed.
How can I provide these libraries to the device to successfully run the HTP backend on Android device?
Build Info:
- libonnxruntime.so = 1.18
- QNN SDK = 2.22*
from onnxruntime.
I used the following official demo code to push the library, but encountered the error with HTP backend Android 8Gen2 device. "QNN SetupBackend failed: Failed to create device. Error: 14001". std::vector<const char*> options_keys = {"backend_path"}; std::vector<const char*> options_values = {"/data/user/0/com.example.myapplication/cache/libQnnHtp.so"};
However, the official demo run_qnn_ep_sample.bat file includes multiple libraries:
1. libQnnHtp.so 2. libQnnHtpV73Stub.so 3. libQnnHtpV73Skel.so 4. libQnnHtpPrepare.so 5. libqnnhtpv73.cat 6. libQnnCpu.so 7. libQnnSystem.so
I also tried using options_values.push_back("/data/user/0/com.example.myapplication/cache/*.so"), or copied these *.so files to the cache folder (the same folder as libQnnHtp.so), but it still failed.
How can I provide these libraries to the device to successfully run the HTP backend on Android device?
Build Info:
* libonnxruntime.so = 1.18 * QNN SDK = 2.22*
I just export the library path using the LD_LIBRARY_PATH.
Linux(android) occurs the fault without the libary, they are searching some folders. such as /vendor/lib64, /sytem/lib64 ....
It depends on the systems. As I set the LD_LIBARY_PATH, it also search the library in LD_LIBRARY_PATH.
$ export LD_LIBRARY_PATH="/data/user/0/com.example.myapplication/cache/"
from onnxruntime.
Related Issues (20)
- Breaks RootNamespace
- [Web] requested dist/*.mjs files for cdnjs HOT 2
- AppendExecutionProvider_DML error HOT 2
- [Mobile] Pre-built 1.19.0 lib is missing for onnxruntime-android HOT 2
- run_async
- [Build] cuda dockerfile build error HOT 3
- [Mobile] QNN-EP graph preparation failed HOT 3
- DirectML failed with invalid command
- [Web] [SD 1.5][SD Turbo][Whipser Base] Browser page out of memory - WebGPU and WebNN GPU EP HOT 3
- [Web] Previously used .wasm binaries missing in 1.19.0 (using web bundler with CopyPlugin) HOT 2
- [Mobile][Android][Bug] SIGSEGV if ortSession.close() is called before ortSession.run() finish HOT 4
- [Bug] [onnxruntime-node] Error: no available backend found. ERR: [wasm] backend not found. HOT 4
- [Documentation] the example does not define test_data variable
- Cant get GPU to work with ONNX Runtime 1.19 Cuda 12.6 CuDNN 9 RTXA4000 HOT 6
- Release version of onnxruntime.dll has a dependency on dbghelp.dll HOT 4
- [Training] No Op registered for SimplifiedLayerNormalization with domain_version of 14 when using generate_artifatcs HOT 2
- [Build] Use Protobuf External Problem HOT 2
- [Build] HOT 1
- [QNN] Initialization failure in particular use case. HOT 2
- [Mobile] Will provide supported 16KB-page-size prebuilt Android .so in the future? HOT 11
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from onnxruntime.