Comments (3)
Thanks a lot for your quick reply to this issue and for the recommended solutions. @SS-JIA, the issue was related to eval mode. After I set the model to evaluation mode, it worked.
from executorch.
I would recommend to try disabling IR validity checking via EdgeCompileConfig
. This should cause the check that is producing that error to be skipped.
One example of how to disable validity checking is:
# Assume that eager_model and sample_inputs have been defined above
exported_program = export(eager_model, sample_inputs)
edge_program = to_edge(
exported_program,
compile_config=exir.EdgeCompileConfig(_check_ir_validity=False, _use_edge_ops = False),
).transform(propagate_dynamic_shape())
Please try it out and see if it works!
from executorch.
However, even if you skip the check it's likely that your model may not be able to execute because non ATen canonical operators are not currently implemented in ExecuTorch's kernel libraries. This means that to execute your model, you may need to provide an implementation for the torch._ops.aten.bernoulli
operator.
I would recommend that you try to execute the model while skipping the check, and if you run into an error complaining that there is no kernel available for the aten.bernoulli
operator:
- Please open an issue to request that a implementation of
aten.bernoulli
be added to the portable kernel library - Alternatively, you can try to provide an implementation for the operator yourself. If you decide to go this route, let me know and I can provide some more details on how to do this.
from executorch.
Related Issues (20)
- coreml backend doesn't work with lstm
- llama model is not fully lowered to ANE (coreml backend)
- Fix bos/eos tokens in bpe tokenizer in c++ HOT 1
- examples/models/llama2 - undefined reference to `pthread_once' HOT 4
- Main requires numpy 1.25 but coremltools only supports up to 1.23 HOT 1
- Failed with qualcomm.scripts.export_example HOT 8
- Crash (native stack) for llama2 demo on Android HOT 4
- Unable to Convert DeepFilterNet to ExecuTorch HOT 10
- Failures/Errors in unit test (with QualComm's AI SDK) HOT 4
- Is there example for running model with Quantization with Vulkan GPU ? HOT 2
- LLAMA Runner with QNN Build Failure in Recent Push HOT 5
- [Mutable Buffer] [Core ML Delegate] Let Core ML Handle Mutable Buffer HOT 3
- Error [[]] attributes are a C23 extension when building with Qualcomm AI Engine Direct HOT 11
- Segmentation Fault when implementing llama/stories110M Android phone deployment HOT 3
- Cross-compiling Executorch SDK for Android HOT 3
- How to export a pretrained model? HOT 1
- The apk downloaded from S3 can not be unzipped HOT 1
- [Android] Set mobile-job workflow as a periodic job HOT 1
- UNSTABLE Build Linux Wheels / pytorch/executorch / upload / manywheel-py3_9-cpu HOT 1
- UNSTABLE Build M1 Wheels / pytorch/executorch / upload / wheel-py3_9-cpu HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from executorch.