Comments (2)
turnkey benchmark timm/resnet18.py --runtime torch-compiled
works for me on the latest version of main
@jeremyfowers can you please also try on your side to see if we can close this issue?
If this does not work on your system, please share which version of torch you are using.
from turnkeyml.
I have root caused the problem: this bug only presents on certain versions of torch 2.x
. What I have tried so far:
torch 2.0.0
: finetorch 2.0.1
: doesn't worktorch 2.2.0
: fine
If anyone runs into this problem in the future, lets suggest that they update their torch installation. Closing issue.
PS. this is yet more motivation for us to enforce a more strict environment for benchmarking!
from turnkeyml.
Related Issues (20)
- Turnkey stats evaluation ID collisions HOT 1
- Provide an option to use a fully-standardized conda environment HOT 2
- Add error messages to report.csv
- Use full-sized GPT-J
- Create an ORT base class and refactor run/onnxrt on to it
- Configurable verbosity in Analyzer Status HOT 1
- Change `--rebuild` to `--skip` HOT 5
- Integrate mass-benchmarking into the Files API HOT 3
- Validate `benchmark_files()` arguments
- turnkey hangs on querying OEM system information
- Input size is only saved to stats in ONNX tool flows
- Proposal: check model path in `--model_path` scripts
- Enhance conda creation methodology for onnxrt
- Reporting places results for the same model on multiple CSV lines HOT 1
- Add support for pipelines of models HOT 1
- Proposal: Store tkml CLI command and timestamp as part of stats and report
- Proposal: A way to skip LLMs
- Issue with converting to ONNX format for LLM models HOT 3
- Stage durations are not being correctly recorded
- Fix CI and enable TKML to work with torch >= 2.2.0
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from turnkeyml.