Comments (8)
YingkunZhou
commented on May 29, 2024
继续用经典的模型efficientnetv2_b0试了试
模型的下载地址为：https://github.com/onnx/models/raw/main/Computer_Vision/tf_efficientnetv2_b0_Opset16_timm/tf_efficientnetv2_b0_Opset16.onnx
得到的量化完的运行结果：
./pictureRecognition.out tf_efficientnetv2_b0_Opset16.mnn daisy.jpg
Load Cache file error.
The device support i8sdot:1, support fp16:1, support i8mm: 0
Create execution error : 101
Create execution error : 101
Session Info: memory use 0.005398 MB, flops is 463.154877 M, backendType is 0, batch size = 1
input: w:192 , h:192, bpp: 3
origin size: 2100, 1500
Can't run session because not resized
For Image: daisy.jpg
21, 250908922840517956672101818055251722240.000000
971, 155706892288681663873593671155795886080.000000
558, 144564517325205176731988373268433207296.000000
952, 112714106392544388862589291026817482752.000000
485, 72253792300723863246554176667036680192.000000
280, 70477894939442528461738991265310048256.000000
255, 42867207357076265693574510722641035264.000000
930, 40476864538057105379101055316830191616.000000
234, 39606622401000425894973568566339567616.000000
39, 33638683099101550629631678460033236992.000000这结果多少是有些抽象了
而未量化前的模型结果
./pictureRecognition.out tmp.mnn daisy.jpg
Load Cache file error.
The device support i8sdot:1, support fp16:1, support i8mm: 0
Session Info: memory use 34.192852 MB, flops is 537.623291 M, backendType is 0, batch size = 1
input: w:192 , h:192, bpp: 3
origin size: 2100, 1500
For Image: daisy.jpg
985, 9.512913
89, 2.403510
322, 2.085096
108, 2.013274
883, 1.951369
309, 1.885692
113, 1.817128
968, 1.690546
770, 1.643703
738, 1.622023看着就正常很多
from mnn.
v0jiuqi
commented on May 29, 2024
我测试了结果没有不对啊，你用pictureRecognition_module.out 测试看看
from mnn.
YingkunZhou
commented on May 29, 2024
@v0jiuqi 您确实是测试了量化后的模型了吗，能否贴一下您运行的分类结果让我看看，感谢！
模型就是上面提到的两个onnx官方仓库的，然后图片为
然后我是在arm64的开发板jetson orin （不是在x86的机器上，这一点也请注意）上进行编译运行的
from mnn.
YingkunZhou
commented on May 29, 2024
具体的量化流程可以参考#2614
from mnn.
YingkunZhou
commented on May 29, 2024
另外我想问一下，官方是打算放弃Session接口，改用Module接口了吗
from mnn.
YingkunZhou
commented on May 29, 2024
我测试了结果没有不对啊，你用pictureRecognition_module.out 测试看看
@v0jiuqi 可否提供一下你用pictureRecognition_module.out 测试的config.json文件，感谢
from mnn.
v0jiuqi
commented on May 29, 2024
这个是我们的量化工具和后端不一致导致的，你等我们更新吧
from mnn.
YingkunZhou
commented on May 29, 2024
好的，感谢
from mnn.
Related Issues (20)
- MNN 2.8.1 CPU耗时比ONNXRuntime多 HOT 2
- 请问走cpu mnn的初始化耗时是否有办法进一步减少 HOT 3
- Can MNN be compiled in Apple M1 max (arm64 proccesor)? HOT 1
- 模型推理结果异常 HOT 11
- MNN对yolov5n.pt导出的onnx模型剪枝后在在单片机中调用报错Segment fault如何解决 HOT 1
- mnn模型量化后使用timeProfile.out测速结果分析 HOT 1
- Model Output Disparity HOT 1
- 一个较大的模型在infer时出现 _mm256_storeu_ps(d + PACK_UNIT * 1, t1); HOT 1
- std::vector to tensor HOT 2
- RAM usage regeression between v1.0.1 and v2.8.1 HOT 3
- 多个模型A和B, 独立interpreter和session并行跑mnn，backend为mali gpu，那模型实际在gpu上按串行执行？后进的推理耗时是A+B？ HOT 3
- 多个模型串行共享一个runtime，内存没有复用反倒增加 HOT 14
- 使用GPU推理时，如何看GPU的占用率 HOT 2
- Building failed for Raspi OS Bookworm 32 bit HOT 4
- Yolov8模型量化后，量化未报错，加载模型推理报错，MNN tool无法打开模型，nerton提示weights参数是空 HOT 10
- windows平台vs2022编译报错 HOT 2
- 使用控制流( if ... else ..) 转换 onnx to mnn 模型, mnn 模型输入信息异常，推理崩溃 HOT 4
- cannot convert qwen to mnn HOT 1
- `MNNV2Basic.out` 中 `Avg` 和 `OpSum` 的时间存在差异 HOT 1
- 2.8.0编译NPU出错
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mnn.