Comments (3)
jxt1234
commented on June 11, 2024
- 现在建议用完整模型，即合并为同一模型的用法
- mnn 版本是什么？
from mnn.
luocf
commented on June 11, 2024
模型用的是这个：qwen-1.8b-int4
mnn版本用是github上最新版本：
commit 976d1d7 (HEAD -> master, origin/master, origin/HEAD)
Merge: 2d926e4 ed68e16
Author: jxt1234 [email protected]
Date: Mon Apr 8 16:17:33 2024 +0800
Merge pull request #2812 from juju812/patch-2
[bugfix] add return value to lambda of std::async
from mnn.
luocf
commented on June 11, 2024
》〉现在建议用完整模型，即合并为同一模型的用法
请问，如何合并为一个模型？
from mnn.
Related Issues (20)
- fastOnnxTest 成功 但使用时输出不一致 HOT 2
- 编译示例工程代码报错
- 编译测试工具报错阻塞 HOT 3
- 问一下, 在armv8.2 cpu 手机上, 是否已支持fp16 进行卷积的推理阿? HOT 1
- c++ 链接MNN后，编译报错，无法解析的外部符号 _std_init_once_link_alternate_names_and_abort和_std_min_element_4 HOT 6
- mnncompress量化模型以后大小没有变化 HOT 3
- MNN.cv has the rotation issue in loading some photos from the phone HOT 1
- 求教 expr 中_Fill 的正确用法 HOT 3
- 鸿蒙系统编译失败 HOT 1
- Facing issue with version incapitability between protobuffer library and MNN library while performing mnnquant quantization process using python API of mnn HOT 4
- 多输入模型转换时添加--optimizePrefer 2选项 并基于此使用MNNPythonOfflineQuant离线量化，在arm cpu后端推理输出异常，与x86 cpu推理不对齐 HOT 1
- 请问MNN如何实现使用同一模型做并行推理？ HOT 4
- Invalidate buffer to create MNN Module HOT 5
- MNNConvert onnx转mnn 错误，nn.ConvTranspose1d forward 中 pad 会出问题 HOT 7
- How to get SD mnn model used in transformers/diffussion/diffussion_demo
- Android 编译DEMO 出现 Target "MNN_CL_WRAP" of type OBJECT_LIBRARY may not be linked into another target
- 问问MNN的兼容方式 HOT 1
- ios平台 没有getTensor方法 HOT 1
- linux x86_64 平台， 多线程情况下， mnn 和推理速度不如 onnx，有可能是什么原因？ HOT 2
- 手机端vulkan特性 image_write_without_format这个特性影响大吗?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mnn.