Comments (4)
v0jiuqi
commented on September 25, 2024
1
诸如 mov v2.8h,v7.8h 改为 mov v2.16b,v7.16b，不要改成 mov v2.8b,v7.8b
from mnn.
v0jiuqi
commented on September 25, 2024
把MNNAbsMaxFP16.S 文件中 15行到20行的内容删掉，再编译。即
from mnn.
kmn1024
commented on September 25, 2024
谢大佬！但之后有另一个问题：
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S: Assembler messages:
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:66: Error: operand mismatch -- `mov v2.8h,v7.8h'
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:66: Info: did you mean this?
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:66: Info: mov v2.8b, v7.8b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:66: Info: other valid variant(s):
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:66: Info: mov v2.16b, v7.16b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:68: Error: operand mismatch -- `mov v1.8h,v6.8h'
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:68: Info: did you mean this?
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:68: Info: mov v1.8b, v6.8b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:68: Info: other valid variant(s):
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:68: Info: mov v1.16b, v6.16b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:104: Error: operand mismatch -- `mov v2.8h,v7.8h'
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:104: Info: did you mean this?
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:104: Info: mov v2.8b, v7.8b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:104: Info: other valid variant(s):
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:104: Info: mov v2.16b, v7.16b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:106: Error: operand mismatch -- `mov v1.8h,v6.8h'
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:106: Info: did you mean this?
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:106: Info: mov v1.8b, v6.8b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:106: Info: other valid variant(s):
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:106: Info: mov v1.16b, v6.16b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:158: Error: operand mismatch -- `mov v2.8h,v7.8h'
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:158: Info: did you mean this?
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:158: Info: mov v2.8b, v7.8b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:158: Info: other valid variant(s):
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:158: Info: mov v2.16b, v7.16b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:160: Error: operand mismatch -- `mov v1.8h,v6.8h'
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:160: Info: did you mean this?
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:160: Info: mov v1.8b, v6.8b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:160: Info: other valid variant(s):
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:160: Info: mov v1.16b, v6.16b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:196: Error: operand mismatch -- `mov v2.8h,v7.8h'
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:196: Info: did you mean this?
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:196: Info: mov v2.8b, v7.8b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:196: Info: other valid variant(s):
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:196: Info: mov v2.16b, v7.16b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:198: Error: operand mismatch -- `mov v1.8h,v6.8h'
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:198: Info: did you mean this?
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:198: Info: mov v1.8b, v6.8b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:198: Info: other valid variant(s):
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:198: Info: mov v1.16b, v6.16b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:366: Error: operand mismatch -- `mov v3.8h,v21.8h'
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:366: Info: did you mean this?
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:366: Info: mov v3.8b, v21.8b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:366: Info: other valid variant(s):
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:366: Info: mov v3.16b, v21.16b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:367: Error: operand mismatch -- `mov v4.8h,v21.8h'
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:367: Info: did you mean this?
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:367: Info: mov v4.8b, v21.8b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:367: Info: other valid variant(s):
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:367: Info: mov v4.16b, v21.16b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:417: Error: operand mismatch -- `mov v3.8h,v21.8h'
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:417: Info: did you mean this?
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:417: Info: mov v3.8b, v21.8b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:417: Info: other valid variant(s):
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:417: Info: mov v3.16b, v21.16b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:418: Error: operand mismatch -- `mov v4.8h,v21.8h'
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:418: Info: did you mean this?
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:418: Info: mov v4.8b, v21.8b
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:418: Info: other valid variant(s):
/home/ubuntu/mnn-llm/MNN/source/backend/arm82/asm/arm64/low_memory/MNNPackedMatMulFP16_int4.S:418: Info: mov v4.16b, v21.16b
from mnn.
kmn1024
commented on September 25, 2024
跑得动了！太牛太快了🐄 好期待 opencl 的来临 (wangzhaode/mnn-llm#136 (comment)) ！
from mnn.
Related Issues (20)
- 多输入模型转换时添加--optimizePrefer 2选项 并基于此使用MNNPythonOfflineQuant离线量化，在arm cpu后端推理输出异常，与x86 cpu推理不对齐 HOT 2
- 请问MNN如何实现使用同一模型做并行推理？ HOT 3
- Invalidate buffer to create MNN Module HOT 6
- MNNConvert onnx转mnn 错误，nn.ConvTranspose1d forward 中 pad 会出问题 HOT 7
- How to get SD mnn model used in transformers/diffussion/diffussion_demo HOT 1
- Android 编译DEMO 出现 Target "MNN_CL_WRAP" of type OBJECT_LIBRARY may not be linked into another target HOT 1
- 问问MNN的兼容方式 HOT 1
- ios平台 没有getTensor方法 HOT 4
- linux x86_64 平台， 多线程情况下， mnn 和推理速度不如 onnx，有可能是什么原因？ HOT 5
- 手机端vulkan特性 image_write_without_format这个特性影响大吗? HOT 2
- mnn 模型，Android 平台 benchmark 测试，推理使用 openCL, vulkan 都比 CPU 慢，可能是什么原因？ HOT 3
- 鸿蒙32位 推理速度异常缓慢 HOT 2
- demo. exec segment.cpp推理为纯黑图，改变后处理后，推理结果正常 HOT 4
- 可以出一个详细的在android平台训练模型的教程吗？ HOT 1
- ModuleBasic.out 测试 mnn 模型，load 模型阶段，报错 “PipelineModule:: Can't find enough output from the model, finded is” HOT 3
- opencl ssd 量化 HOT 3
- Python 多次推理会有结果不一致的情况 HOT 5
- 编译android release的libMNN.so的时候怎样可以保留带symbol的so，方便上线定位crash HOT 3
- C++ multi threads call error. HOT 1
- ONNX转换成MNN模型结果错误 HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mnn.