Comments (5)
xiaoluomi
commented on June 9, 2024
你好，目前Paddleslim还不支持对Softmax这个op做量化，目前支持的量化op为：['conv2d', 'depthwise_conv2d', 'conv2d_transpose', 'mul', 'matmul', 'matmul_v2']，目前仅支持在Softmax这个OP前插入量化和反量化节点。
from paddleslim.
Zheng-Bicheng
commented on June 9, 2024
你好，目前Paddleslim还不支持对Softmax这个op做量化，目前支持的量化op为：['conv2d', 'depthwise_conv2d', 'conv2d_transpose', 'mul', 'matmul', 'matmul_v2']，目前仅支持在Softmax这个OP前插入量化和反量化节点。
大佬，那这个量化节点的信息有办法修改吗？我需要将scale和zp分别固定
from paddleslim.
xiaoluomi
commented on June 9, 2024
很抱歉，目前Paddleslim是无法提供相应的接口的，无法满足你的特殊需求。
from paddleslim.
Zheng-Bicheng
commented on June 9, 2024
很抱歉，目前Paddleslim是无法提供相应的接口的，无法满足你的特殊需求。
能帮忙给出一下插入softmax量化节点这个步骤是在哪个地方完成的吗？我可以自己进行修改
from paddleslim.
xiaoluomi
commented on June 9, 2024
paddleslim会调用paddlepaddle框架下的量化，在https://github.com/PaddlePaddle/Paddle/blob/28920ca9ef1bf7761c4bd8a42af7d222423feb58/python/paddle/static/quantization/quant_config.py#L236
下表明支持其前面插入量化节点，量化器也在该文件下，具体插入节点等请参照https://github.com/PaddlePaddle/Paddle/tree/28920ca9ef1bf7761c4bd8a42af7d222423feb58/python/paddle/static/quantization
from paddleslim.
Related Issues (20)
- 自动压缩中的蒸馏损失为多个时，配置文件要怎么设置？ HOT 2
- act 自动压缩pytorch_yolo实例中，python onnx--> tensorrt int8推理结果异常 HOT 1
- AttributeError: module 'paddleslim' has no attribute 'models' HOT 1
- 配置pruner的时候显示 0 collections
- 新年好！静态模型离线量化wav2lip，结束后发现没有所谓的 scale 文件 HOT 5
- 如何使用sensitive来确定yolov3 mobilenetv3的剪枝率呀？ HOT 9
- 想问一下你们刚更新的目标检测模型离线量化示例，它支持旋转框吗？例如ppyoloe-r HOT 4
- [Bug]TypeError: 'float' object is not iterable HOT 1
- 有考虑过新增人脸检测模型的压缩例程嘛？ HOT 3
- 请问出现这种情况的原因会是什么？# 自动压缩 autoCompression HOT 4
- 使用paddleslim模型动态剪枝后，如何保存模型呢
- 文档中提供的自动压缩后RT-DETR模型的准确率很低 HOT 5
- 关于自动压缩yolov8-s，run.py的时候出错。 HOT 3
- 报错：var_tensor.shape[0]，tuple index out of range HOT 1
- paddleslim量化的模型如何使用openvino进行推理 HOT 1
- rtdetr进行自动压缩过程中报错如下 HOT 2
- rtdetr nms false HOT 1
- AttributeError HOT 2
- from paddleslim.dygraph.dist中没有import AdaptorBase HOT 12
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from paddleslim.