Comments (5)
ZhangZhiPku
commented on May 10, 2024
你是想看cuda的实现还是pytorch的实现?
from ppq.
huoshuai-dot
commented on May 10, 2024
你是想看cuda的实现还是pytorch的实现?
pytorch的
from ppq.
ZhangZhiPku
commented on May 10, 2024
pytorch的实现可以看这个
https://github.com/openppl-public/ppq/blob/master/ppq/quantization/qfunction/linear.py
ppq使用tensor quantization config来控制量化流程，所有量化逻辑都绑定在算子身上，你可以通过op.config来访问这些tensor quantization config结构。ppq.executor在执行到每一个算子的时候，将去读取算子身上绑定的量化信息，并使用 linear.py 中定义的量化函数对数据进行处理。
from ppq.
huoshuai-dot
commented on May 10, 2024
linear.py 定义的是量化tensor的函数 那么 假设一个卷积 他的weight以及bias全部被量化成uint8类型之后 uint8的输入feature跟这些量化后的权重的卷积过程是调用哪些函数去执行呢？还是说pytorch支持uint8的卷积操作？
from ppq.
ZhangZhiPku
commented on May 10, 2024
pytorch不支持uint8的卷积，linear.py里面量化完了还是浮点数哦，你再仔细看看...
from ppq.
Related Issues (20)
- vision transformer量化模型 HOT 1
- 如何将yolov8n-seg进行int8量化. onnx2trtint8
- 回归模型相关咨询 HOT 2
- AttributeError: ORT_OOS_INT8 HOT 1
- LSQ算法微调后，输出的scale量化参数存在负值，请问如何修改源码，使其输出的scale为正值？ HOT 1
- PPQ installtion error: `TypeError: Descriptors cannot be created directly. If this call came from a _pb2.py file, your generated code is out of date and must be regenerated with protoc >= 3.19.0.` HOT 4
- PPQ yolov5-7.0 ：return torch.cat(concat_view, axis=axis) RuntimeError: Sizes of tensors must match except in dimension 1. Expected size 28 but got size 27 for tensor number 1 in the list. HOT 1
- yolov8量化后无结果 HOT 3
- YOLOv6量化后仅能预测一类 HOT 3
- 能不能量化自己的模型啊？有教程吗 HOT 1
- 内存泄露 HOT 3
- yolov5 模型量化后的精度损失 HOT 2
- QLinearMatmul : weight zero point must be a scalar, 1D tensor of size 1, or last to second dimension is 1
- 量化时出现RandomNormalLike这个算子没有注册跟实现的问题，请问有没有简单的注册实现例子可以参考？ HOT 1
- NotImplementedError: Graph op: /quantize/ArgMin(ArgMin) has no backend implementation HOT 1
- 请问model zoo的模型在哪里？ HOT 1
- 调度部分算子至FP32时，生成engine失败 HOT 2
- Op Execution Error: PRelu_1 HOT 4
- 关于resize op的一个bug HOT 1
- 量化模型的时候出现TypeError HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ppq.