Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jst/add groupwise quantization #150

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

Jiang-Stan
Copy link
Collaborator

@Jiang-Stan Jiang-Stan commented Jul 30, 2023

首尾层8w8f
weight 不同Observer实验:

Model config float MinMax MSE Percentile w/ alpha=1e-3 ACIQ
ResNet18 4w8f weight per-channel-symmetric 69.76% 56.91% 57.59% 58.31% 52.95%
ResNet18 4w8f weight per-group-symmetric group_size=32 69.76% 59.64% 62.08% 59.67% 52.23%
ResNet18 4w8f weight per-group-symmetric group_size=8 69.76% 66.57% 65.99% 66.57% 50.29%

feature不同Observer实验:

Model config float MinMax MSE Percentile w/ alpha=1e-3 ACIQ
ResNet18 8w4f feature per-tensor-affine 69.76% 57.51% 67.90% 67.45% 67.71%
ResNet18 8w4f feature per-group-affine group_size=32 69.76% 60.18% 67.94% 67.49% 67.15%
ResNet18 8w4f feature per-group-affine group_size=8 69.76% 62.69% 67.68% 67.27% 65.496%

@Jiang-Stan Jiang-Stan requested a review from hych2020 July 30, 2023 14:39
@Jiang-Stan Jiang-Stan force-pushed the jst/add_groupwise_quantization branch from 80ce699 to b55dc36 Compare July 31, 2023 03:07
seems ok version

seems ok version

tested ok version

disable input quantizer of silu and upsample

rectified version

black

black

fix bug

fix bug

black
@Jiang-Stan Jiang-Stan force-pushed the jst/add_groupwise_quantization branch from b55dc36 to 61b2b5d Compare July 31, 2023 03:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant