Zhikai Li
github.comzkkli has 7 repositories available. Follow their code on GitHub.
- Page language
- en
- Directory citations
- 1
- Discovery sources
- 1
DUCKQUANT / THE QUANT & AI DIRECTORY
2,336 resources, ranked by in-directory PageRank
zkkli has 7 repositories available. Follow their code on GitHub.
Publication: What Makes Quantization for Large Language Model Hard? An Empirical Study from the Lens of Perturbation. Published Mar 24, 2024.
Publication: Exploring Post-training Quantization in LLMs from Comprehensive Study to Low Rank Compensation. Published Mar 24, 2024.
Publication: Agile-Quant: Activation-Guided Quantization for Faster Inference of LLMs on the Edge. Published Mar 24, 2024.
Publication: Norm Tweaking: High-Performance Low-Bit Quantization of Large Language Models. Published Mar 24, 2024.
Publication: OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Models. Published Mar 24, 2024.
Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".
Reorder-based post-training quantization for large language model
Publication: AQ-DETR: Low-Bit Quantized Detection Transformer with Auxiliary Queries. Published Mar 24, 2024.
Publication: Bi-ViT: Pushing the Limit of Vision Transformer Quantization. Published Mar 24, 2024.
Publication: Instance-Aware Group Quantization for Vision Transformers. Published 2024.
Explore this resource at its source website for documentation and current information.
Public repository by Qualcomm-AI-research. Primary language: Python.
Publication: Q-DETR: An Efficient Low-Bit Quantized Detection Transformer. Published 2023.
Publication: OMPQ: Orthogonal Mixed Precision Quantization. Published Jun 26, 2023.
Compression schema for gradients of activations in backward pass
Publication: PTMQ: Post-training Multi-Bit Quantization of Neural Networks. Published Mar 24, 2024.
Publication: Robustness-Guided Image Synthesis for Data-Free Quantization. Published Mar 24, 2024.
Publication: MetaMix: Meta-State Precision Searcher for Mixed-Precision Activation Quantization. Published Mar 24, 2024.
Publication: Make RepVGG Greater Again: A Quantization-Aware Approach. Published Mar 24, 2024.
Public repository by Qualcomm-AI-research. Primary language: Python.
Publication: Fast and Accurate Binary Neural Networks Based on Depth-Width Reshaping. Published Jun 26, 2023.
Publication: Resilient Binary Neural Network. Published Jun 26, 2023.
Publication: Quantized Feature Distillation for Network Quantization. Published Jun 26, 2023.
Publication: Rethinking Data-Free Quantization as a Zero-Sum Game. Published Jun 26, 2023.
Public repository by Qualcomm-AI-research. Primary language: Python.
Explore this resource at its source website for documentation and current information.
Publication: HAWQ: Hessian AWare Quantization of Neural Networks With Mixed-Precision. Published 2019.
Explore this resource at its source website for documentation and current information.
Embedding Quantization (Compress Word Embeddings)
[NeurIPS 2021] Source code for the paper "Qu-ANTI-zation: Exploiting Neural Network Quantization for Achieving Adversarial Outcomes"
Explore this resource at its source website for documentation and current information.
Explore this resource at its source website for documentation and current information.
Publication: OPQ: Compressing Deep Neural Networks with One-shot Pruning-Quantization. Published May 18, 2021.
Publication: QPP: Real-Time Quantization Parameter Prediction for Deep Neural Networks. Published 2021.
Publication: Automated Log-Scale Quantization for Low-Cost Deep Neural Networks. Published 2021.