Research paper / RESOURCE PROFILE

Fast and Efficient 2-bit LLM Inference on GPU: 2/4/16-bit in a Weight Matrix with Asynchronous Dequantization

Publication: Fast and Efficient 2-bit LLM Inference on GPU: 2/4/16-bit in a Weight Matrix with Asynchronous Dequantization. Published Nov 28, 2023.

arxiv.orgPublished Nov 28, 2023
Visit source website ↗

Overview

Publication: Fast and Efficient 2-bit LLM Inference on GPU: 2/4/16-bit in a Weight Matrix with Asynchronous Dequantization. Published Nov 28, 2023.

Publication information

Publication title
Fast and Efficient 2-bit LLM Inference on GPU: 2/4/16-bit in a Weight Matrix with Asynchronous Dequantization
Authors
Jinhao Li, Jiaming Xu, Shiyao Li, Shan Huang, Jun Liu, Yaoxiu Lian, Guohao Dai
Published
Nov 28, 2023
Last publication revision
Nov 9, 2024
Subject areas
cs.LG, cs.DC
Publication source
arxiv.org · abs/2311.16442v4 ↗

Source: arXiv API · observed Oct 11, 2026.

Source links & provenance

http://arxiv.org/abs/2311.16442 ↗

Discovery references

References explain how this resource entered the collection. They do not represent an endorsement.

Explore related resources

Screenshot unavailableResource information and source links remain available. DeepIntoStreams/TSFM_Finance — reviewed source website screenshot
RepositoryChecked capture

DeepIntoStreams/TSFM_Finance

github.com

the official implementation of the paper “Re(visiting) Time Series Foundation Models in Finance”.

GitHub stars
31
Language
Jupyter Notebook
Code license
Apache-2.0
foundation-modeltime-seriesresearch-lab
96 Authority 96 / 100 Cited by 2 resources in this directory 2 discovery sources Directory record updated: 2026-10-11 How scoring works →

Sign In

Register

Reset Password

Please enter your username or email address, you will receive a link to create a new password via email.