LLM Inference Unveiled: Survey and Roofline Model Insights
Paper • 2402.16363 • Published • 4
GSA
community
AI & ML interests
None defined yet.
hahnyuan
authored 7
papers almost 2 years ago
Post-training Quantization on Diffusion Models
Paper • 2211.15736 • Published
PB-LLM: Partially Binarized Large Language Models
Paper • 2310.00034 • Published • 2
QuEST: Low-bit Diffusion Model Quantization via Efficient Selective Finetuning
Paper • 2402.03666 • Published
WKVQuant: Quantizing Weight and Key/Value Cache for Large Language Models Gains More
Paper • 2402.12065 • Published
DiTFastAttn: Attention Compression for Diffusion Transformer Models
Paper • 2406.08552 • Published • 25
PD-Quant: Post-Training Quantization based on Prediction Difference Metric
Paper • 2212.07048 • Published