PN-Mix: Pair-Norm Guided Mixed-Precision Key Cache Quantization for Efficient Long-Output LLM Inference
Paper • 2610.19605 • Published • 6
None defined yet.
PN-Mix: Pair-Norm Guided Mixed-Precision Key Cache Quantization for Efficient Long-Output LLM Inference
Replacing Training with Memory: Listwise Selection for Text-to-SQL