{"list":"other","total":106,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"1912.01703","title":"PyTorch: An Imperative Style, High-Performance Deep Learning Library","created":"2019-12-03","cited_by_count":20305},{"id":"2303.08774","title":"GPT-4 Technical Report","created":"2023-03-15","cited_by_count":18396},{"id":"1910.10683","title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","created":"2019-10-23","cited_by_count":14599},{"id":"2309.06180","title":"Efficient Memory Management for Large Language Model Serving with PagedAttention","created":"2023-09-12","cited_by_count":5944},{"id":"2204.02311","title":"PaLM: Scaling Language Modeling with Pathways","created":"2022-04-05","cited_by_count":5326},{"id":"1701.06538","title":"Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer","created":"2017-01-23","cited_by_count":3509},{"id":"2305.14314","title":"QLoRA: Efficient Finetuning of Quantized LLMs","created":"2023-05-23","cited_by_count":3418},{"id":"2203.15556","title":"Training Compute-Optimal Large Language Models","created":"2022-03-29","cited_by_count":3019},{"id":"2210.17323","title":"GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers","created":"2022-10-31","cited_by_count":1919},{"id":"2503.19786","title":"Gemma 3 Technical Report","created":"2025-03-25","cited_by_count":1824},{"id":"2211.10438","title":"SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models","created":"2022-11-18","cited_by_count":1386},{"id":"2306.00978","title":"AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration","created":"2023-06-01","cited_by_count":1298},{"id":"2301.00774","title":"SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot","created":"2023-01-02","cited_by_count":1121},{"id":"2208.07339","title":"LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale","created":"2022-08-15","cited_by_count":906},{"id":"2404.00456","title":"QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs","created":"2024-03-30","cited_by_count":634},{"id":"2401.18079","title":"KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization","created":"2024-01-31","cited_by_count":591},{"id":"2201.11990","title":"Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model","created":"2022-01-28","cited_by_count":559},{"id":"2102.00554","title":"Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks","created":"2021-01-31","cited_by_count":527},{"id":"2206.01861","title":"ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers","created":"2022-06-04","cited_by_count":526},{"id":"2106.08295","title":"A White Paper on Neural Network Quantization","created":"2021-06-15","cited_by_count":472},{"id":"2308.13137","title":"OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models","created":"2023-08-25","cited_by_count":424},{"id":"2304.13712","title":"Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond","created":"2023-04-26","cited_by_count":411},{"id":"2306.03078","title":"SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression","created":"2023-06-05","cited_by_count":367},{"id":"1909.05840","title":"Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT","created":"2019-09-12","cited_by_count":359},{"id":"1906.04721","title":"Data-Free Quantization Through Weight Equalization and Bias Correction","created":"2019-06-11","cited_by_count":336},{"id":"2305.17888","title":"LLM-QAT: Data-Free Quantization Aware Training for Large Language Models","created":"2023-05-29","cited_by_count":324},{"id":"2208.11580","title":"Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning","created":"2022-08-24","cited_by_count":322},{"id":"2306.07629","title":"SqueezeLLM: Dense-and-Sparse Quantization","created":"2023-06-13","cited_by_count":294},{"id":"2310.19102","title":"Atom: Low-bit Quantization for Efficient and Accurate LLM Serving","created":"2023-10-29","cited_by_count":272},{"id":"2308.07633","title":"A Survey on Model Compression for Large Language Models","created":"2023-08-15","cited_by_count":269},{"id":"1911.03852","title":"HAWQ-V2: Hessian Aware trace-Weighted Quantization of Neural Networks","created":"2019-11-10","cited_by_count":261},{"id":"2405.04532","title":"QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving","created":"2024-05-07","cited_by_count":208},{"id":"2404.14294","title":"A Survey on Efficient Inference for Large Language Models","created":"2024-04-22","cited_by_count":205},{"id":"2304.01433","title":"TPU v4: An Optically Reconfigurable Supercomputer for Machine Learning with Hardware Support for Embeddings","created":"2023-04-04","cited_by_count":202},{"id":"2209.05433","title":"FP8 Formats for Deep Learning","created":"2022-09-12","cited_by_count":196},{"id":"2312.03863","title":"Efficient Large Language Models: A Survey","created":"2023-12-06","cited_by_count":186},{"id":"2406.01721","title":"DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs","created":"2024-06-03","cited_by_count":167},{"id":"2407.11062","title":"EfficientQAT: Efficient Quantization-Aware Training for Large Language Models","created":"2024-07-10","cited_by_count":127},{"id":"2411.03350","title":"A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and Trustworthiness","created":"2024-11-04","cited_by_count":127},{"id":"2304.01089","title":"RPTQ: Reorder-based Post-training Quantization for Large Language Models","created":"2023-04-03","cited_by_count":116},{"id":"2306.02272","title":"OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Models","created":"2023-06-04","cited_by_count":114},{"id":"1712.01507","title":"Bit Fusion: Bit-Level Dynamically Composable Architecture for Accelerating Deep Neural Networks","created":"2017-12-05","cited_by_count":109},{"id":"2005.03842","title":"GOBO: Quantizing Attention-Based NLP Models for Low Latency and Energy Efficient Inference","created":"2020-05-08","cited_by_count":106},{"id":"2402.18096","title":"No Token Left Behind: Reliable KV Cache Compression via Importance-Aware Mixed Precision Quantization","created":"2024-02-28","cited_by_count":101},{"id":"2305.14152","title":"Memory-Efficient Fine-Tuning of Compressed Large Language Models via sub-4-bit Integer Quantization","created":"2023-05-23","cited_by_count":100},{"id":"2310.00034","title":"PB-LLM: Partially Binarized Large Language Models","created":"2023-09-29","cited_by_count":83},{"id":"2004.05795","title":"Rethinking Differentiable Search for Mixed-Precision Neural Networks","created":"2020-04-13","cited_by_count":82},{"id":"2402.18158","title":"Evaluating Quantized Large Language Models","created":"2024-02-28","cited_by_count":77},{"id":"2509.25149","title":"Pretraining Large Language Models with NVFP4","created":"2025-09-29","cited_by_count":76},{"id":"2504.04823","title":"Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models","created":"2025-04-07","cited_by_count":73},{"id":"2102.04503","title":"VS-Quant: Per-vector Scaled Quantization for Accurate Low-Precision Neural Network Inference","created":"2021-02-08","cited_by_count":64},{"id":"2404.14047","title":"An empirical study of LLaMA3 quantization: from LLMs to MLLMs","created":"2024-04-22","cited_by_count":64},{"id":"2405.14917","title":"SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Models","created":"2024-05-23","cited_by_count":63},{"id":"2304.09145","title":"Outlier Suppression+: Accurate quantization of large language models by equivalent and optimal shifting and scaling","created":"2023-04-18","cited_by_count":61},{"id":"2405.10637","title":"Layer-Condensed KV Cache for Efficient Inference of Large Language Models","created":"2024-05-17","cited_by_count":59},{"id":"2501.17116","title":"Optimizing Large Language Model Training Using FP4 Quantization","created":"2025-01-28","cited_by_count":56},{"id":"2411.01433","title":"HOBBIT: A Mixed Precision Expert Offloading System for Fast MoE Inference","created":"2024-11-03","cited_by_count":55},{"id":"2402.10517","title":"Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs","created":"2024-02-16","cited_by_count":54},{"id":"2306.00317","title":"FlexRound: Learnable Rounding based on Element-wise Division for Post-Training Quantization","created":"2023-06-01","cited_by_count":48},{"id":"2402.05964","title":"A Survey on Transformer Compression","created":"2024-02-05","cited_by_count":46},{"id":"2406.06385","title":"Low-Rank Quantization-Aware Training for LLMs","created":"2024-06-10","cited_by_count":43},{"id":"2509.02350","title":"Implicit Reasoning in Large Language Models: A Comprehensive Survey","created":"2025-09-02","cited_by_count":43},{"id":"2310.09259","title":"QUIK: Towards End-to-End 4-Bit Inference on Generative Large Language Models","created":"2023-10-13","cited_by_count":39},{"id":"2501.03035","title":"Quantization Meets Reasoning: Exploring LLM Low-Bit Quantization Degradation for Mathematical Reasoning","created":"2025-01-06","cited_by_count":37},{"id":"2411.02530","title":"A Comprehensive Study on Quantization Techniques for Large Language Models","created":"2024-10-30","cited_by_count":36},{"id":"2412.14363","title":"ResQ: Mixed-Precision Quantization of Large Language Models with Low-Rank Residuals","created":"2024-12-18","cited_by_count":36},{"id":"2402.14866","title":"APTQ: Attention-aware Post-Training Mixed-Precision Quantization for Large Language Models","created":"2024-02-21","cited_by_count":34},{"id":"2409.16694","title":"A Survey of Low-bit Large Language Models: Basics, Systems, and Algorithms","created":"2024-09-25","cited_by_count":31},{"id":"2502.11569","title":"Towards Reasoning Ability of Small Language Models","created":"2025-02-17","cited_by_count":29},{"id":"2311.00502","title":"Efficient LLM Inference on CPUs","created":"2023-11-01","cited_by_count":24},{"id":"2408.08554","title":"ABQ-LLM: Arbitrary-Bit Quantized Inference Acceleration for Large Language Models","created":"2024-08-16","cited_by_count":22},{"id":"2505.18610","title":"PM-KVQ: Progressive Mixed-precision KV Cache Quantization for Long-CoT LLMs","created":"2025-05-24","cited_by_count":22},{"id":"2307.01998","title":"Zero-Shot Neural Architecture Search: Challenges, Solutions, and Opportunities","created":"2023-07-05","cited_by_count":21},{"id":"2309.17224","title":"Training and inference of large language models using 8-bit floating point","created":"2023-09-29","cited_by_count":20},{"id":"2405.07518","title":"SambaNova SN40L: Scaling the AI Memory Wall with Dataflow and Composition of Experts","created":"2024-05-13","cited_by_count":18},{"id":"2410.13461","title":"Progressive Mixed-Precision Decoding for Efficient LLM Inference","created":"2024-10-17","cited_by_count":18},{"id":"2411.11745","title":"BitMoD: Bit-serial Mixture-of-Datatype LLM Acceleration","created":"2024-11-18","cited_by_count":18},{"id":"2508.01625","title":"EAC-MoE: Expert-Selection Aware Compressor for Mixture-of-Experts Large Language Models","created":"2025-08-03","cited_by_count":18},{"id":"2406.08903","title":"Delta-CoMe: Training-Free Delta-Compression with Mixed-Precision for Large Language Models","created":"2024-06-13","cited_by_count":17},{"id":"2412.14590","title":"MixLLM: LLM Quantization with Global Mixed-precision between Output-features and Highly-efficient System Design","created":"2024-12-19","cited_by_count":16},{"id":"2403.01136","title":"LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization","created":"2024-03-02","cited_by_count":15},{"id":"2311.16442","title":"Fast and Efficient 2-bit LLM Inference on GPU: 2/4/16-bit in a Weight Matrix with Asynchronous Dequantization","created":"2023-11-28","cited_by_count":14},{"id":"2509.12019","title":"AMQ: Enabling AutoML for Mixed-precision Weight-Only Quantization of Large Language Models","created":"2025-09-15","cited_by_count":14},{"id":"2405.00314","title":"Model Quantization and Hardware Acceleration for Vision Transformers: A Comprehensive Survey","created":"2024-05-01","cited_by_count":13},{"id":"2407.11534","title":"LRQ: Optimizing Post-Training Quantization for Large Language Models by Learning Low-Rank Weight-Scaling Matrices","created":"2024-07-16","cited_by_count":11},{"id":"2410.13056","title":"Channel-Wise Mixed-Precision Quantization for Large Language Models","created":"2024-10-16","cited_by_count":11},{"id":"2508.02343","title":"MicroMix: Efficient Mixed-Precision Quantization with Microscaling Formats for Large Language Models","created":"2025-08-04","cited_by_count":11},{"id":"2405.03637","title":"Collage: Light-Weight Low-Precision Strategy for LLM Training","created":"2024-05-06","cited_by_count":10},{"id":"2111.10770","title":"Efficient Softmax Approximation for Deep Neural Networks with Attention Mechanism","created":"2021-11-21","cited_by_count":9},{"id":"2404.02837","title":"Cherry on Top: Parameter Heterogeneity and Quantization in Large Language Models","created":"2024-04-03","cited_by_count":9},{"id":"2405.18710","title":"To FP8 and Back Again: Quantifying Reduced Precision Effects on LLM Training Stability","created":"2024-05-29","cited_by_count":9},{"id":"2405.15025","title":"OAC: Output-adaptive Calibration for Accurate Post-training Quantization","created":"2024-05-23","cited_by_count":7},{"id":"2308.03290","title":"FLIQS: One-Shot Mixed-Precision Floating-Point and Integer Quantization Search","created":"2023-08-07","cited_by_count":6},{"id":"2311.04417","title":"Evaluating Emerging AI/ML Accelerators: IPU, RDU, and NVIDIA/AMD GPUs","created":"2023-11-08","cited_by_count":5},{"id":"2411.18065","title":"FlexiBit: Fully Flexible Precision Bit-parallel Accelerator Architecture for Arbitrary Mixed Precision AI","created":"2024-11-27","cited_by_count":5},{"id":"2402.17985","title":"FlattenQuant: Breaking Through the Inference Compute-bound for Large Language Models with Per-tensor Quantization","created":"2024-02-28","cited_by_count":4},{"id":"2503.07654","title":"MergeQuant: Accurate 4-bit Static Quantization of Large Language Models by Channel-wise Calibration","created":"2025-03-07","cited_by_count":4}],"next_cursor":"100"}