{"total":114,"rows":[{"id":"2505.02567","title":"Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunities","created":"2025-05-05","cited_by_count":85,"area":null},{"id":"2505.05427","title":"Ultra-FineWeb: Efficient Data Filtering and Verification for High-Quality LLM Training Data","created":"2025-05-08","cited_by_count":38,"area":null},{"id":"2502.06042","title":"Scaling Laws for Forgetting during Finetuning with Pretraining Data Injection","created":"2025-02-09","cited_by_count":35,"area":null},{"id":"2506.04689","title":"Recycling the Web: A Method to Enhance Pre-training Data Quality and Quantity for Language Models","created":"2025-06-05","cited_by_count":31,"area":null},{"id":"2505.17799","title":"A Coreset Selection of Coreset Selection Literature: Introduction and Recent Advances","created":"2025-05-23","cited_by_count":28,"area":null},{"id":"2512.22382","title":"Completed Hyperparameter Transfer across Modules, Width, Depth, Batch and Duration","created":"2025-12-26","cited_by_count":27,"area":null},{"id":"2502.20082","title":"LongRoPE2: Near-Lossless LLM Context Window Scaling","created":"2025-02-27","cited_by_count":24,"area":null},{"id":"2510.06826","title":"Mid-Training of Large Language Models: A Survey","created":"2025-10-08","cited_by_count":21,"area":null},{"id":"2510.23081","title":"A Survey on LLM Mid-Training","created":"2025-10-27","cited_by_count":21,"area":null},{"id":"2504.08896","title":"Position: Beyond Euclidean -- Foundation Models Should Embrace Non-Euclidean Geometries","created":"2025-04-11","cited_by_count":18,"area":null},{"id":"2511.04418","title":"The Illusion of Certainty: Uncertainty Quantification for LLMs Fails under Ambiguity","created":"2025-11-06","cited_by_count":17,"area":null},{"id":"2511.18903","title":"How Learning Rate Decay Wastes Your Best Data in Curriculum-Based LLM Pretraining","created":"2025-11-24","cited_by_count":14,"area":null},{"id":"2502.11948","title":"HalluEntity: Benchmarking and Understanding Entity-Level Hallucination Detection","created":"2025-02-17","cited_by_count":13,"area":null},{"id":"2502.14709","title":"Group-Level Data Selection for Efficient Pretraining","created":"2025-02-20","cited_by_count":13,"area":null},{"id":"2510.24963","title":"Language Model Behavioral Phases are Consistent Across Architecture, Training Data, and Scale","created":"2025-10-28","cited_by_count":13,"area":null},{"id":"2601.00671","title":"Fast-weight Product Key Memory","created":"2026-01-02","cited_by_count":13,"area":null},{"id":"2504.08716","title":"ModernBERT or DeBERTaV3? Examining Architecture and Data Influence on Transformer Encoder Models Performance","created":"2025-04-11","cited_by_count":12,"area":null},{"id":"2503.01901","title":"Identifying Sensitive Weights via Post-quantization Integral","created":"2025-02-28","cited_by_count":11,"area":null},{"id":"2506.04179","title":"SkipGPT: Dynamic Layer Pruning Reinvented with Token Awareness and Module Decoupling","created":"2025-06-04","cited_by_count":11,"area":null},{"id":"2502.06663","title":"EfficientLLM: Scalable Pruning-Aware Pretraining for Architecture-Agnostic Edge Language Models","created":"2025-02-10","cited_by_count":10,"area":null},{"id":"2503.12294","title":"The Lucie-7B LLM and the Lucie Training Dataset: Open resources for multilingual language generation","created":"2025-03-15","cited_by_count":10,"area":null},{"id":"2502.16860","title":"LongAttn: Selecting Long-context Training Data via Token-level Attention","created":"2025-02-24","cited_by_count":9,"area":null},{"id":"2505.22251","title":"Evaluation of LLMs in Speech is Often Flawed: Test Set Contamination in Large Language Models for Speech Recognition","created":"2025-05-28","cited_by_count":9,"area":null},{"id":"2510.10618","title":"Preserving LLM Capabilities through Calibration Data Curation: From Analysis to Optimization","created":"2025-10-12","cited_by_count":9,"area":null},{"id":"2411.19574","title":"KV Shifting Attention Enhances Language Modeling","created":"2024-11-29","cited_by_count":8,"area":null},{"id":"2506.14111","title":"Essential-Web v1.0: 24T tokens of organized web data","created":"2025-06-17","cited_by_count":8,"area":null},{"id":"2506.21545","title":"Data Efficacy for Language Model Training","created":"2025-06-26","cited_by_count":8,"area":null},{"id":"2509.20214","title":"Q-Palette: Fractional-Bit Quantizers Toward Optimal Bit Allocation for Efficient LLM Deployment","created":"2025-09-24","cited_by_count":8,"area":null},{"id":"2411.17800","title":"STAR: Synthesis of Tailored Architectures","created":"2024-11-26","cited_by_count":7,"area":null},{"id":"2502.14907","title":"GneissWeb: Preparing High Quality Data for LLMs at Scale","created":"2025-02-19","cited_by_count":7,"area":null},{"id":"2504.12491","title":"Can Pre-training Indicators Reliably Predict Fine-tuning Outcomes of LLMs?","created":"2025-04-16","cited_by_count":7,"area":null},{"id":"2505.12238","title":"PANORAMA: A synthetic PII-laced dataset for studying sensitive data memorization in LLMs","created":"2025-05-18","cited_by_count":7,"area":null},{"id":"2506.01790","title":"IF-GUIDE: Influence Function-Guided Detoxification of LLMs","created":"2025-06-02","cited_by_count":7,"area":null},{"id":"2507.16178","title":"LLM Data Selection and Utilization via Dynamic Bi-level Optimization","created":"2025-07-22","cited_by_count":7,"area":null},{"id":"2504.01542","title":"Register Always Matters: Analysis of LLM Pretraining Data Through the Lens of Language Variation","created":"2025-04-02","cited_by_count":6,"area":null},{"id":"2504.07854","title":"The KL3M Data Project: Copyright-Clean Training Resources for Large Language Models","created":"2025-04-10","cited_by_count":6,"area":null},{"id":"2508.00109","title":"FACTORY: A Challenging Human-Verified Prompt Set for Long-Form Factuality","created":"2025-07-31","cited_by_count":6,"area":null},{"id":"2509.13765","title":"TENET: An Efficient Sparsity-Aware LUT-Centric Architecture for Ternary LLM Inference On Edge","created":"2025-09-17","cited_by_count":6,"area":null},{"id":"2510.10681","title":"RePro: Training Language Models to Faithfully Recycle the Web for Pretraining","created":"2025-10-12","cited_by_count":6,"area":null},{"id":"2602.12414","title":"propella-1: Multi-Property Document Annotation for LLM Data Curation at Scale","created":"2026-02-12","cited_by_count":6,"area":null},{"id":"2505.07796","title":"Learning Dynamics in Continual Pre-Training for Large Language Models","created":"2025-05-12","cited_by_count":5,"area":null},{"id":"2506.10952","title":"Domain2Vec: Vectorizing Datasets to Find the Optimal Data Mixture without Training","created":"2025-06-12","cited_by_count":5,"area":null},{"id":"2507.01785","title":"MuRating: A High Quality Data Selecting Approach to Multilingual Large Language Model Pretraining","created":"2025-07-02","cited_by_count":5,"area":null},{"id":"2603.26164","title":"DataFlex: A Unified Framework for Data-Centric Dynamic Training of Large Language Models","created":"2026-03-27","cited_by_count":5,"area":null},{"id":"2508.04676","title":"GeRe: Towards Efficient Anti-Forgetting in Continual Learning of LLM via General Samples Replay","created":"2025-08-06","cited_by_count":4,"area":null},{"id":"2510.09655","title":"Data Provenance Auditing of Fine-Tuned Large Language Models with a Text-Preserving Technique","created":"2025-10-07","cited_by_count":4,"area":null},{"id":"2510.20984","title":"Learning Grouped Lattice Vector Quantizers for Low-Bit LLM Compression","created":"2025-10-23","cited_by_count":4,"area":null},{"id":"2602.09003","title":"Data Science and Technology Towards AGI Part I: Tiered Data Management","created":"2026-02-09","cited_by_count":4,"area":null},{"id":"2605.23454","title":"ARES: Automated Rubric Synthesis for Scalable LLM Reinforcement Learning","created":"2026-05-22","cited_by_count":4,"area":null},{"id":"2606.24998","title":"Internal Data Repetition Destroys Language Models","created":"2026-06-23","cited_by_count":4,"area":null},{"id":"2502.01804","title":"Soup-of-Experts: Pretraining Specialist Models via Parameters Averaging","created":"2025-02-03","cited_by_count":3,"area":null},{"id":"2505.11076","title":"Addition is almost all you need: Compressing large language models with double binary factorization","created":"2025-05-16","cited_by_count":3,"area":null},{"id":"2506.16552","title":"Revela: Dense Retriever Learning via Language Modeling","created":"2025-06-19","cited_by_count":3,"area":null},{"id":"2507.21138","title":"TTS-1 Technical Report","created":"2025-07-22","cited_by_count":3,"area":null},{"id":"2510.00866","title":"Removing Noise, not Finding Gold: Quality Filtering for Large-Scale Pretraining","created":"2025-10-01","cited_by_count":3,"area":null},{"id":"2510.01879","title":"REPAIR: Robust Editing via Progressive Adaptive Intervention and Reintegration","created":"2025-10-02","cited_by_count":3,"area":null},{"id":"2510.13996","title":"The German Commons - 154 Billion Tokens of Openly Licensed Text for German Language Models","created":"2025-10-15","cited_by_count":3,"area":null},{"id":"2510.20860","title":"Data-Centric Lessons To Improve Speech-Language Pretraining","created":"2025-10-22","cited_by_count":3,"area":null},{"id":"2511.21513","title":"IntAttention: A Fully Integer Attention Pipeline for Efficient Edge Inference","created":"2025-11-26","cited_by_count":3,"area":null},{"id":"2602.04706","title":"LiteToken: Removing Intermediate Merge Residues From BPE Tokenizers","created":"2026-02-04","cited_by_count":3,"area":null},{"id":"2602.17698","title":"ScaleBITS: Scalable Bitwidth Search for Hardware-Aligned Mixed-Precision LLMs","created":"2026-02-06","cited_by_count":3,"area":null},{"id":"2604.04204","title":"How Does \"English (US)\" Become the Default? Triangulating Structural Bias Towards American English Across the LLM Pipeline","created":"2026-04-05","cited_by_count":3,"area":null},{"id":"2606.10531","title":"LC-QAT: Data-Efficient 2-Bit QAT for LLMs via Linear-Constrained Vector Quantization","created":"2026-06-09","cited_by_count":3,"area":null},{"id":"2502.05159","title":"A Lightweight Method to Disrupt Memorized Sequences in LLM","created":"2025-02-07","cited_by_count":2,"area":null},{"id":"2509.23488","title":"Mapping Overlaps in Benchmarks through Perplexity in the Wild","created":"2025-09-27","cited_by_count":2,"area":null},{"id":"2510.01240","title":"RSAVQ: Riemannian Sensitivity-Aware Vector Quantization for Large Language Models","created":"2025-09-24","cited_by_count":2,"area":null},{"id":"2512.02901","title":"Fairy2i: Training Complex LLMs from Real LLMs with All Parameters in $\\{\\pm 1, \\pm i\\}$","created":"2025-12-02","cited_by_count":2,"area":null},{"id":"2512.12880","title":"Improving Recursive Transformers with Mixture of LoRAs","created":"2025-12-14","cited_by_count":2,"area":null},{"id":"2603.10351","title":"Mitigating Translationese Bias in Multilingual LLM-as-a-Judge via Disentangled Information Bottleneck","created":"2026-03-11","cited_by_count":2,"area":null},{"id":"2603.20843","title":"HiCI: Hierarchical Construction-Integration for Long-Context Attention","created":"2026-03-21","cited_by_count":2,"area":null},{"id":"2607.11052","title":"Domain-Aware Scaling Laws Uncover Data Synergy","created":"2026-07-13","cited_by_count":2,"area":null},{"id":"2504.14569","title":"NoWag: A Unified Framework for Shape Preserving Compression of Large Language Models","created":"2025-04-20","cited_by_count":1,"area":null},{"id":"2505.15024","title":"Diagnosing our datasets: How does my language model learn clinical information?","created":"2025-05-21","cited_by_count":1,"area":null},{"id":"2506.02077","title":"Assigning Distinct Roles to Quantized and Low-Rank Matrices Toward Optimal Weight Decomposition","created":"2025-06-02","cited_by_count":1,"area":null},{"id":"2506.15461","title":"All is Not Lost: LLM Recovery without Checkpoints","created":"2025-06-18","cited_by_count":1,"area":null},{"id":"2508.03542","title":"Speech-to-LaTeX: New Models and Datasets for Converting Spoken Equations and Sentences","created":"2025-08-05","cited_by_count":1,"area":null},{"id":"2509.22418","title":"Partial Parameter Updates for Efficient Distributed Training","created":"2025-09-26","cited_by_count":1,"area":null},{"id":"2510.11234","title":"Neural Weight Compression for Language Models","created":"2025-10-13","cited_by_count":1,"area":null},{"id":"2511.07505","title":"FedRW: Efficient Privacy-Preserving Data Reweighting for Enhancing Federated Learning of Language Models","created":"2025-11-10","cited_by_count":1,"area":null},{"id":"2511.18054","title":"Blu-WERP (Web Extraction and Refinement Pipeline): A Scalable Pipeline for Preprocessing Large Language Model Datasets","created":"2025-11-22","cited_by_count":1,"area":null},{"id":"2602.00300","title":"Faithful-Patchscopes: Understanding and Mitigating Model Bias in Hidden Representations Explanation of Large Language Models","created":"2026-01-30","cited_by_count":1,"area":null},{"id":"2602.02001","title":"Preserve-Then-Quantize: Balancing Rank Budgets for Quantization Error Reconstruction in LLMs","created":"2026-02-02","cited_by_count":1,"area":null},{"id":"2602.16704","title":"Reinforced Fast Weights with Next-Sequence Prediction","created":"2026-02-18","cited_by_count":1,"area":null},{"id":"2604.01178","title":"Screening Is Enough","created":"2026-04-01","cited_by_count":1,"area":null},{"id":"2606.14150","title":"Small LLMs: Pruning vs. Training from Scratch","created":"2026-06-12","cited_by_count":1,"area":null},{"id":"2607.08646","title":"UltraX: Refining Pre-Training Data at Scale with Adaptive Programmatic Editing","created":"2026-07-09","cited_by_count":1,"area":null},{"id":"2607.24717","title":"DataOrchestra: Learning to Orchestrate Per-Example Curation of Pretraining Data","created":"2026-07-27","cited_by_count":1,"area":null},{"id":"2607.28418","title":"WIDE: Boosting Adaptive LLM Inference via Token-level Dynamic Width Pruning","created":"2026-07-30","cited_by_count":1,"area":null},{"id":"2608.23705","title":"The Limits of Automatic Evaluation of Creativity in Large Language Models","created":"2026-08-24","cited_by_count":1,"area":null},{"id":"2412.17490","title":"A Toolkit for Virtual Reality Data Collection","created":"2024-12-23","cited_by_count":0,"area":null},{"id":"2505.16333","title":"Understanding Differential Transformer Unchains Pretrained Self-Attentions","created":"2025-05-22","cited_by_count":0,"area":null},{"id":"2505.24241","title":"Advantageous Parameter Expansion Training Makes Better Large Language Models","created":"2025-05-30","cited_by_count":0,"area":null},{"id":"2510.02483","title":"Litespark Technical Report: High-Throughput, Energy-Efficient LLM Training Framework","created":"2025-10-02","cited_by_count":0,"area":null},{"id":"2510.16757","title":"SAMOSA: Sharpness Aware Minimization for Open Set Active learning","created":"2025-10-19","cited_by_count":0,"area":null},{"id":"2511.05743","title":"In-Context Learning Without Copying","created":"2025-11-07","cited_by_count":0,"area":null},{"id":"2511.10027","title":"ChEmREF: Evaluating Language Model Readiness for Chemical Emergency Response","created":"2025-11-13","cited_by_count":0,"area":null},{"id":"2511.21736","title":"R2Q: Towards Robust 2-Bit Large Language Models via Residual Refinement Quantization","created":"2025-11-21","cited_by_count":0,"area":null},{"id":"2512.07454","title":"Persian-Phi: Efficient Cross-Lingual Adaptation of Compact LLMs via Curriculum Learning","created":"2025-12-08","cited_by_count":0,"area":null},{"id":"2512.21580","title":"Gamayun's Path to Multilingual Mastery: Cost-Efficient Training of a 1.5B-Parameter LLM","created":"2025-12-25","cited_by_count":0,"area":null},{"id":"2601.10804","title":"BYOL: Bring Your Own Language Into LLMs","created":"2026-01-15","cited_by_count":0,"area":null}],"next_cursor":"100"}