{"total":162,"rows":[{"id":"2108.13624","title":"Towards Out-Of-Distribution Generalization: A Survey","created":"2021-08-31","cited_by_count":436,"area":null},{"id":"2110.08420","title":"Understanding Dataset Difficulty with $\\mathcal{V}$-Usable Information","created":"2021-10-16","cited_by_count":291,"area":null},{"id":"2306.03819","title":"LEACE: Perfect linear concept erasure in closed form","created":"2023-06-06","cited_by_count":267,"area":null},{"id":"2301.04709","title":"Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretability","created":"2023-01-11","cited_by_count":205,"area":"mechinterp"},{"id":"2111.09259","title":"Acquisition of Chess Knowledge in AlphaZero","created":"2021-11-17","cited_by_count":123,"area":null},{"id":"2312.03526","title":"On the Diversity and Realism of Distilled Dataset: An Efficient Dataset Distillation Paradigm","created":"2023-12-06","cited_by_count":109,"area":null},{"id":"2304.10703","title":"ReCEval: Evaluating Reasoning Chains via Correctness and Informativeness","created":"2023-04-21","cited_by_count":77,"area":"lr"},{"id":"2304.09355","title":"To Compress or Not to Compress- Self-Supervised Learning and Information Theory: A Review","created":"2023-04-19","cited_by_count":72,"area":null},{"id":"2403.13043","title":"When Do We Not Need Larger Vision Models?","created":"2024-03-19","cited_by_count":67,"area":null},{"id":"2402.16061","title":"How Large Language Models Encode Context Knowledge? A Layer-Wise Probing Study","created":"2024-02-25","cited_by_count":64,"area":null},{"id":"2109.09234","title":"Conditional probing: measuring usable information beyond a baseline","created":"2021-09-19","cited_by_count":62,"area":null},{"id":"2505.24832","title":"How much do language models memorize?","created":"2025-05-30","cited_by_count":61,"area":null},{"id":"2204.08831","title":"Probing for the Usage of Grammatical Number","created":"2022-04-19","cited_by_count":59,"area":null},{"id":"2106.07156","title":"Temporal Predictive Coding For Model-Based Planning In Latent Space","created":"2021-06-14","cited_by_count":55,"area":null},{"id":"2106.10800","title":"Lossy Compression for Lossless Prediction","created":"2021-06-21","cited_by_count":52,"area":null},{"id":"2106.08367","title":"What Context Features Can Transformer Language Models Use?","created":"2021-06-15","cited_by_count":50,"area":null},{"id":"2404.00859","title":"Do language models plan ahead for future tokens?","created":"2024-04-01","cited_by_count":49,"area":null},{"id":"2101.04108","title":"Controllable Guarantees for Fair Outcomes via Contrastive Information Estimation","created":"2021-01-11","cited_by_count":45,"area":null},{"id":"2302.09466","title":"RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressions","created":"2023-02-19","cited_by_count":43,"area":null},{"id":"2402.08327","title":"PreFLMR: Scaling Up Fine-Grained Late-Interaction Multi-modal Retrievers","created":"2024-02-13","cited_by_count":42,"area":"mllm"},{"id":"2305.18378","title":"Disentanglement via Latent Quantization","created":"2023-05-28","cited_by_count":40,"area":null},{"id":"2505.00661","title":"On the generalization of language models from in-context learning and finetuning: a controlled study","created":"2025-05-01","cited_by_count":40,"area":"lr"},{"id":"2310.12973","title":"Frozen Transformers in Language Models Are Effective Visual Encoder Layers","created":"2023-10-19","cited_by_count":39,"area":null},{"id":"2106.05937","title":"Fair Normalizing Flows","created":"2021-06-10","cited_by_count":38,"area":null},{"id":"2303.10837","title":"FedML-HE: An Efficient Homomorphic-Encryption-Based Privacy-Preserving Federated Learning System","created":"2023-03-20","cited_by_count":38,"area":null},{"id":"2209.06235","title":"Improving Self-Supervised Learning by Characterizing Idealized Representations","created":"2022-09-13","cited_by_count":34,"area":null},{"id":"2203.10995","title":"Word Order Does Matter (And Shuffled Language Models Know It)","created":"2022-03-21","cited_by_count":32,"area":null},{"id":"2403.00025","title":"On the Challenges and Opportunities in Generative AI","created":"2024-02-28","cited_by_count":31,"area":null},{"id":"2503.15484","title":"Value Profiles for Encoding Human Variation","created":"2025-03-19","cited_by_count":29,"area":"alignment"},{"id":"2206.05975","title":"On the Learning of Non-Autoregressive Transformers","created":"2022-06-13","cited_by_count":27,"area":null},{"id":"2307.15054","title":"A Geometric Notion of Causal Probing","created":"2023-07-27","cited_by_count":25,"area":null},{"id":"2311.01270","title":"People Make Better Edits: Measuring the Efficacy of LLM-Generated Counterfactually Augmented Data for Harmful Language Detection","created":"2023-11-02","cited_by_count":25,"area":null},{"id":"2109.03853","title":"A Bayesian Framework for Information-Theoretic Probing","created":"2021-09-08","cited_by_count":22,"area":null},{"id":"2210.04982","title":"REV: Information-Theoretic Evaluation of Free-Text Rationales","created":"2022-10-10","cited_by_count":22,"area":null},{"id":"2210.07213","title":"FARE: Provably Fair Representation Learning with Practical Certificates","created":"2022-10-13","cited_by_count":21,"area":null},{"id":"2401.17505","title":"Arrows of Time for Large Language Models","created":"2024-01-30","cited_by_count":20,"area":null},{"id":"2507.02608","title":"Lost in Latent Space: An Empirical Study of Latent Diffusion Models for Physics Emulation","created":"2025-07-03","cited_by_count":19,"area":"diffusion"},{"id":"2107.01131","title":"Tight Mutual Information Estimation With Contrastive Fenchel-Legendre Optimization","created":"2021-07-02","cited_by_count":18,"area":null},{"id":"2304.01434","title":"VNE: An Effective Method for Improving Deep Representation by Manipulating Eigenvalue Distribution","created":"2023-04-04","cited_by_count":17,"area":null},{"id":"2406.05213","title":"On Subjective Uncertainty Quantification and Calibration in Natural Language Generation","created":"2024-06-07","cited_by_count":16,"area":null},{"id":"2208.10134","title":"Machine Learning with Confidential Computing: A Systematization of Knowledge","created":"2022-08-22","cited_by_count":15,"area":null},{"id":"2407.06076","title":"Understanding Visual Feature Reliance through the Lens of Complexity","created":"2024-07-08","cited_by_count":15,"area":null},{"id":"2210.04643","title":"Critical Learning Periods for Multisensory Integration in Deep Networks","created":"2022-10-06","cited_by_count":14,"area":null},{"id":"2306.08193","title":"Operationalising Representation in Natural Language Processing","created":"2023-06-14","cited_by_count":14,"area":null},{"id":"2506.04870","title":"Aligning Multimodal Representations through an Information Bottleneck","created":"2025-06-05","cited_by_count":13,"area":null},{"id":"2205.12239","title":"Gacs-Korner Common Information Variational Autoencoder","created":"2022-05-24","cited_by_count":12,"area":null},{"id":"2412.05186","title":"One-shot Federated Learning via Synthetic Distiller-Distillate Communication","created":"2024-12-06","cited_by_count":12,"area":null},{"id":"2209.10438","title":"A Measure of the Complexity of Neural Representations based on Partial Information Decomposition","created":"2022-09-21","cited_by_count":11,"area":null},{"id":"2302.09344","title":"Beyond Distribution Shift: Spurious Features Through the Lens of Training Dynamics","created":"2023-02-18","cited_by_count":11,"area":null},{"id":"2305.18213","title":"Gaussian Process Probes (GPP) for Uncertainty-Aware Probing","created":"2023-05-29","cited_by_count":11,"area":null},{"id":"2312.10019","title":"Understanding Probe Behaviors through Variational Bounds of Mutual Information","created":"2023-12-15","cited_by_count":11,"area":null},{"id":"2303.03951","title":"Probing Graph Representations","created":"2023-03-07","cited_by_count":10,"area":null},{"id":"2410.10924","title":"A Benchmark Suite for Evaluating Neural Mutual Information Estimators on Unstructured Datasets","created":"2024-10-14","cited_by_count":10,"area":null},{"id":"2602.18297","title":"Analyzing and Improving Chain-of-Thought Monitorability Through Information Theory","created":"2026-02-20","cited_by_count":10,"area":"lr"},{"id":"2402.07214","title":"Through the Lens of Split Vote: Exploring Disagreement, Difficulty and Calibration in Legal Case Outcome Classification","created":"2024-02-11","cited_by_count":9,"area":null},{"id":"2404.17951","title":"Cauchy-Schwarz Divergence Information Bottleneck for Regression","created":"2024-04-27","cited_by_count":9,"area":null},{"id":"2405.14736","title":"GIFT: Unlocking Full Potential of Labels in Distilled Dataset at Near-zero Cost","created":"2024-05-23","cited_by_count":9,"area":null},{"id":"2506.04877","title":"There Was Never a Bottleneck in Concept Bottleneck Models","created":"2025-06-05","cited_by_count":8,"area":null},{"id":"2602.23163","title":"A Decision-Theoretic Formalisation of Steganography With Applications to LLM Monitoring","created":"2026-02-26","cited_by_count":8,"area":null},{"id":"2401.04305","title":"Advancing Deep Active Learning & Data Subset Selection: Unifying Principles with Information-Theory Intuitions","created":"2024-01-09","cited_by_count":7,"area":null},{"id":"2411.06508","title":"Understanding the Role of Equivariance in Self-supervised Learning","created":"2024-11-10","cited_by_count":7,"area":null},{"id":"2302.03068","title":"Evaluating Self-Supervised Learning via Risk Decomposition","created":"2023-02-06","cited_by_count":6,"area":null},{"id":"2402.19457","title":"$\\texttt{COSMIC}$: Mutual Information for Task-Agnostic Summarization Evaluation","created":"2024-02-29","cited_by_count":6,"area":null},{"id":"2503.20098","title":"Fundamental Limits of Perfect Concept Erasure","created":"2025-03-25","cited_by_count":6,"area":null},{"id":"2211.06420","title":"The Architectural Bottleneck Principle","created":"2022-11-11","cited_by_count":5,"area":null},{"id":"2409.16239","title":"Label-Augmented Dataset Distillation","created":"2024-09-24","cited_by_count":5,"area":null},{"id":"2106.12062","title":"A Practical & Unified Notation for Information-Theoretic Quantities in ML","created":"2021-06-22","cited_by_count":4,"area":null},{"id":"2112.09895","title":"Towards the Explanation of Graph Neural Networks in Digital Pathology with Information Flows","created":"2021-12-18","cited_by_count":4,"area":null},{"id":"2212.09603","title":"Explanation Regeneration via Information Bottleneck","created":"2022-12-19","cited_by_count":4,"area":null},{"id":"2305.16474","title":"FairDP: Certified Fairness with Differential Privacy","created":"2023-05-25","cited_by_count":4,"area":null},{"id":"2312.06499","title":"TaCo: Targeted Concept Erasure Prevents Non-Linear Classifiers From Detecting Protected Attributes","created":"2023-12-11","cited_by_count":4,"area":null},{"id":"2312.10171","title":"Pipeline and Dataset Generation for Automated Fact-checking in Almost Any Language","created":"2023-12-15","cited_by_count":4,"area":null},{"id":"2402.07999","title":"NetInfoF Framework: Measuring and Exploiting Network Usable Information","created":"2024-02-12","cited_by_count":4,"area":null},{"id":"2402.18678","title":"RORA: Robust Free-Text Rationale Evaluation","created":"2024-02-28","cited_by_count":4,"area":null},{"id":"2407.01384","title":"Free-text Rationale Generation under Readability Level Control","created":"2024-07-01","cited_by_count":4,"area":null},{"id":"2410.06232","title":"Range, not Independence, Drives Modularity in Biologically Inspired Representations","created":"2024-10-08","cited_by_count":4,"area":null},{"id":"2410.12774","title":"Identifying Task Groupings for Multi-Task Learning Using Pointwise V-Usable Information","created":"2024-10-16","cited_by_count":4,"area":null},{"id":"2110.08931","title":"Quantifying the Task-Specific Information in Text-Based Classifications","created":"2021-10-17","cited_by_count":3,"area":null},{"id":"2207.11987","title":"Information Processing Equalities and the Information-Risk Bridge","created":"2022-07-25","cited_by_count":3,"area":null},{"id":"2405.10244","title":"Towards Task-Compatible Compressible Representations","created":"2024-05-16","cited_by_count":3,"area":null},{"id":"2601.01620","title":"The Gray Area: Characterizing Moderator Disagreement on Reddit","created":"2026-01-04","cited_by_count":3,"area":null},{"id":"2606.24156","title":"Accelerating Multimodal Large Language Models with Prior-Corrected Token Reduction","created":"2026-06-23","cited_by_count":3,"area":"mllm"},{"id":"2105.13929","title":"Quantifying and Localizing Usable Information Leakage from Neural Network Gradients","created":"2021-05-28","cited_by_count":2,"area":null},{"id":"2210.02989","title":"SynBench: Task-Agnostic Benchmarking of Pretrained Representations using Synthetic Data","created":"2022-10-06","cited_by_count":2,"area":null},{"id":"2404.10268","title":"Modeling Low-Resource Health Coaching Dialogues via Neuro-Symbolic Goal Summarization and Text-Units-Text Generation","created":"2024-04-16","cited_by_count":2,"area":null},{"id":"2405.10376","title":"Dealing Doubt: Unveiling Threat Models in Gradient Inversion Attacks under Federated Learning, A Survey and Taxonomy","created":"2024-05-16","cited_by_count":2,"area":null},{"id":"2406.04892","title":"Sexism Detection on a Data Diet","created":"2024-06-07","cited_by_count":2,"area":null},{"id":"2505.01372","title":"Evaluating Explanations: An Explanatory Virtues Framework for Mechanistic Interpretability -- The Strange Science Part I.ii","created":"2025-05-02","cited_by_count":2,"area":"mechinterp"},{"id":"2512.03107","title":"Detecting AI Hallucinations in Finance: An Information-Theoretic Method Cuts Hallucination Rate by 92%","created":"2025-12-02","cited_by_count":2,"area":null},{"id":"2601.21568","title":"Bridging Functional and Representational Similarity via Usable Information","created":"2026-01-29","cited_by_count":2,"area":null},{"id":"2604.13258","title":"Hessian-Enhanced Token Attribution (HETA): Interpreting Autoregressive LLMs","created":"2026-04-14","cited_by_count":2,"area":null},{"id":"2605.01381","title":"A framework for analyzing concept representations in neural models","created":"2026-05-02","cited_by_count":2,"area":null},{"id":"2607.10039","title":"Are We Ready for AI-Driven Discovery? AI Verification Before the Next Fundamental Physics Breakthrough","created":"2026-07-10","cited_by_count":2,"area":null},{"id":"2210.10012","title":"Log-linear Guardedness and its Implications","created":"2022-10-18","cited_by_count":1,"area":null},{"id":"2301.11688","title":"Can We Use Probing to Better Understand Fine-tuning and Knowledge Distillation of the BERT NLU?","created":"2023-01-27","cited_by_count":1,"area":"distill"},{"id":"2302.05888","title":"Position Matters! Empirical Study of Order Effect in Knowledge-grounded Dialogue","created":"2023-02-12","cited_by_count":1,"area":null},{"id":"2304.00305","title":"Predictive Heterogeneity: Measures and Applications","created":"2023-04-01","cited_by_count":1,"area":null},{"id":"2304.09803","title":"On the Perception of Difficulty: Differences between Humans and AI","created":"2023-04-19","cited_by_count":1,"area":null},{"id":"2310.04557","title":"Measuring Information in Text Explanations","created":"2023-10-06","cited_by_count":1,"area":null},{"id":"2310.10955","title":"A State-Vector Framework for Dataset Effects","created":"2023-10-17","cited_by_count":1,"area":null}],"next_cursor":"100"}