{"total":175,"rows":[{"id":"2511.08544","title":"LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristics","created":"2025-11-11","cited_by_count":254,"area":null},{"id":"2110.11316","title":"CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIP","created":"2021-10-21","cited_by_count":89,"area":null},{"id":"2304.09355","title":"To Compress or Not to Compress- Self-Supervised Learning and Information Theory: A Review","created":"2023-04-19","cited_by_count":72,"area":null},{"id":"2203.07004","title":"Rethinking Minimal Sufficient Representation in Contrastive Learning","created":"2022-03-14","cited_by_count":69,"area":null},{"id":"2111.02329","title":"Implicit Deep Adaptive Design: Policy-Based Experimental Design without Likelihoods","created":"2021-11-03","cited_by_count":61,"area":null},{"id":"2111.11010","title":"Density Ratio Estimation via Infinitesimal Classification","created":"2021-11-22","cited_by_count":61,"area":null},{"id":"2101.11604","title":"Shape or Texture: Understanding Discriminative Features in CNNs","created":"2021-01-27","cited_by_count":52,"area":null},{"id":"2106.10800","title":"Lossy Compression for Lossless Prediction","created":"2021-06-21","cited_by_count":52,"area":null},{"id":"2102.06866","title":"Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning","created":"2021-02-13","cited_by_count":47,"area":null},{"id":"2109.14595","title":"Generalization Bounds For Meta-Learning: An Information-Theoretic Analysis","created":"2021-09-29","cited_by_count":45,"area":null},{"id":"2201.04309","title":"Robust Contrastive Learning against Noisy Views","created":"2022-01-12","cited_by_count":45,"area":null},{"id":"2209.07999","title":"Self-Supervised Learning with an Information Maximization Criterion","created":"2022-09-16","cited_by_count":38,"area":null},{"id":"2110.02719","title":"The Information Geometry of Unsupervised Reinforcement Learning","created":"2021-10-06","cited_by_count":37,"area":null},{"id":"2302.07920","title":"InfoNCE Loss Provably Learns Cluster-Preserving Representations","created":"2023-02-15","cited_by_count":37,"area":null},{"id":"2306.11078","title":"Beyond Normal: On the Evaluation of Mutual Information Estimators","created":"2023-06-19","cited_by_count":37,"area":null},{"id":"2209.09024","title":"Dataset Inference for Self-Supervised Models","created":"2022-09-16","cited_by_count":36,"area":null},{"id":"2405.09308","title":"TimeX++: Learning Time-Series Explanations with Information Bottleneck","created":"2024-05-15","cited_by_count":33,"area":null},{"id":"2310.09031","title":"MINDE: Mutual Information Neural Diffusion Estimation","created":"2023-10-13","cited_by_count":31,"area":null},{"id":"2106.04989","title":"CLCC: Contrastive Learning for Color Constancy","created":"2021-06-09","cited_by_count":29,"area":null},{"id":"2106.07278","title":"Which Mutual-Information Representation Learning Objectives are Sufficient for Control?","created":"2021-06-14","cited_by_count":29,"area":null},{"id":"2103.11275","title":"Self-supervised Representation Learning with Relative Predictive Coding","created":"2021-03-21","cited_by_count":28,"area":null},{"id":"2106.13401","title":"Decomposed Mutual Information Estimation for Contrastive Representation Learning","created":"2021-06-25","cited_by_count":25,"area":null},{"id":"2110.02501","title":"On the Surrogate Gap between Contrastive and Supervised Losses","created":"2021-10-06","cited_by_count":25,"area":null},{"id":"2303.00633","title":"An Information-Theoretic Perspective on Variance-Invariance-Covariance Regularization","created":"2023-03-01","cited_by_count":25,"area":null},{"id":"2107.11635","title":"Clustering by Maximizing Mutual Information Across Views","created":"2021-07-24","cited_by_count":23,"area":null},{"id":"2107.01152","title":"Simpler, Faster, Stronger: Breaking The log-K Curse On Contrastive Learners With FlatNCE","created":"2021-07-02","cited_by_count":22,"area":null},{"id":"2109.03853","title":"A Bayesian Framework for Information-Theoretic Probing","created":"2021-09-08","cited_by_count":22,"area":null},{"id":"2403.02187","title":"Mutual Information Estimation via Normalizing Flows","created":"2024-03-04","cited_by_count":22,"area":null},{"id":"2301.08164","title":"DiME: Maximizing Mutual Information by a Difference of Matrix-Based Entropies","created":"2023-01-19","cited_by_count":21,"area":null},{"id":"2307.06235","title":"Multimodal Molecular Pretraining via Modality Blending","created":"2023-07-12","cited_by_count":21,"area":null},{"id":"2409.02732","title":"Approximating mutual information of high-dimensional variables using learned representations","created":"2024-09-03","cited_by_count":21,"area":null},{"id":"2202.06618","title":"A Differential Entropy Estimator for Training Neural Networks","created":"2022-02-14","cited_by_count":20,"area":null},{"id":"2109.03560","title":"X-GOAL: Multiplex Heterogeneous Graph Prototypical Contrastive Learning","created":"2021-09-08","cited_by_count":19,"area":null},{"id":"2305.08013","title":"Information Bottleneck Analysis of Deep Neural Networks via Lossy Compression","created":"2023-05-13","cited_by_count":19,"area":null},{"id":"2105.12049","title":"Honest-but-Curious Nets: Sensitive Attributes of Private Inputs Can Be Secretly Coded into the Classifiers' Outputs","created":"2021-05-25","cited_by_count":18,"area":null},{"id":"2107.01131","title":"Tight Mutual Information Estimation With Contrastive Fenchel-Legendre Optimization","created":"2021-07-02","cited_by_count":18,"area":null},{"id":"2305.20025","title":"Mutual Information Estimation via $f$-Divergence and Data Derangements","created":"2023-05-31","cited_by_count":17,"area":null},{"id":"2109.00922","title":"Improving Multimodal fusion via Mutual Dependency Maximisation","created":"2021-08-31","cited_by_count":15,"area":null},{"id":"2103.04813","title":"Boosting Semi-supervised Image Segmentation with Global and Local Mutual Information Regularization","created":"2021-03-08","cited_by_count":14,"area":null},{"id":"2205.03589","title":"Learning Disentangled Textual Representations via Statistical Measures of Similarity","created":"2022-05-07","cited_by_count":14,"area":null},{"id":"2103.06872","title":"Tensor networks and efficient descriptions of classical data","created":"2021-03-11","cited_by_count":13,"area":null},{"id":"2307.10907","title":"The Role of Entropy and Reconstruction in Multi-View Self-Supervised Learning","created":"2023-07-20","cited_by_count":13,"area":null},{"id":"2402.10150","title":"$f$-MICL: Understanding and Generalizing InfoNCE-based Contrastive Learning","created":"2024-02-15","cited_by_count":13,"area":null},{"id":"2108.02373","title":"M2IOSR: Maximal Mutual Information Open Set Recognition","created":"2021-08-05","cited_by_count":12,"area":null},{"id":"2311.17233","title":"Quantifying the redundancy between prosody and text","created":"2023-11-28","cited_by_count":12,"area":null},{"id":"2502.02719","title":"Beyond Topological Self-Explainable GNNs: A Formal Explainability Perspective","created":"2025-02-04","cited_by_count":11,"area":null},{"id":"2107.06456","title":"AID-Purifier: A Light Auxiliary Network for Boosting Adversarial Defense","created":"2021-07-14","cited_by_count":10,"area":null},{"id":"2206.04239","title":"Crosslinguistic word order variation reflects evolutionary pressures of dependency and information locality","created":"2022-06-09","cited_by_count":10,"area":null},{"id":"2211.10856","title":"Diffeomorphic Information Neural Estimation","created":"2022-11-20","cited_by_count":10,"area":null},{"id":"2410.10924","title":"A Benchmark Suite for Evaluating Neural Mutual Information Estimators on Unstructured Datasets","created":"2024-10-14","cited_by_count":10,"area":null},{"id":"2602.01456","title":"Rectified LpJEPA: Joint-Embedding Predictive Architectures with Sparse and Maximum-Entropy Representations","created":"2026-02-01","cited_by_count":10,"area":null},{"id":"2204.01612","title":"Neural Estimation of the Rate-Distortion Function With Applications to Operational Source Coding","created":"2022-04-04","cited_by_count":9,"area":null},{"id":"2307.04755","title":"Information decomposition in complex systems via machine learning","created":"2023-07-10","cited_by_count":9,"area":null},{"id":"2409.06109","title":"Estimating the Completeness of Discrete Speech Units","created":"2024-09-09","cited_by_count":9,"area":null},{"id":"2208.06270","title":"RenyiCL: Contrastive Representation Learning with Skew Renyi Divergence","created":"2022-08-12","cited_by_count":8,"area":null},{"id":"2403.07320","title":"Approaching Rate-Distortion Limits in Neural Compression with Lattice Transform Coding","created":"2024-03-12","cited_by_count":8,"area":null},{"id":"2405.16730","title":"\"Noisier\" Noise Contrastive Eestimation is (Almost) Maximum Likelihood","created":"2024-05-27","cited_by_count":8,"area":null},{"id":"2103.08026","title":"A Scalable Gradient-Free Method for Bayesian Experimental Design with Implicit Models","created":"2021-03-14","cited_by_count":7,"area":null},{"id":"2112.07133","title":"CLIP-Lite: Information Efficient Visual Representation Learning with Language Supervision","created":"2021-12-14","cited_by_count":7,"area":null},{"id":"2210.04974","title":"Function-space regularized R\\'enyi divergences","created":"2022-10-10","cited_by_count":7,"area":null},{"id":"2211.17264","title":"Interpretability with full complexity by constraining feature information","created":"2022-11-30","cited_by_count":7,"area":null},{"id":"2306.00608","title":"On the Effectiveness of Hybrid Mutual Information Estimation","created":"2023-06-01","cited_by_count":7,"area":null},{"id":"2310.10240","title":"On the Properties and Estimation of Pointwise Mutual Information Profiles","created":"2023-10-16","cited_by_count":7,"area":null},{"id":"2502.01383","title":"InfoBridge: Mutual Information estimation via Bridge Matching","created":"2025-02-03","cited_by_count":7,"area":null},{"id":"2102.13182","title":"MIND: Inductive Mutual Information Estimation, A Convex Maximum-Entropy Copula Approach","created":"2021-02-25","cited_by_count":6,"area":null},{"id":"2104.06612","title":"Deep Data Density Estimation through Donsker-Varadhan Representation","created":"2021-04-14","cited_by_count":6,"area":null},{"id":"2212.13425","title":"GEDI: GEnerative and DIscriminative Training for Self-Supervised Learning","created":"2022-12-27","cited_by_count":6,"area":null},{"id":"2305.16967","title":"Evaluating Open-Domain Dialogues in Latent Space with Next Sentence Prediction and Mutual Information","created":"2023-05-26","cited_by_count":6,"area":null},{"id":"2305.18435","title":"Statistically Efficient Bayesian Sequential Experiment Design via Reinforcement Learning with Cross-Entropy Estimators","created":"2023-05-29","cited_by_count":6,"area":null},{"id":"2309.07200","title":"Latent Representation and Simulation of Markov Processes via Time-Lagged Information Bottleneck","created":"2023-09-13","cited_by_count":6,"area":null},{"id":"2402.02444","title":"BECLR: Batch Enhanced Contrastive Few-Shot Learning","created":"2024-02-04","cited_by_count":6,"area":null},{"id":"2407.00482","title":"Towards Formalizing Spuriousness of Biased Datasets Using Partial Information Decomposition","created":"2024-06-29","cited_by_count":6,"area":null},{"id":"2411.15931","title":"Improving Pre-trained Self-Supervised Embeddings Through Effective Entropy Maximization","created":"2024-11-24","cited_by_count":6,"area":null},{"id":"2503.20098","title":"Fundamental Limits of Perfect Concept Erasure","created":"2025-03-25","cited_by_count":6,"area":null},{"id":"2111.06676","title":"A Reverse Jensen Inequality Result with Application to Mutual Information Estimation","created":"2021-11-12","cited_by_count":5,"area":null},{"id":"2208.12352","title":"OOD-Probe: A Neural Interpretation of Out-of-Domain Generalization","created":"2022-08-25","cited_by_count":5,"area":null},{"id":"2402.01399","title":"A Probabilistic Model Behind Self-Supervised Learning","created":"2024-02-02","cited_by_count":5,"area":null},{"id":"2506.04411","title":"Self-Supervised Contrastive Learning is Approximately Supervised Contrastive Learning","created":"2025-06-04","cited_by_count":5,"area":null},{"id":"2101.02083","title":"Representation learning for maximization of MI, nonlinear ICA and nonlinear subspaces with robust density ratio estimation","created":"2021-01-06","cited_by_count":4,"area":null},{"id":"2303.12957","title":"Reinforcement Learning with Exogenous States and Rewards","created":"2023-03-22","cited_by_count":4,"area":null},{"id":"2406.04047","title":"Slicing Mutual Information Generalization Bounds for Neural Networks","created":"2024-06-06","cited_by_count":4,"area":null},{"id":"2410.06993","title":"Efficient Distribution Matching of Representations via Noise-Injected Deep InfoMax","created":"2024-10-09","cited_by_count":4,"area":null},{"id":"2506.14796","title":"PFMBench: Protein Foundation Model Benchmark","created":"2025-06-01","cited_by_count":4,"area":null},{"id":"2510.20644","title":"Connecting Jensen-Shannon and Kullback-Leibler Divergences: A New Bound for Representation Learning","created":"2025-10-23","cited_by_count":4,"area":null},{"id":"2510.20968","title":"Neural Mutual Information Estimation with Vector Copulas","created":"2025-10-23","cited_by_count":4,"area":null},{"id":"2511.12278","title":"PCA++: How Uniformity Induces Robustness to Background Noise in Contrastive Learning","created":"2025-11-15","cited_by_count":4,"area":null},{"id":"2104.06325","title":"Finding Concept-specific Biases in Form--Meaning Associations","created":"2021-04-13","cited_by_count":3,"area":null},{"id":"2110.08931","title":"Quantifying the Task-Specific Information in Text-Based Classifications","created":"2021-10-17","cited_by_count":3,"area":null},{"id":"2210.12562","title":"Greedy Modality Selection via Approximate Submodular Maximization","created":"2022-10-22","cited_by_count":3,"area":null},{"id":"2301.12197","title":"Mutual Wasserstein Discrepancy Minimization for Sequential Recommendation","created":"2023-01-28","cited_by_count":3,"area":null},{"id":"2307.15830","title":"A Distance Correlation-Based Approach to Characterize the Effectiveness of Recurrent Neural Networks for Time Series Forecasting","created":"2023-07-28","cited_by_count":3,"area":null},{"id":"2401.01176","title":"Fundamental Limitation of Semantic Communications: Neural Estimation for Rate-Distortion","created":"2024-01-02","cited_by_count":3,"area":null},{"id":"2405.12456","title":"Mutual Information Analysis in Multimodal Learning Systems","created":"2024-05-21","cited_by_count":3,"area":null},{"id":"2412.11066","title":"Learning Robust and Privacy-Preserving Representations via Information Theory","created":"2024-12-15","cited_by_count":3,"area":null},{"id":"2502.12088","title":"Meta-Statistical Learning: Supervised Learning of Statistical Estimators","created":"2025-02-17","cited_by_count":3,"area":null},{"id":"2503.07691","title":"Fair Text Classification via Transferable Representations","created":"2025-03-10","cited_by_count":3,"area":null},{"id":"2509.02407","title":"Fisher information flow in artificial neural networks","created":"2025-09-02","cited_by_count":3,"area":null},{"id":"2603.03530","title":"Directional Neural Collapse Explains Few-Shot Transfer in Self-Supervised Learning","created":"2026-03-03","cited_by_count":3,"area":null},{"id":"2103.05276","title":"Continual Density Ratio Estimation in an Online Setting","created":"2021-03-09","cited_by_count":2,"area":null},{"id":"2108.00819","title":"Active Learning in Gaussian Process State Space Model","created":"2021-07-30","cited_by_count":2,"area":null}],"next_cursor":"100"}