The Limited Multi-Label Projection Layer
Not on the map. Why?
Abstract (arXiv)
We propose the Limited Multi-Label (LML) projection layer as a new primitive operation for end-to-end learning systems. The LML layer provides a probabilistic way of modeling multi-label predictions limited to having exactly k labels. We derive efficient forward and backward passes for this layer and show how the layer can be used to optimize the top-k recall for multi-label tasks with incomplete label information. We evaluate LML layers on top-k CIFAR-100 classification and scene graph generation. We show that LML layers add a negligible amount of computational overhead, strictly improve the model's representational capacity, and improve accuracy. We also revisit the truncated top-k entropy method as a competitive baseline for top-k classification.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 5; 2024: 6; 2025: 1; 2026: 2.
21 papers.
Sort:
By area:
- 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunitiescited by 129
- 2022Tutorial on amortized optimizationcited by 83
- 2022Backpropagation through Combinatorial Algorithms: Identity with Projection Workscited by 29
- 2022Rank-based Decomposable Losses in Machine Learning: A Surveycited by 26
- 2023Fast, Differentiable and Sparse Top-k: a Convex Analysis Perspectivecited by 26
- 2023Backpropagation of Unrolled Solvers with Folded Optimizationcited by 13
- 2022Decision-Focused Learning without Differentiable Optimization: Learning Locally Optimized Decision Lossescited by 12
- 2021Regularized Frank-Wolfe for Dense CRFs: Generalizing Mean Field and Beyondcited by 10
- 2022ZippyPoint: Fast Interest Point Detection, Description, and Matching through Mixed Precision Discretizationcited by 10
- 2024LPGD: A General Framework for Backpropagation through Embedded Optimization Layerscited by 6
- 2024Locally Convex Global Loss Network for Decision-Focused Learningcited by 3
- 2023Adaptive Experimentation at Scale: A Computational Framework for Flexible Batchescited by 2
9 more
- 2024End-to-End Learning for Fair Multiobjective Optimization Under Uncertaintycited by 2
- 2024Preference-Optimized Pareto Set Learning for Blackbox Optimizationcited by 2
- 2025Prediction Loss Guided Decision-Focused Learningcited by 2
- 2023Analyzing and Enhancing the Backward-Pass Convergence of Unrolled Optimizationcited by 1
- 2026Differentiable Knapsack and Top-k Operators via Dynamic Programmingcited by 1
- 2021DiPS: Differentiable Policy for Sketching in Recommender Systemscited by 0
- 2024Efficient Public Health Intervention Planning Using Decomposition-Based Decision-Focused Learningcited by 0
- 2024End-to-End Optimization and Learning of Fair Court Schedulescited by 0
- 2026Differentiable Zero-One Loss via Hypersimplex Projectionscited by 0
- 2026Differentiable Zero-One Loss via Hypersimplex Projections26 Feb 2026
- 2026Differentiable Knapsack and Top-k Operators via Dynamic Programming29 Jan 2026
- 2025Prediction Loss Guided Decision-Focused Learning10 Sep 2025
- 2024End-to-End Optimization and Learning of Fair Court Schedules22 Oct 2024
- 2024Preference-Optimized Pareto Set Learning for Blackbox Optimization19 Aug 2024
- 2024LPGD: A General Framework for Backpropagation through Embedded Optimization Layers8 Jul 2024
- 2024Efficient Public Health Intervention Planning Using Decomposition-Based Decision-Focused Learning8 Mar 2024
- 2024Locally Convex Global Loss Network for Decision-Focused Learning4 Mar 2024
- 2024End-to-End Learning for Fair Multiobjective Optimization Under Uncertainty12 Feb 2024
- 2023Analyzing and Enhancing the Backward-Pass Convergence of Unrolled Optimization28 Dec 2023
- 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunities25 Jul 2023
- 2023Adaptive Experimentation at Scale: A Computational Framework for Flexible Batches21 Mar 2023
9 more
- 2023Fast, Differentiable and Sparse Top-k: a Convex Analysis Perspective2 Feb 2023
- 2023Backpropagation of Unrolled Solvers with Folded Optimization28 Jan 2023
- 2022Rank-based Decomposable Losses in Machine Learning: A Survey18 Jul 2022
- 2022Backpropagation through Combinatorial Algorithms: Identity with Projection Works30 May 2022
- 2022Decision-Focused Learning without Differentiable Optimization: Learning Locally Optimized Decision Losses30 Mar 2022
- 2022ZippyPoint: Fast Interest Point Detection, Description, and Matching through Mixed Precision Discretization7 Mar 2022
- 2022Tutorial on amortized optimization1 Feb 2022
- 2021DiPS: Differentiable Policy for Sketching in Recommender Systems8 Dec 2021
- 2021Regularized Frank-Wolfe for Dense CRFs: Generalizing Mean Field and Beyond27 Oct 2021
- 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunitiescited by 129
- 2022Tutorial on amortized optimizationcited by 83
- 2022Rank-based Decomposable Losses in Machine Learning: A Surveycited by 26
- 2023Fast, Differentiable and Sparse Top-k: a Convex Analysis Perspectivecited by 26
- 2023Backpropagation of Unrolled Solvers with Folded Optimizationcited by 13
- 2022Decision-Focused Learning without Differentiable Optimization: Learning Locally Optimized Decision Lossescited by 12
- 2021Regularized Frank-Wolfe for Dense CRFs: Generalizing Mean Field and Beyondcited by 10
- 2022ZippyPoint: Fast Interest Point Detection, Description, and Matching through Mixed Precision Discretizationcited by 10
- 2024LPGD: A General Framework for Backpropagation through Embedded Optimization Layerscited by 6
- 2024Locally Convex Global Loss Network for Decision-Focused Learningcited by 3
- 2023Adaptive Experimentation at Scale: A Computational Framework for Flexible Batchescited by 2
- 2024End-to-End Learning for Fair Multiobjective Optimization Under Uncertaintycited by 2
12 most cited of 20 All 20 (JSON)
- 2026Differentiable Zero-One Loss via Hypersimplex Projections26 Feb 2026
- 2026Differentiable Knapsack and Top-k Operators via Dynamic Programming29 Jan 2026
- 2025Prediction Loss Guided Decision-Focused Learning10 Sep 2025
- 2024End-to-End Optimization and Learning of Fair Court Schedules22 Oct 2024
- 2024Preference-Optimized Pareto Set Learning for Blackbox Optimization19 Aug 2024
- 2024LPGD: A General Framework for Backpropagation through Embedded Optimization Layers8 Jul 2024
- 2024Efficient Public Health Intervention Planning Using Decomposition-Based Decision-Focused Learning8 Mar 2024
- 2024Locally Convex Global Loss Network for Decision-Focused Learning4 Mar 2024
- 2024End-to-End Learning for Fair Multiobjective Optimization Under Uncertainty12 Feb 2024
- 2023Analyzing and Enhancing the Backward-Pass Convergence of Unrolled Optimization28 Dec 2023
- 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunities25 Jul 2023
- 2023Adaptive Experimentation at Scale: A Computational Framework for Flexible Batches21 Mar 2023
12 newest of 20 All 20 (JSON)