A Consistent Regularization Approach for Structured Prediction
Not on the map. Why?
Abstract (arXiv)
We propose and analyze a regularization approach for structured prediction problems. We characterize a large class of loss functions that allows to naturally embed structured outputs in a linear space. We exploit this fact to design learning algorithms using a surrogate loss approach and regularization techniques. We prove universal consistency and finite sample bounds characterizing the generalization properties of the proposed methods. Experimental results are provided to demonstrate the practical usefulness of the proposed approach.
Key facts. Cited by 33 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 May 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 6; 2023: 6; 2024: 9; 2025: 5; 2026: 1.
33 papers.
Sort:
By area:
- 2023Cross-Entropy Loss Functions: Theoretical Analysis and Applicationscited by 210
- 2022Optimal Rates for Regularized Conditional Mean Embedding Learningcited by 50
- 2024A Universal Growth Rate for Learning with Smooth Surrogate Lossescited by 24
- 2022Learning to Predict Graphs with Fused Gromov-Wasserstein Barycenterscited by 22
- 2023Towards Optimal Sobolev Norm Rates for the Vector-Valued Regularized Least-Squares Algorithmcited by 22
- 2024H-Consistency Guarantees for Regressioncited by 21
- 2024Enhanced H-Consistency Boundscited by 18
- 2021Surrogate Regret Bounds for Polyhedral Lossescited by 15
- 2023Estimating Koopman operators with sketching to provably learn large scale dynamical systemscited by 15
- 2024Optimal Rates for Vector-Valued Spectral Regularization Learning Algorithmscited by 12
- 2021Fast rates in structured predictioncited by 11
- 2022Lifting Weak Supervision To Structured Predictioncited by 10
21 more
- 2022Learning Energy Networks with Generalized Fenchel-Young Lossescited by 8
- 2024Nonparametric Instrumental Regression via Kernel Methods is Minimax Optimalcited by 8
- 2024Online Structured Prediction with Fenchel--Young Losses and Improved Surrogate Regret for Online Multiclass Classification with Logistic Losscited by 7
- 2022Vector-Valued Least-Squares Regression under Output Regularity Assumptionscited by 5
- 2023Sketch In, Sketch Out: Accelerating both Learning and Inference for Structured Prediction with Kernelscited by 5
- 2023Geometry-Aware Adaptation for Pretrained Modelscited by 5
- 2021Disambiguation of weak supervision with exponential convergence ratescited by 4
- 2021Fine-grained Generalization Analysis of Structured Output Predictioncited by 4
- 2024Generalization Bounds of Surrogate Policies for Combinatorial Optimization Problemscited by 3
- 2024Nonparametric Sparse Online Learning of the Koopman Operatorcited by 2
- 2024Deep Sketched Output Kernel Regression for Structured Predictioncited by 2
- 2025Establishing Linear Surrogate Regret Bounds for Convex Smooth Losses via Convolutional Fenchel-Young Lossescited by 2
- 2026Linear-Core Surrogates: Smooth Loss Functions with Linear Rates for Classification and Structured Predictioncited by 2
- 2023A Structured Prediction Approach for Robot Imitation Learningcited by 1
- 2025Bandit and Delayed Feedback in Online Structured Predictioncited by 1
- 2025A Kernel-based Stochastic Approximation Framework for Nonlinear Operator Learningcited by 1
- 2021Structured Prediction for CRiSP Inverse Kinematics Learning with Misspecified Robot Modelscited by 0
- 2021Autonomous Driving Implementation in an Experimental Environmentcited by 0
- 2022From Weakly Supervised Learning to Active Learningcited by 0
- 2025Nonparametric Sparse Online Learning of the Koopman Operatorcited by 0
- 2025Non-Stationary Online Structured Prediction with Surrogate Lossescited by 0
- 2026Linear-Core Surrogates: Smooth Loss Functions with Linear Rates for Classification and Structured Prediction30 Apr 2026
- 2025Non-Stationary Online Structured Prediction with Surrogate Losses8 Oct 2025
- 2025A Kernel-based Stochastic Approximation Framework for Nonlinear Operator Learning14 Sep 2025
- 2025Establishing Linear Surrogate Regret Bounds for Convex Smooth Losses via Convolutional Fenchel-Young Losses14 May 2025
- 2025Bandit and Delayed Feedback in Online Structured Prediction26 Feb 2025
- 2025Nonparametric Sparse Online Learning of the Koopman Operator27 Jan 2025
- 2024Nonparametric Instrumental Regression via Kernel Methods is Minimax Optimal29 Nov 2024
- 2024Generalization Bounds of Surrogate Policies for Combinatorial Optimization Problems24 Jul 2024
- 2024Enhanced H-Consistency Bounds18 Jul 2024
- 2024Deep Sketched Output Kernel Regression for Structured Prediction13 Jun 2024
- 2024Optimal Rates for Vector-Valued Spectral Regularization Learning Algorithms23 May 2024
- 2024Nonparametric Sparse Online Learning of the Koopman Operator13 May 2024
21 more
- 2024A Universal Growth Rate for Learning with Smooth Surrogate Losses9 May 2024
- 2024H-Consistency Guarantees for Regression28 Mar 2024
- 2024Online Structured Prediction with Fenchel--Young Losses and Improved Surrogate Regret for Online Multiclass Classification with Logistic Loss13 Feb 2024
- 2023Towards Optimal Sobolev Norm Rates for the Vector-Valued Regularized Least-Squares Algorithm12 Dec 2023
- 2023A Structured Prediction Approach for Robot Imitation Learning26 Sep 2023
- 2023Geometry-Aware Adaptation for Pretrained Models23 Jul 2023
- 2023Estimating Koopman operators with sketching to provably learn large scale dynamical systems7 Jun 2023
- 2023Cross-Entropy Loss Functions: Theoretical Analysis and Applications14 Apr 2023
- 2023Sketch In, Sketch Out: Accelerating both Learning and Inference for Structured Prediction with Kernels20 Feb 2023
- 2022Lifting Weak Supervision To Structured Prediction24 Nov 2022
- 2022Vector-Valued Least-Squares Regression under Output Regularity Assumptions16 Nov 2022
- 2022From Weakly Supervised Learning to Active Learning23 Sep 2022
- 2022Optimal Rates for Regularized Conditional Mean Embedding Learning2 Aug 2022
- 2022Learning Energy Networks with Generalized Fenchel-Young Losses19 May 2022
- 2022Learning to Predict Graphs with Fused Gromov-Wasserstein Barycenters8 Feb 2022
- 2021Surrogate Regret Bounds for Polyhedral Losses26 Oct 2021
- 2021Fine-grained Generalization Analysis of Structured Output Prediction31 May 2021
- 2021Autonomous Driving Implementation in an Experimental Environment23 May 2021
- 2021Structured Prediction for CRiSP Inverse Kinematics Learning with Misspecified Robot Models25 Feb 2021
- 2021Disambiguation of weak supervision with exponential convergence rates4 Feb 2021
- 2021Fast rates in structured prediction1 Feb 2021
- 2023Cross-Entropy Loss Functions: Theoretical Analysis and Applicationscited by 210
- 2022Optimal Rates for Regularized Conditional Mean Embedding Learningcited by 50
- 2024A Universal Growth Rate for Learning with Smooth Surrogate Lossescited by 24
- 2022Learning to Predict Graphs with Fused Gromov-Wasserstein Barycenterscited by 22
- 2023Towards Optimal Sobolev Norm Rates for the Vector-Valued Regularized Least-Squares Algorithmcited by 22
- 2024H-Consistency Guarantees for Regressioncited by 21
- 2024Enhanced H-Consistency Boundscited by 18
- 2021Surrogate Regret Bounds for Polyhedral Lossescited by 15
- 2023Estimating Koopman operators with sketching to provably learn large scale dynamical systemscited by 15
- 2024Optimal Rates for Vector-Valued Spectral Regularization Learning Algorithmscited by 12
- 2021Fast rates in structured predictioncited by 11
- 2022Lifting Weak Supervision To Structured Predictioncited by 10
12 most cited of 32 All 32 (JSON)
- 2026Linear-Core Surrogates: Smooth Loss Functions with Linear Rates for Classification and Structured Prediction30 Apr 2026
- 2025Non-Stationary Online Structured Prediction with Surrogate Losses8 Oct 2025
- 2025A Kernel-based Stochastic Approximation Framework for Nonlinear Operator Learning14 Sep 2025
- 2025Establishing Linear Surrogate Regret Bounds for Convex Smooth Losses via Convolutional Fenchel-Young Losses14 May 2025
- 2025Bandit and Delayed Feedback in Online Structured Prediction26 Feb 2025
- 2025Nonparametric Sparse Online Learning of the Koopman Operator27 Jan 2025
- 2024Nonparametric Instrumental Regression via Kernel Methods is Minimax Optimal29 Nov 2024
- 2024Generalization Bounds of Surrogate Policies for Combinatorial Optimization Problems24 Jul 2024
- 2024Enhanced H-Consistency Bounds18 Jul 2024
- 2024Deep Sketched Output Kernel Regression for Structured Prediction13 Jun 2024
- 2024Optimal Rates for Vector-Valued Spectral Regularization Learning Algorithms23 May 2024
- 2024Nonparametric Sparse Online Learning of the Koopman Operator13 May 2024
12 newest of 32 All 32 (JSON)