{"total":124,"rows":[{"id":"2303.06349","title":"Resurrecting Recurrent Neural Networks for Long Sequences","created":"2023-03-11","cited_by_count":408,"area":null},{"id":"2110.09348","title":"Understanding Dimensional Collapse in Contrastive Self-supervised Learning","created":"2021-10-18","cited_by_count":378,"area":null},{"id":"2102.02611","title":"CKConv: Continuous Kernel Convolution For Sequential Data","created":"2021-02-04","cited_by_count":120,"area":null},{"id":"2104.07167","title":"Orthogonalizing Convolutional Layers with the Cayley Transform","created":"2021-04-14","cited_by_count":105,"area":null},{"id":"2103.02631","title":"RotoGrad: Gradient Homogenization in Multitask Learning","created":"2021-03-03","cited_by_count":83,"area":null},{"id":"2106.13898","title":"Closed-form Continuous-time Neural Models","created":"2021-06-25","cited_by_count":65,"area":null},{"id":"2103.05487","title":"UnICORNN: A recurrent model for learning very long time dependencies","created":"2021-03-09","cited_by_count":56,"area":null},{"id":"2102.04877","title":"Noisy Recurrent Neural Networks","created":"2021-02-09","cited_by_count":42,"area":null},{"id":"2301.12832","title":"Deep networks for system identification: a Survey","created":"2023-01-30","cited_by_count":37,"area":null},{"id":"2102.07432","title":"Fast and accurate optimization on the orthogonal manifold without retraction","created":"2021-02-15","cited_by_count":35,"area":null},{"id":"2106.05275","title":"Tractable Density Estimation on Learned Manifolds with Conformal Embedding Flows","created":"2021-06-09","cited_by_count":31,"area":null},{"id":"2104.05097","title":"Pay attention to your loss: understanding misconceptions about 1-Lipschitz neural networks","created":"2021-04-11","cited_by_count":30,"area":null},{"id":"2203.05483","title":"projUNN: efficient method for training deep networks with unitary matrices","created":"2022-03-10","cited_by_count":27,"area":null},{"id":"2302.08210","title":"A Survey of Geometric Optimization for Deep Learning: From Euclidean Space to Riemannian Manifold","created":"2023-02-16","cited_by_count":21,"area":null},{"id":"2310.10013","title":"Riemannian Residual Neural Networks","created":"2023-10-16","cited_by_count":21,"area":null},{"id":"2303.16510","title":"Infeasible Deterministic, Stochastic, and Variance-Reduction Algorithms for Optimization under Orthogonality Constraints","created":"2023-03-29","cited_by_count":18,"area":null},{"id":"2108.05623","title":"Existence, Stability and Scalability of Orthogonal Convolutional Neural Networks","created":"2021-08-12","cited_by_count":16,"area":null},{"id":"2307.15288","title":"Learning Nonlinear Projections for Reduced-Order Modeling of Dynamical Systems using Constrained Autoencoders","created":"2023-07-28","cited_by_count":16,"area":null},{"id":"2309.08045","title":"Traveling Waves Encode the Recent Past and Enhance Sequence Learning","created":"2023-09-03","cited_by_count":16,"area":null},{"id":"2311.16833","title":"1-Lipschitz Layers Compared: Memory, Speed, and Certifiable Robustness","created":"2023-11-28","cited_by_count":16,"area":null},{"id":"2405.20799","title":"Rough Transformers: Lightweight and Continuous Time Series Modelling through Signature Patching","created":"2024-05-31","cited_by_count":16,"area":null},{"id":"2103.00673","title":"Convolutional Normalization: Improving Deep Convolutional Network Robustness and Training","created":"2021-03-01","cited_by_count":15,"area":null},{"id":"2306.09739","title":"Stabilized Neural Differential Equations for Learning Dynamics with Explicit Constraints","created":"2023-06-16","cited_by_count":15,"area":null},{"id":"2210.01407","title":"Homotopy-based training of NeuralODEs for accurate dynamics discovery","created":"2022-10-04","cited_by_count":14,"area":null},{"id":"2411.01248","title":"Guiding Neural Collapse: Optimising Towards the Nearest Simplex Equiangular Tight Frame","created":"2024-11-02","cited_by_count":14,"area":null},{"id":"2306.01485","title":"Robust low-rank training via approximate orthonormal constraints","created":"2023-06-02","cited_by_count":13,"area":null},{"id":"2305.19059","title":"Geometry-aware training of factorized layers in tensor Tucker format","created":"2023-05-30","cited_by_count":12,"area":null},{"id":"2112.04364","title":"Generalization Error Bounds for Iterative Recovery Algorithms Unfolded as Neural Networks","created":"2021-12-08","cited_by_count":11,"area":null},{"id":"2205.14173","title":"Momentum Stiefel Optimizer, with Applications to Suitably-Orthogonal Attention, and Optimal Transport","created":"2022-05-27","cited_by_count":11,"area":null},{"id":"2305.19190","title":"Inverse Approximation Theory for Nonlinear Recurrent Neural Networks","created":"2023-05-30","cited_by_count":11,"area":null},{"id":"2110.07034","title":"How Does Momentum Benefit Deep Neural Networks Architecture Design? A Few Case Studies","created":"2021-10-13","cited_by_count":10,"area":null},{"id":"2201.12133","title":"O-ViT: Orthogonal Vision Transformer","created":"2022-01-28","cited_by_count":10,"area":null},{"id":"2405.16419","title":"Enhancing Feature Diversity Boosts Channel-Adaptive Vision Transformers","created":"2024-05-26","cited_by_count":10,"area":null},{"id":"2509.09679","title":"ButterflyQuant: Ultra-low-bit LLM Quantization through Learnable Orthogonal Butterfly Transforms","created":"2025-09-11","cited_by_count":10,"area":null},{"id":"2405.16312","title":"Time-SSM: Simplifying and Unifying State Space Models for Time Series Forecasting","created":"2024-05-25","cited_by_count":9,"area":null},{"id":"2204.00740","title":"Path Development Network with Finite-dimensional Lie Group Representation","created":"2022-04-02","cited_by_count":8,"area":null},{"id":"2310.02012","title":"Towards Training Without Depth Limits: Batch Normalization Without Gradient Explosion","created":"2023-10-03","cited_by_count":8,"area":null},{"id":"2410.05499","title":"Unitary convolutions for learning on graphs and groups","created":"2024-10-07","cited_by_count":8,"area":null},{"id":"2509.16664","title":"$\\boldsymbol{\\lambda}$-Orthogonality Regularization for Compatible Representation Learning","created":"2025-09-20","cited_by_count":8,"area":null},{"id":"2603.06242","title":"DC-Merge: Improving Model Merging with Directional Consistency","created":"2026-03-06","cited_by_count":8,"area":null},{"id":"2105.05944","title":"Slower is Better: Revisiting the Forgetting Mechanism in LSTM for Slower Information Decay","created":"2021-05-12","cited_by_count":7,"area":null},{"id":"2106.08928","title":"RNNs of RNNs: Recursive Construction of Stable Assemblies of Recurrent Neural Networks","created":"2021-06-16","cited_by_count":7,"area":null},{"id":"2106.09121","title":"Scaling-up Diverse Orthogonal Convolutional Networks with a Paraunitary Framework","created":"2021-06-16","cited_by_count":7,"area":null},{"id":"2210.00973","title":"NCVX: A General-Purpose Optimization Solver for Constrained Machine and Deep Learning","created":"2022-10-03","cited_by_count":7,"area":null},{"id":"2210.02083","title":"Multi-View Independent Component Analysis with Shared and Individual Sources","created":"2022-10-05","cited_by_count":7,"area":null},{"id":"2304.08914","title":"A Study of Neural Collapse Phenomenon: Grassmannian Frame, Symmetry and Generalization","created":"2023-04-18","cited_by_count":7,"area":null},{"id":"2406.02154","title":"Learning Hamiltonian neural Koopman operator and simultaneously sustaining and discovering conservation law","created":"2024-06-04","cited_by_count":7,"area":null},{"id":"2103.04217","title":"Spectral Tensor Train Parameterization of Deep Learning Layers","created":"2021-03-07","cited_by_count":6,"area":null},{"id":"2303.00399","title":"D4FT: A Deep Learning Approach to Kohn-Sham Density Functional Theory","created":"2023-03-01","cited_by_count":6,"area":null},{"id":"2309.10291","title":"Koopman Invertible Autoencoder: Leveraging Forward and Backward Dynamics for Temporal Modeling","created":"2023-09-19","cited_by_count":6,"area":null},{"id":"2403.12012","title":"Convergence of Kinetic Langevin Monte Carlo on Lie groups","created":"2024-03-18","cited_by_count":6,"area":null},{"id":"2605.12492","title":"Pion: A Spectrum-Preserving Optimizer via Orthogonal Equivalence Transformation","created":"2026-05-12","cited_by_count":6,"area":null},{"id":"2108.00051","title":"Coordinate descent on the orthogonal group for recurrent neural network training","created":"2021-07-30","cited_by_count":5,"area":null},{"id":"2205.08385","title":"Feedback Gradient Descent: Efficient and Stable Optimization with Orthogonality for DNNs","created":"2022-05-12","cited_by_count":5,"area":null},{"id":"2210.01245","title":"Random orthogonal additive filters: a solution to the vanishing/exploding gradient of deep neural networks","created":"2022-10-03","cited_by_count":5,"area":null},{"id":"2212.00228","title":"Gated Recurrent Neural Networks with Weighted Time-Delay Feedback","created":"2022-12-01","cited_by_count":5,"area":null},{"id":"2403.11199","title":"Graph Unitary Message Passing","created":"2024-03-17","cited_by_count":5,"area":null},{"id":"2512.17090","title":"How to Square Tensor Networks and Circuits Without Squaring Them","created":"2025-12-18","cited_by_count":5,"area":null},{"id":"2101.02916","title":"Accelerating Training of Batch Normalization: A Manifold Perspective","created":"2021-01-08","cited_by_count":4,"area":null},{"id":"2111.14777","title":"Deep Decomposition for Stochastic Normal-Abnormal Transport","created":"2021-11-29","cited_by_count":4,"area":null},{"id":"2206.01261","title":"Entangled Residual Mappings","created":"2022-06-02","cited_by_count":4,"area":null},{"id":"2208.06496","title":"Orthogonal Gated Recurrent Unit with Neumann-Cayley Transformation","created":"2022-08-12","cited_by_count":4,"area":null},{"id":"2211.14645","title":"Accelerated Riemannian Optimization: Handling Constraints with a Prox to Bound Geometric Penalties","created":"2022-11-26","cited_by_count":4,"area":null},{"id":"2312.07529","title":"Topological Obstructions and How to Avoid Them","created":"2023-12-12","cited_by_count":4,"area":null},{"id":"2604.02309","title":"go-$m$HC: Direct Parameterization of Manifold-Constrained Hyper-Connections via Generalized Orthostochastic Matrices","created":"2026-04-02","cited_by_count":4,"area":null},{"id":"2102.09589","title":"A Differential Geometry Perspective on Orthogonal Recurrent Models","created":"2021-02-18","cited_by_count":3,"area":null},{"id":"2112.01453","title":"Target Propagation via Regularized Inversion","created":"2021-12-02","cited_by_count":3,"area":null},{"id":"2305.16901","title":"Generalizing Adam to Manifolds for Efficiently Training Transformers","created":"2023-05-26","cited_by_count":3,"area":null},{"id":"2306.09939","title":"Towards Better Orthogonality Regularization with Disentangled Norm in Training Deep CNNs","created":"2023-06-16","cited_by_count":3,"area":null},{"id":"2308.01547","title":"Get the Best of Both Worlds: Improving Accuracy and Transferability by Grassmann Class Representation","created":"2023-08-03","cited_by_count":3,"area":null},{"id":"2505.12378","title":"Efficient Optimization with Orthogonality Constraint: a Randomized Riemannian Submanifold Method","created":"2025-05-18","cited_by_count":3,"area":null},{"id":"2509.11236","title":"Online Optimization on Hadamard Manifolds: Curvature Independent Regret Bounds on Horospherically Convex Objectives","created":"2025-09-14","cited_by_count":3,"area":null},{"id":"2602.14656","title":"An Embarrassingly Simple Way to Optimize Orthogonal Matrices at Scale","created":"2026-02-16","cited_by_count":3,"area":null},{"id":"2102.11855","title":"Deep Unitary Convolutional Neural Networks","created":"2021-02-23","cited_by_count":2,"area":null},{"id":"2203.05082","title":"Givens Coordinate Descent Methods for Rotation Matrix Learning in Trainable Embedding Indexes","created":"2022-03-09","cited_by_count":2,"area":null},{"id":"2412.07883","title":"On Faster Marginalization with Squared Circuits via Orthonormalization","created":"2024-12-10","cited_by_count":2,"area":null},{"id":"2501.15828","title":"Hybrid Quantum Neural Networks with Amplitude Encoding: Advancing Recovery Rate Predictions","created":"2025-01-27","cited_by_count":2,"area":null},{"id":"2507.11688","title":"Composing Linear Layers from Irreducibles","created":"2025-07-15","cited_by_count":2,"area":null},{"id":"2509.20503","title":"Myosotis: structured computation for attention like layer","created":"2025-09-24","cited_by_count":2,"area":null},{"id":"2602.22255","title":"Deep Sequence Modeling with Quantum Dynamics: Language as a Wave Function","created":"2026-02-24","cited_by_count":2,"area":null},{"id":"2605.11508","title":"LiBrA-Net: Lie-Algebraic Bilateral Affine Fields for Real-Time 4K Video Dehazing","created":"2026-05-12","cited_by_count":2,"area":null},{"id":"2606.27880","title":"OrthoTryOn: Geometric Orthogonalization for Conflict-Free Unified Fashion Generation","created":"2026-06-26","cited_by_count":2,"area":null},{"id":"2106.00003","title":"Parallelized Computation and Backpropagation Under Angle-Parametrized Orthogonal Matrices","created":"2021-05-30","cited_by_count":1,"area":null},{"id":"2307.11462","title":"Improve Long-term Memory Learning Through Rescaling the Error Temporally","created":"2023-07-21","cited_by_count":1,"area":null},{"id":"2401.05967","title":"Block-Diagonal Orthogonal Relation and Matrix Entity for Knowledge Graph Embedding","created":"2024-01-11","cited_by_count":1,"area":null},{"id":"2402.04012","title":"Quantized Approximately Orthogonal Recurrent Neural Networks","created":"2024-02-05","cited_by_count":1,"area":null},{"id":"2404.00082","title":"Data-Driven Room Acoustic Modeling Via Differentiable Feedback Delay Networks With Learnable Delay Lines","created":"2024-03-29","cited_by_count":1,"area":null},{"id":"2410.03977","title":"Learning to Balance: Diverse Normalization for Cloth-Changing Person Re-Identification","created":"2024-10-04","cited_by_count":1,"area":null},{"id":"2601.09185","title":"OrthoGeoLoRA: Geometric Parameter-Efficient Fine-Tuning for Structured Social Science Concept Retrieval on theWeb","created":"2026-01-14","cited_by_count":1,"area":null},{"id":"2602.18417","title":"Subgroups of $U(d)$ Induce Natural RNN and Transformer Architectures","created":"2026-02-20","cited_by_count":1,"area":null},{"id":"2603.21684","title":"LipsAM: Lipschitz-Continuous Amplitude Modifier for Audio Signal Processing and its Application to Plug-and-Play Dereverberation","created":"2026-03-23","cited_by_count":1,"area":null},{"id":"2605.05136","title":"CPCANet: Deep Unfolding Common Principal Component Analysis for Domain Generalization","created":"2026-05-06","cited_by_count":1,"area":null},{"id":"2605.05914","title":"Quantum-enhanced Large Language Models on Quantum Hardware via Cayley Unitary Adapters","created":"2026-05-07","cited_by_count":1,"area":null},{"id":"2605.11855","title":"Improving the Performance and Learning Stability of Parallelizable RNNs Designed for Ultra-Low Power Applications","created":"2026-05-12","cited_by_count":1,"area":null},{"id":"2605.16067","title":"SAFE Quantum Machine Learning with Variational Quantum Classifiers","created":"2026-05-15","cited_by_count":1,"area":null},{"id":"2605.20534","title":"Axiomatizing Neural Networks via Pursuit of Subspaces","created":"2026-05-19","cited_by_count":1,"area":null},{"id":"2608.14691","title":"The Quantum Shortcut: Complex Phase-State Dynamics Reduce the Optimization Steps of Sequence Models","created":"2026-08-07","cited_by_count":1,"area":null},{"id":"2102.10052","title":"A Projection Algorithm for the Unitary Weights","created":"2021-02-19","cited_by_count":0,"area":null},{"id":"2203.15576","title":"Subspace-based Representation and Learning for Phonotactic Spoken Language Recognition","created":"2022-03-28","cited_by_count":0,"area":null},{"id":"2210.01348","title":"Fast Saturating Gate for Learning Long Time Scales with Recurrent Neural Networks","created":"2022-10-04","cited_by_count":0,"area":null}],"next_cursor":"100"}