{"list":"other","total":87,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"2106.09685","title":"LoRA: Low-Rank Adaptation of Large Language Models","created":"2021-06-17","cited_by_count":14380},{"id":"2312.00752","title":"Mamba: Linear-Time Sequence Modeling with Selective State Spaces","created":"2023-12-01","cited_by_count":4718},{"id":"1409.0473","title":"Neural Machine Translation by Jointly Learning to Align and Translate","created":"2014-09-01","cited_by_count":4548},{"id":"2101.03961","title":"Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity","created":"2021-01-11","cited_by_count":3073},{"id":"1911.11641","title":"PIQA: Reasoning about Physical Commonsense in Natural Language","created":"2019-11-26","cited_by_count":2883},{"id":"2111.00396","title":"Efficiently Modeling Long Sequences with Structured State Spaces","created":"2021-10-31","cited_by_count":2465},{"id":"1412.3555","title":"Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling","created":"2014-12-11","cited_by_count":2367},{"id":"2006.16236","title":"Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention","created":"2020-06-29","cited_by_count":2022},{"id":"1901.02860","title":"Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context","created":"2019-01-09","cited_by_count":1850},{"id":"2009.14794","title":"Rethinking Attention with Performers","created":"2020-09-30","cited_by_count":1601},{"id":"2006.04768","title":"Linformer: Self-Attention with Linear Complexity","created":"2020-06-08","cited_by_count":1474},{"id":"2404.06654","title":"RULER: What's the Real Context Size of Your Long-Context Language Models?","created":"2024-04-09","cited_by_count":1346},{"id":"2111.07832","title":"iBOT: Image BERT Pre-Training with Online Tokenizer","created":"2021-11-15","cited_by_count":903},{"id":"2305.13048","title":"RWKV: Reinventing RNNs for the Transformer Era","created":"2023-05-22","cited_by_count":827},{"id":"2307.08621","title":"Retentive Network: A Successor to Transformer for Large Language Models","created":"2023-07-17","cited_by_count":613},{"id":"2003.05997","title":"Efficient Content-Based Sparse Attention with Routing Transformers","created":"2020-03-12","cited_by_count":471},{"id":"2103.03404","title":"Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depth","created":"2021-03-05","cited_by_count":419},{"id":"2302.10866","title":"Hyena Hierarchy: Towards Larger Convolutional Language Models","created":"2023-02-21","cited_by_count":393},{"id":"1906.05113","title":"A Survey of Autonomous Driving: Common Practices and Emerging Technologies","created":"2019-06-12","cited_by_count":379},{"id":"2105.03404","title":"ResMLP: Feedforward networks for image classification with data-efficient training","created":"2021-05-07","cited_by_count":339},{"id":"2405.04517","title":"xLSTM: Extended Long Short-Term Memory","created":"2024-05-07","cited_by_count":327},{"id":"2404.02060","title":"Long-context LLMs Struggle with Long In-context Learning","created":"2024-04-02","cited_by_count":286},{"id":"2312.14197","title":"Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Models","created":"2023-12-21","cited_by_count":264},{"id":"2002.02562","title":"Transformer Transducer: A Streamable Speech Recognition Model with Transformer Encoders and RNN-T Loss","created":"2020-02-07","cited_by_count":235},{"id":"1907.10641","title":"WinoGrande: An Adversarial Winograd Schema Challenge at Scale","created":"2019-07-24","cited_by_count":204},{"id":"2311.04939","title":"LooGLE: Can Long-Context Language Models Understand Long Contexts?","created":"2023-11-08","cited_by_count":202},{"id":"2308.10168","title":"Head-to-Tail: How Knowledgeable are Large Language Models (LLMs)? A.K.A. Will LLMs Replace Knowledge Graphs?","created":"2023-08-20","cited_by_count":168},{"id":"2404.05892","title":"Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence","created":"2024-04-08","cited_by_count":159},{"id":"1901.04407","title":"Self-Driving Cars: A Survey","created":"2019-01-14","cited_by_count":148},{"id":"2201.05337","title":"A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models","created":"2022-01-14","cited_by_count":129},{"id":"2106.09388","title":"Deep Subdomain Adaptation Network for Image Classification","created":"2021-06-17","cited_by_count":119},{"id":"2105.14103","title":"An Attention Free Transformer","created":"2021-05-28","cited_by_count":112},{"id":"2007.03141","title":"Dual Mixup Regularized Learning for Adversarial Domain Adaptation","created":"2020-07-07","cited_by_count":99},{"id":"2403.02308","title":"Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architectures","created":"2024-03-04","cited_by_count":98},{"id":"2306.16636","title":"CMATH: Can Your Language Model Pass Chinese Elementary School Math Test?","created":"2023-06-29","cited_by_count":90},{"id":"2401.12973","title":"In-Context Language Learning: Architectures and Algorithms","created":"2024-01-23","cited_by_count":89},{"id":"2109.13226","title":"BigSSL: Exploring the Frontier of Large-Scale Semi-Supervised Learning for Automatic Speech Recognition","created":"2021-09-27","cited_by_count":88},{"id":"2404.07544","title":"From Words to Numbers: Your Large Language Model Is Secretly A Capable Regressor When Given In-Context Examples","created":"2024-04-11","cited_by_count":57},{"id":"2307.15020","title":"SuperCLUE: A Comprehensive Chinese Large Language Model Benchmark","created":"2023-07-27","cited_by_count":50},{"id":"2404.15956","title":"A Survey on Visual Mamba","created":"2024-04-24","cited_by_count":50},{"id":"2407.01527","title":"KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark of Long Context Capable Approaches","created":"2024-07-01","cited_by_count":42},{"id":"2404.04478","title":"Diffusion-RWKV: Scaling RWKV-Like Architectures for Diffusion Models","created":"2024-04-06","cited_by_count":41},{"id":"2407.18232","title":"LION: Linear Group RNN for 3D Object Detection in Point Clouds","created":"2024-07-25","cited_by_count":38},{"id":"2410.01201","title":"Were RNNs All We Needed?","created":"2024-10-02","cited_by_count":38},{"id":"2407.11087","title":"Restore-RWKV: Efficient and Effective Medical Image Restoration with RWKV","created":"2024-07-14","cited_by_count":36},{"id":"2401.15641","title":"PRE: A Peer Review Based Large Language Model Evaluator","created":"2024-01-28","cited_by_count":28},{"id":"2102.00813","title":"About Face: A Survey of Facial Recognition Evaluation","created":"2021-02-01","cited_by_count":27},{"id":"2401.00690","title":"Benchmarking Large Language Models on Controllable Generation under Diversified Instructions","created":"2024-01-01","cited_by_count":27},{"id":"2406.06973","title":"RWKV-CLIP: A Robust Vision-Language Representation Learner","created":"2024-06-11","cited_by_count":23},{"id":"2401.09093","title":"RWKV-TS: Beyond Traditional Recurrent Neural Network for Time Series Tasks","created":"2024-01-17","cited_by_count":22},{"id":"2405.15214","title":"PointRWKV: Efficient RWKV-Like Model for Hierarchical Point Cloud Learning","created":"2024-05-24","cited_by_count":21},{"id":"2310.10266","title":"Generative Calibration for In-context Learning","created":"2023-10-16","cited_by_count":20},{"id":"2310.15147","title":"S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Models","created":"2023-10-23","cited_by_count":18},{"id":"2406.19369","title":"Mamba or RWKV: Exploring High-Quality and High-Efficiency Segment Anything Model","created":"2024-06-27","cited_by_count":18},{"id":"2407.12077","title":"GoldFinch: High Performance RWKV/Transformer Hybrid with Linear Pre-Fill and Extreme KV-Cache Compression","created":"2024-07-16","cited_by_count":18},{"id":"2310.08049","title":"Is attention required for ICL? Exploring the Relationship Between Model Architecture and In-Context Learning Ability","created":"2023-10-12","cited_by_count":17},{"id":"2312.03121","title":"Evaluating Agents using Social Choice Theory","created":"2023-12-05","cited_by_count":11},{"id":"2406.13362","title":"VisualRWKV: Exploring Recurrent Neural Networks for Visual Language Models","created":"2024-06-19","cited_by_count":10},{"id":"2403.19913","title":"MANGO: A Benchmark for Evaluating Mapping and Navigation Abilities of Large Language Models","created":"2024-03-29","cited_by_count":9},{"id":"2404.05971","title":"Does Transformer Interpretability Transfer to RNNs?","created":"2024-04-09","cited_by_count":9},{"id":"2407.08112","title":"How Well Can a Long Sequence Model Model Long Sequences? Comparing Architechtural Inductive Biases on Long-Context Abilities","created":"2024-07-11","cited_by_count":9},{"id":"2409.19987","title":"OccRWKV: Rethinking Efficient 3D Semantic Occupancy Prediction with Linear Complexity","created":"2024-09-30","cited_by_count":9},{"id":"2310.11634","title":"MAGNIFICo: Evaluating the In-Context Learning Ability of Large Language Models to Generalize to Novel Interpretations","created":"2023-10-18","cited_by_count":7},{"id":"2404.19178","title":"Revenge of the Fallen? Recurrent Models Match Transformers at Predicting Human Language Comprehension Metrics","created":"2024-04-30","cited_by_count":6},{"id":"2309.14758","title":"Exploring RWKV for Memory Efficient and Low Latency Streaming ASR","created":"2023-09-26","cited_by_count":5},{"id":"2407.16306","title":"Optimizing Robotic Manipulation with Decision-RWKV: A Recurrent Sequence Modeling Approach for Lifelong Learning","created":"2024-07-23","cited_by_count":5},{"id":"2211.09712","title":"SigT: An Efficient End-to-End MIMO-OFDM Receiver Framework Based on Transformer","created":"2022-11-02","cited_by_count":4},{"id":"2308.14353","title":"ZhuJiu: A Multi-dimensional, Multi-faceted Chinese Benchmark for Large Language Models","created":"2023-08-28","cited_by_count":4},{"id":"2402.11588","title":"SDiT: Spiking Diffusion Model with Transformer","created":"2024-02-18","cited_by_count":4},{"id":"2411.05636","title":"Video RWKV:Video Action Recognition Based RWKV","created":"2024-11-08","cited_by_count":4},{"id":"2312.14860","title":"Advancing VAD Systems Based on Multi-Task Learning with Improved Model Structures","created":"2023-12-19","cited_by_count":3},{"id":"2407.09044","title":"Sensorimotor Attention and Language-based Regressions in Shared Latent Variables for Integrating Robot Motion Learning and LLM","created":"2024-07-12","cited_by_count":3},{"id":"2412.03814","title":"Exploring Real&Synthetic Dataset and Linear Attention in Image Restoration","created":"2024-12-05","cited_by_count":3},{"id":"2306.05176","title":"RRWKV: Capturing Long-range Dependencies in RWKV","created":"2023-06-08","cited_by_count":2},{"id":"2402.02625","title":"Enhancing Transformer RNNs with Multiple Temporal Perspectives","created":"2024-02-04","cited_by_count":2},{"id":"2406.06626","title":"Benchmarking Neural Decoding Backbones towards Enhanced On-edge iBCI Applications","created":"2024-06-08","cited_by_count":2},{"id":"2408.01950","title":"Why Perturbing Symbolic Music is Necessary: Fitting the Distribution of Never-used Notes through a Joint Probabilistic Diffusion Model","created":"2024-08-04","cited_by_count":2},{"id":"2409.00286","title":"OnlySportsLM: Optimizing Sports-Domain Language Models with SOTA Performance under Billion Parameters","created":"2024-08-30","cited_by_count":2},{"id":"2409.03939","title":"Experimentation in Content Moderation using RWKV","created":"2024-09-05","cited_by_count":2},{"id":"2411.06065","title":"DFT: A Dual-branch Framework of Fluctuation and Trend for Stock Price Prediction","created":"2024-11-09","cited_by_count":2},{"id":"2311.01981","title":"ProSG: Using Prompt Synthetic Gradients to Alleviate Prompt Forgetting of RNN-like Language Models","created":"2023-11-03","cited_by_count":1},{"id":"2410.11665","title":"VisualRWKV-HD and UHD: Advancing High-Resolution Processing for Visual Language Models","created":"2024-10-15","cited_by_count":1},{"id":"2412.10856","title":"RWKV-edge: Deeply Compressed RWKV for Resource-Constrained Devices","created":"2024-12-14","cited_by_count":1}],"next_cursor":null}