Generative Input: Towards Next-Generation Input Methods Paradigm
Not on the map. Why?
Abstract (arXiv)
Since the release of ChatGPT, generative models have achieved tremendous success and become the de facto approach for various NLP tasks. However, its application in the field of input methods remains under-explored. Many neural network approaches have been applied to the construction of Chinese input method engines(IMEs).Previous research often assumed that the input pinyin was correct and focused on Pinyin-to-character(P2C) task, which significantly falls short of meeting users' demands. Moreover, previous research could not leverage user feedback to optimize the model and provide personalized results. In this study, we propose a novel Generative Input paradigm named GeneInput. It uses prompts to handle all input scenarios and other intelligent auxiliary input functions, optimizing the model with user feedback to deliver personalized results. The results demonstrate that we have achieved state-of-the-art performance for the first time in the Full-mode Key-sequence to Characters(FK2C) task. We propose a novel reward model training method that eliminates the need for additional manual annotations and the performance surpasses GPT-4 in tasks involving intelligent association and conversational assistance. Compared to traditional paradigms, GeneInput not only demonstrates superior performance but also exhibits enhanced robustness, scalability, and online learning capabilities.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 11 of its 28 references that are in the map. First posted on arXiv 2 Nov 2023.
Builds on
11 of 28 references.
References · 11
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2019Portuguese Named Entity Recognition using BERT-CRFcited by 73
- 2022Exploring and Adapting Chinese GPT to Pinyin Input Methodcited by 8
- 2017Tracing a Loose Wordhood for Chinese Input Method Enginecited by 2
- 2018Chinese Pinyin Aided IME, Input What You Have Not Keystroked Yetcited by 2
- 2022PERT: A New Solution to Pinyin to Character Conversion Taskcited by 2
- 2018KNPTC: Knowledge and Neural Machine Translation Powered Chinese Pinyin Typo Correctioncited by 1
- 2018Real-time Neural-based Input Methodcited by 1
Built on by
Citing papers per year: 2024: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2022SkillNet-NLG: General-Purpose Natural Language Generation with a Sparsely Activated Approach
- 2023An Empirical Study of Instruction-tuning Large Language Models in Chinese
- 2023Improving ChatGPT Prompt for Code Generation
- 2023An Automated Survey of Generative Artificial Intelligence: Large Language Models, Architectures, Protocols, and Applications
- 2025PoeTone: A Framework for Constrained Generation of Structured Chinese Songci with LLMs
- 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models
- 2024Large Language Model Based Generative Error Correction: A Challenge and Baselines for Speech Recognition, Speaker Tagging, and Emotion Recognition
- 2024Generative AI for Synthetic Data Generation: Methods, Challenges and the Future