The Master-Slave Encoder Model for Improving Patent Text Summarization: A New Approach to Combining Specifications and Claims
Not on the map. Why?
Abstract (arXiv)
In order to solve the problem of insufficient generation quality caused by traditional patent text abstract generation models only originating from patent specifications, the problem of new terminology OOV caused by rapid patent updates, and the problem of information redundancy caused by insufficient consideration of the high professionalism, accuracy, and uniqueness of patent texts, we proposes a patent text abstract generation model (MSEA) based on a master-slave encoder architecture; Firstly, the MSEA model designs a master-slave encoder, which combines the instructions in the patent text with the claims as input, and fully explores the characteristics and details between the two through the master-slave encoder; Then, the model enhances the consideration of new technical terms in the input sequence based on the pointer network, and further enhances the correlation with the input text by re weighing the "remembered" and "for-gotten" parts of the input sequence from the encoder; Finally, an enhanced repetition suppression mechanism for patent text was introduced to ensure accurate and non redundant abstracts generated. On a publicly available patent text dataset, compared to the state-of-the-art model, Improved Multi-Head Attention Mechanism (IMHAM), the MSEA model achieves an improvement of 0.006, 0.005, and 0.005 in Rouge-1, Rouge-2, and Rouge-L scores, respectively. MSEA leverages the characteristics of patent texts to effectively enhance the quality of patent text generation, demonstrating its advancement and effectiveness in the experiments.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 51 of its 139 references that are in the map. First posted on arXiv 21 Nov 2024.
Builds on
51 of 139 references.
References · 51
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2018Deep contextualized word representationscited by 2,285
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
- 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 809
- 2017Adversarial Examples for Evaluating Reading Comprehension Systemscited by 568
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
38 more
- 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
- 2016SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documentscited by 245
- 2019DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversationcited by 184
- 2019RUBi: Reducing Unimodal Biases in Visual Question Answeringcited by 183
- 2020Rumor Detection on Social Media with Bi-Directional Graph Convolutional Networkscited by 152
- 2019Black is to Criminal as Caucasian is to Police: Detecting and Removing Multiclass Bias in Word Embeddingscited by 146
- 2019Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Groundedcited by 127
- 2020Image Representations Learned With Unsupervised Pre-Training Contain Human-like Biasescited by 107
- 2016Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbotscited by 103
- 2023A Comprehensive Survey on Automatic Knowledge Graph Constructioncited by 63
- 2019Self-Critical Reasoning for Robust Visual Question Answeringcited by 61
- 2020Deep Open Intent Classification with Adaptive Decision Boundarycited by 56
- 2019SG-Net: Syntax-Guided Machine Reading Comprehensioncited by 52
- 2015Learning Natural Language Inference with LSTMcited by 51
- 2019Revealing the Importance of Semantic Retrieval for Machine Reading at Scalecited by 50
- 2024Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Surveycited by 50
- 2018Knowledgeable Reader: Enhancing Cloze-Style Reading Comprehension with External Commonsense Knowledgecited by 48
- 2016Machine Comprehension Using Match-LSTM and Answer Pointercited by 47
- 2020jiant: A Software Toolkit for Research on General-Purpose Text Understanding Modelscited by 39
- 2020Loss re-scaling VQA: Revisiting the LanguagePrior Problem from a Class-imbalance Viewcited by 36
- 2020Unshuffling Data for Improved Generalizationcited by 35
- 2015A Deep Architecture for Semantic Matching with Multiple Positional Sentence Representationscited by 32
- 2018Efficient and Robust Question Answering from Minimal Context over Documentscited by 26
- 2020Filling the Gap of Utterance-aware and Speaker-aware Representation for Multi-turn Dialoguecited by 26
- 2024GET: Unlocking the Multi-modal Potential of CLIP for Generalized Category Discoverycited by 26
- 2016Hierarchical Question Answering for Long Documentscited by 21
- 2021DADgraph: A Discourse-aware Dialogue Graph Neural Network for Multiparty Dialogue Machine Reading Comprehensioncited by 16
- 2019Retrieve, Read, Rerank: Towards End-to-End Multi-Document Reading Comprehensioncited by 15
- 2021Dialogue History Matters! Personalized Response Selectionin Multi-turn Retrieval-based Chatbotscited by 14
- 2019Utterance-to-Utterance Interactive Matching Network for Multi-Turn Response Selection in Retrieval-Based Chatbotscited by 13
- 2021Self- and Pseudo-self-supervised Prediction of Speaker and Key-utterance for Multi-party Dialogue Reading Comprehensioncited by 13
- 2021Enhanced Speaker-aware Multi-party Multi-turn Dialogue Comprehensioncited by 13
- 2021Multi-turn Dialogue Reading Comprehension with Pivot Turns and Knowledgecited by 10
- 2018Semantic-Unit-Based Dilated Convolution for Multi-Label Text Classificationcited by 8
- 2022Back to the Future: Bidirectional Information Decoupling Network for Multi-turn Dialogue Modelingcited by 7
- 2021Improving Question Answering Performance Using Knowledge Distillation and Active Learningcited by 6
- 2022TSTR: Too Short to Represent, Summarize with Details! Intro-Guided Extended Summary Generationcited by 4
- 2022Research Status of Deep Learning Methods for Rumor Detectioncited by 3
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2025: 1.
1 paper.