# Improving Conversational Recommendation Systems' Quality with Context-Aware Item Meta Information

arXiv: https://arxiv.org/abs/2112.08140 · HTML: https://mlsanity.com/paper/2112.08140/

## Key facts

- Cited by 26 papers in the map (data through 14 Oct 2026).
- Builds on 25 of its 36 references that are in the map.
- First posted on arXiv 15 Dec 2021.

## Builds on (most cited first, 25 of 25)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Semi-Supervised Classification with Graph Convolutional Networks](https://mlsanity.com/paper/1609.02907/) (2016)
- [DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter](https://mlsanity.com/paper/1910.01108/) (2019)
- [Prefix-Tuning: Optimizing Continuous Prompts for Generation](https://mlsanity.com/paper/2101.00190/) (2021)
- [ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks](https://mlsanity.com/paper/1908.02265/) (2019)
- [Modeling Relational Data with Graph Convolutional Networks](https://mlsanity.com/paper/1703.06103/) (2017)
- [LXMERT: Learning Cross-Modality Encoder Representations from Transformers](https://mlsanity.com/paper/1908.07490/) (2019)
- [Making Pre-trained Language Models Better Few-shot Learners](https://mlsanity.com/paper/2012.15723/) (2020)
- [Neural Collaborative Filtering](https://mlsanity.com/paper/1708.05031/) (2017)
- [A Diversity-Promoting Objective Function for Neural Conversation Models](https://mlsanity.com/paper/1510.03055/) (2015)
- [ConceptNet 5.5: An Open Multilingual Graph of General Knowledge](https://mlsanity.com/paper/1612.03975/) (2016)
- [BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer](https://mlsanity.com/paper/1904.06690/) (2019)
- [DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation](https://mlsanity.com/paper/1911.00536/) (2019)
- [Convolutional 2D Knowledge Graph Embeddings](https://mlsanity.com/paper/1707.01476/) (2017)
- [Deep Interest Network for Click-Through Rate Prediction](https://mlsanity.com/paper/1706.06978/) (2017)
- [InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximization](https://mlsanity.com/paper/1908.01000/) (2019)
- [Towards Deep Conversational Recommendations](https://mlsanity.com/paper/1812.07617/) (2018)
- [Improving Conversational Recommender Systems via Knowledge Graph based Semantic Fusion](https://mlsanity.com/paper/2007.04032/) (2020)
- [Towards Knowledge-Based Recommender Dialog System](https://mlsanity.com/paper/1908.05391/) (2019)
- [INSPIRED: Toward Sociable Recommendation Dialog Systems](https://mlsanity.com/paper/2009.14306/) (2020)
- [A Hierarchical Recurrent Encoder-Decoder For Generative Context-Aware Query Suggestion](https://mlsanity.com/paper/1507.02221/) (2015)
- [CR-Walker: Tree-Structured Graph Reasoning and Dialog Acts for Conversational Recommendation](https://mlsanity.com/paper/2010.10333/) (2020)
- [Learning Neural Templates for Recommender Dialogue System](https://mlsanity.com/paper/2109.12302/) (2021)
- [Efficiently Embedding Dynamic Knowledge Graphs](https://mlsanity.com/paper/1910.06708/) (2019)
- [DEUX: An Attribute-Guided Framework for Sociable Recommendation Dialog Systems](https://mlsanity.com/paper/2105.00825/) (2021)

## Built on by (most cited first, 26 of 26)

- [A Survey on Large Language Models for Recommendation](https://mlsanity.com/paper/2305.19860/) (2023)
- [How Can Recommender Systems Benefit from Large Language Models: A Survey](https://mlsanity.com/paper/2306.05817/) (2023)
- [A Review of Modern Recommender Systems Using Generative Models (Gen-RecSys)](https://mlsanity.com/paper/2404.00579/) (2024)
- [Rethinking the Evaluation for Conversational Recommendation in the Era of Large Language Models](https://mlsanity.com/paper/2305.13112/) (2023)
- [MuseChat: A Conversational Music Recommendation System for Videos](https://mlsanity.com/paper/2310.06282/) (2023)
- [Bayesian Optimization with LLM-Based Acquisition Functions for Natural Language Preference Elicitation](https://mlsanity.com/paper/2405.00981/) (2024)
- [TREA: Tree-Structure Reasoning Schema for Conversational Recommendation](https://mlsanity.com/paper/2307.10543/) (2023)
- [Parameter-Efficient Conversational Recommender System as a Language Processing Task](https://mlsanity.com/paper/2401.14194/) (2024)
- [Towards Empathetic Conversational Recommender Systems](https://mlsanity.com/paper/2409.10527/) (2024)
- [Generative Explore-Exploit: Training-free Optimization of Generative Recommender Systems using LLM Optimizers](https://mlsanity.com/paper/2406.05255/) (2024)
- [From Prompting to Alignment: A Generative Framework for Query Recommendation](https://mlsanity.com/paper/2504.10208/) (2025)
- [Knowledge Graphs and Pre-trained Language Models enhanced Representation Learning for Conversational Recommender Systems](https://mlsanity.com/paper/2312.10967/) (2023)
- [Multi-grained Hypergraph Interest Modeling for Conversational Recommendation](https://mlsanity.com/paper/2305.04798/) (2023)
- [Knowledge-Enhanced Conversational Recommendation via Transformer-based Sequential Modelling](https://mlsanity.com/paper/2412.02415/) (2024)
- [Search-Based Interaction For Conversation Recommendation via Generative Reward Model Based Simulated User](https://mlsanity.com/paper/2504.20458/) (2025)
- [Beyond Single Labels: Improving Conversational Recommendation through LLM-Powered Data Augmentation](https://mlsanity.com/paper/2508.05657/) (2025)
- [Towards a Unified Conversational Recommendation System: Multi-task Learning via Contextualized Knowledge Distillation](https://mlsanity.com/paper/2310.18119/) (2023)
- [A Conversation is Worth A Thousand Recommendations: A Survey of Holistic Conversational Recommender Systems](https://mlsanity.com/paper/2309.07682/) (2023)
- [Conversational Recommendation as Retrieval: A Simple, Strong Baseline](https://mlsanity.com/paper/2305.13725/) (2023)
- [Multi-Type Context-Aware Conversational Recommender Systems via Mixture-of-Experts](https://mlsanity.com/paper/2504.13655/) (2025)
- [TRACE: Tourism Recommendation with Accountable Citation Evidence](https://mlsanity.com/paper/2605.07677/) (2026)
- [CoRE-CoG: Conversational Recommendation of Entities using Constrained Generation](https://mlsanity.com/paper/2311.08511/) (2023)
- [Large Language Model Driven Recommendation](https://mlsanity.com/paper/2408.10946/) (2024)
- [LumiCRS: Asymmetric Contrastive Prototype Learning for Long-Tail Conversational Recommender Systems](https://mlsanity.com/paper/2507.04722/) (2025)
- [A Scenario-Oriented Survey of Federated Recommender Systems: Techniques, Challenges, and Future Directions](https://mlsanity.com/paper/2508.19620/) (2025)
- [PinCLIP: Large-scale Foundational Multimodal Representation at Pinterest](https://mlsanity.com/paper/2603.03544/) (2026)

## Abstract (arXiv)

Conversational recommendation systems (CRS) engage with users by inferring user preferences from dialog history, providing accurate recommendations, and generating appropriate responses. Previous CRSs use knowledge graph (KG) based recommendation modules and integrate KG with language models for response generation. Although KG-based approaches prove effective, two issues remain to be solved. First, KG-based approaches ignore the information in the conversational context but only rely on entity relations and bag of words to recommend items. Second, it requires substantial engineering efforts to maintain KGs that model domain-specific relations, thus leading to less flexibility. In this paper, we propose a simple yet effective architecture comprising a pre-trained language model (PLM) and an item metadata encoder. The encoder learns to map item metadata to embeddings that can reflect the semantic information in the dialog context. The PLM then consumes the semantic-aligned item embeddings together with dialog context to generate high-quality recommendations and responses. Instead of modeling entity relations with KGs, our model reduces engineering complexity by directly converting each item to an embedding. Experimental results on the benchmark dataset ReDial show that our model obtains state-of-the-art results on both recommendation and response generation tasks.
