mlsanityData to 7 Oct 2026

TalkPlayData 2: An Agentic Synthetic Data Pipeline for Multimodal Conversational Music Recommendation

arXiv 2509.09685 ↗First posted 18 Aug 2025cs.IR cs.AI cs.MMcited by 2

On the map: LLM agents and tool use → Multimodal and embodied agents

also in 1 more
Abstract (arXiv)

We present TalkPlayData 2, a synthetic dataset for multimodal conversational music recommendation generated by an agentic data pipeline. In the proposed pipeline, multiple large language model (LLM) agents are created under various roles with specialized prompts and access to different parts of information, and the chat data is acquired by logging the conversation between the Listener LLM and the Recsys LLM. To cover various conversation scenarios, for each conversation, the Listener LLM is conditioned on a finetuned conversation goal. Finally, all the LLMs are multimodal with audio and images, allowing a simulation of multimodal recommendation and conversation. In the LLM-as-a-judge and subjective evaluation experiments, TalkPlayData 2 achieved the proposed goal in various aspects related to training a generative recommendation model for music. TalkPlayData 2 and its generation code are released at https://talkpl-ai.github.io.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 27 of its 53 references that are in the map. First posted on arXiv 18 Aug 2025.

Builds on

27 of 53 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025AgentSGEN: Multi-Agent LLM in the Loop for Semantic Collaboration and GENeration of Synthetic Data7 May

Other references · 26

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  4. 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
  5. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 362
  6. 2024Self-Preference Bias in LLM-as-a-Judgecited by 248
  7. 2020A Survey on Conversational Recommender Systemscited by 142
  8. 2018Conversational Recommender Systemcited by 115
  9. 2025MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mixcited by 113
  10. 2016madmom: a new Python Audio and Music Signal Processing Librarycited by 63
  11. 2024LLM-Powered User Simulator for Recommender Systemcited by 38
  12. 2023LLark: A Multimodal Instruction-Following Language Model for Musiccited by 29
14 more
  1. 2025Do We Truly Need So Many Samples? Multi-LLM Repeated Sampling Efficiently Scales Test-Time Computecited by 20
  2. 2021Content-driven Music Recommendation: Evolution, State of the Art, and Challengescited by 12
  3. 2024The Music Maestro or The Musically Challenged, A Massive Music Evaluation Benchmark for Large Language Modelscited by 10
  4. 2023Talk the Walk: Synthetic Data Generation for Conversational Music Recommendationcited by 9
  5. 2024Incorporating External Knowledge and Goal Guidance for LLM-based Conversational Recommender Systemscited by 8
  6. 2024Can LLMs "Reason" in Music? An Evaluation of LLMs' Capability of Music Understanding and Generationcited by 7
  7. 2025TALKPLAY: Multimodal Music Recommendation with Large Language Modelscited by 7
  8. 2023Beyond Single Items: Exploring User Preferences in Item Sets with the Conversational Playlist Curation Datasetcited by 6
  9. 2025Just Ask for Music (JAM): Multimodal and Personalized Natural Language Music Recommendationcited by 5
  10. 2024Evaluation of pretrained language models on music understandingcited by 4
  11. 2024Music Discovery Dialogue Generation Using Human Intent Analysis and Large Language Modelscited by 4
  12. 2024A Benchmark and Robustness Study of In-Context-Learning with Large Language Models in Music Entity Detectioncited by 4
  13. 2025SampleLLM: Optimizing Tabular Data Synthesis in Recommendationscited by 4
  14. 2024Predicting User Intents and Musical Attributes from Music Discovery Conversationscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

  1. 2026Autonomous Information Seeking: A Roadmap for Agentic Recommender Systemscited by 3
  2. 2025Music Recommendation with Large Language Models: Challenges, Opportunities, and Evaluationcited by 1

Similar, not cited

Close in wording, no citation either way

  1. 2025TalkPlay-Tools: Conversational Music Recommendation with LLM Tool Calling
  2. 2025WeMusic-Agent: Efficient Conversational Music Recommendation via Knowledge Internalization and Agentic Boundary Learning
  3. 2024Muse: A Multimodal Conversational Recommendation Dataset with Scenario-Grounded User Profiles
  4. 2026Multimodal Music Recommendation System using LLMs
  5. 2026DialBGM: A Benchmark for Background Music Recommendation from Everyday Multi-Turn Dialogues
  6. 2025LLM-Based Intelligent Agents for Music Recommendation: A Comparison with Classical Content-Based Filtering
  7. 2025A Multimodal Conversational Agent for Tabular Data Analysis
  8. 2025TuneGenie: Reasoning-based LLM agents for preferential music generation