mlsanityData to 14 Oct 2026

QoNext: Towards Next-generation QoE for Foundation Models

arXiv 2509.21889 ↗First posted 26 Sep 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Existing evaluations of foundation models predominantly focus on output correctness, treating interaction as a static exchange of information. However, such perspectives overlook the essence of the LLM-driven conversational experience, which is determined not only by content quality but, crucially, by dynamic service attributes such as generation velocity and latency patterns. To address this gap, we introduce QoNext, the first framework that adapts Quality of Experience (QoE) principles from networking and multimedia to the holistic assessment of human-AI interaction. QoNext identifies experiential factors that shape user experience and incorporates them into controlled experiments in simulated interaction scenarios, where human ratings are collected under diverse configurations. From these studies we construct the QoNext Database and train the QoNext Model, a neural predictor that estimates user experience directly from measurable system parameters. Our results demonstrate that QoNext effectively decodes the underlying mechanisms of user satisfaction and enables precise prediction of human sentiment across varied service conditions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 81 references that are in the map. First posted on arXiv 26 Sep 2025.

Builds on

32 of 81 references.

References · 32

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  6. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  7. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  8. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  9. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  10. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
  11. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
  12. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
20 more
  1. 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
  2. 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 721
  3. 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 490
  4. 2020AutoGluon-Tabular: Robust and Accurate AutoML for Structured Datacited by 383
  5. 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
  6. 2023Evaluating Large Language Models: A Comprehensive Surveycited by 202
  7. 2024UNIAA: A Unified Multi-modal Image Aesthetic Assessment Baseline and Benchmarkcited by 42
  8. 2025HumanAesExpert: Advancing a Multi-Modality Foundation Model for Human Image Aesthetic Assessmentcited by 19
  9. 2025HumaniBench: A Human-Centric Framework for Large Multimodal Models Evaluationcited by 19
  10. 2018Topic-based Evaluation for Conversational Botscited by 16
  11. 2025Creation-MMBench: Assessing Context-Aware Creative Intelligence in MLLMcited by 14
  12. 2024EmpathicStories++: A Multimodal Dataset for Empathy towards Personal Experiencescited by 10
  13. 2025Information Density Principle for MLLM Benchmarkscited by 9
  14. 2024AACessTalk: Fostering Communication between Minimally Verbal Autistic Children and Parents with Contextual Guidance and Card Recommendationcited by 7
  15. 2024HERM: Benchmarking and Enhancing Multimodal LLMs for Human-Centric Understandingcited by 7
  16. 2021Impact of Response Latency on User Behaviour in Mobile Web Searchcited by 4
  17. 2023DEnsity: Open-domain Dialogue Evaluation Metric using Density Estimationcited by 3
  18. 2025GazeSwipe: Enhancing Mobile Touchscreen Reachability through Seamless Gaze and Finger-Swipe Integrationcited by 2
  19. 2025The Ever-Evolving Science Examcited by 2
  20. 2025User-centric Subjective Leaderboard by Customizable Reward Modelingcited by 1

Built on by

Not cited yet.