CLARA: Clarification of Language Ambiguity through Result Analysis for Natural-Language Cancer Genomics Queries
Not on the map. Why?
Abstract (arXiv)
A natural language interface can be used to make cancer genomics databases easier to use, but even if a question is perfectly fluent, its scientific meaning can be ambiguous. We propose CLARA, a framework that represents a question as a typed scientific query specification, considers a few possible interpretations, executes them, and asks for clarification when the estimates diverge. CLARA was assessed on mutation-prevalence contrasts among eight TCGA PanCancer Atlas cohorts and a 30-gene panel. This benchmark consisted of 330 unique executable contrasts varying in mutation scope, assay denominator, and sample context; 115 contrasts were result-sensitive and 215 were result-stable, per the preregistered definition of relative divergence greater than 0.10 or absolute divergence greater than 5 percentage points. An independently implemented pandas execution engine perfectly replicated all 660 results from the SQLite engine. In a separate 120-question LLM-generated, manually vetted language stress test, CLARA recognized all 60 result-sensitive contrasts and needlessly clarified 13 of 60 stable contrasts (accuracy 89.2%, sensitivity/recall 100%, specificity 78.3%). Standalone machine learning had superior overall accuracy (97.5%) but missed one critical contrast. This demonstrates that downstream execution can distinguish consequential from inconsequential ambiguity and reveal an explicit trade-off between safety and burden.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 21 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
11 of 21 references.
References · 11
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,139
- 2021PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Modelscited by 411
- 2024Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflowscited by 232
- 2019CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to Databasescited by 185
- 2019SParC: Cross-Domain Semantic Parsing in Contextcited by 144
- 2020Semantic Evaluation for Text-to-SQL with Distilled Test Suitescited by 126
- 2019Text-to-SQL Generation for Question Answering on Electronic Medical Recordscited by 77
- 2018Robust Text-to-SQL Generation with Execution-Guided Decodingcited by 52
- 2023Error Detection for Text-to-SQL Semantic Parsingcited by 12
- 2020"What Do You Mean by That?" A Parser-Independent Interactive Approach for Enhancing Text-to-SQLcited by 11
Built on by
Not cited yet.