Tool-calling retrieval versus vector RAG for a small Greek--English knowledge base: accuracy and robustness to how users type Greek
On the map: Retrieval-augmented generation → RAG robustness and adaptive retrieval also fits: RAG pipeline design and evaluation
also in 1 more
Abstract (arXiv)
Assistants grounded in a small, frequently edited knowledge base can retrieve through tool calls to a live data interface or through vector retrieval-augmented generation (RAG). We compare the two on KyGround, a benchmark of 198 questions drawn from the published records of a Greek--English agricultural platform on Kythera, Greece, with answers verified automatically against the records and each question posed in up to nine forms, including Greek without accents, in capitals and in three Latin-script (Greeklish) schemes. With Claude Haiku 4.5 as router and answer model, a reconstruction of the platform's tool agent answered 71.6% of canonical Greek questions correctly and vector RAG 95.3% (difference -23.6 percentage points, 95% CI -33.1 to -15.1). Letting the router write the vector query changed nothing, and placing the whole knowledge base of about 26,000 tokens in the prompt reached 99.3%. The tool agent's losses arose in retrieval. Its literal searches returned nothing when the router's arguments did not occur verbatim in a record, for example when it transliterated Greek into Latin script or combined words that occur in a record but not as one phrase, and the agent then abstained. Unaccented and capitalised questions cost the tool agent about 20 points and vector RAG at most 2; accent-insensitive search removed this loss, and matching stemmed tokens raised the tool agent to 83.8% on canonical Greek. Greeklish cost both designs about 21 to 32 points. Tool interfaces for community knowledge bases need search that tolerates how users type.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in RAG robustness and adaptive retrieval, one of 15 directions in Retrieval-augmented generation. First posted on arXiv 6 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Forgotten History or Test-of-Time? Retrospect and Prospect on RAG from an IR Perspective
- 2025Out of Style: RAG's Fragility to Linguistic Variation
- 2026On the impact of retrieved content representations in RAG Pipelines
- 2026Corpus2Skill: Distilling Enterprise Knowledge into Navigable Agent Skills for QA and RAG
- 2024From RAGs to rich parameters: Probing how language models utilize external knowledge over parametric information for factual queries
- 2024Toward Optimal Search and Retrieval for RAG
- 2026RAGTurk: Best Practices for Retrieval Augmented Generation in Turkish
- 2025Optimizing Retrieval-Augmented Generation: Analysis of Hyperparameter Impact on Performance and Efficiency