Causal Connections: Leveraging Multilingual Fine-Tuning for Financial QA@FinCausal 2026
Not on the map. Why?
Abstract (arXiv)
This paper describes team HSA_CORAL's submission to the FinCausal 2026 shared task on extracting cause-effect relations from financial narratives via extractive question answering in English and Spanish. We compare three modeling families: (i) encoder-only token tagging with multilingual BERT, (ii) encoder-decoder generation with multilingual BART, and (iii) decoder-only LLMs (Llama 3.1 and GPT variants) using prompt refinement, few-shot demonstrations, and supervised fine-tuning. Across settings, prompting and few-shot examples yield competitive performance, while supervised fine-tuning provides the largest gains. Our best system, GPT-4.1 Mini fine-tuned on combined English and Spanish training data, achieves a tied highest score on the English subtask (score 4.8140) and ranks third on Spanish (score 4.7753) under the shared task's LLM-as-a-judge metric. Overall, the results highlight the value of task-specific adaptation and multilingual fine-tuning for cross-lingual transfer in financial causality QA.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 11 of its 29 references that are in the map. First posted on arXiv 25 Jun 2026.
Builds on
11 of 29 references.
References · 11
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,986
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,884
- 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 478
- 2019End-to-End Open-Domain Question Answering with BERTserinicited by 152
- 2022Few Shot Generative Model Adaption via Relaxed Spatial Structural Alignmentcited by 54
- 2021Semantic Answer Similarity for Evaluating Question Answering Modelscited by 47
- 2020Financial Document Causality Detection Shared Task (FinCausal 2020)cited by 31
- 2021Sequence tagging for biomedical extractive question answeringcited by 12
- 2022Prototypical Fine-tuning: Towards Robust Performance Under Varying Data Sizescited by 10
- 2022A Generative Approach for Financial Causality Extractioncited by 4
Built on by
Not cited yet.