Automatic Detection of Causality in Requirement Artifacts: the CiRA Approach
Not on the map. Why?
Abstract (arXiv)
System behavior is often expressed by causal relations in requirements (e.g., If event 1, then event 2). Automatically extracting this embedded causal knowledge supports not only reasoning about requirements dependencies, but also various automated engineering tasks such as seamless derivation of test cases. However, causality extraction from natural language is still an open research challenge as existing approaches fail to extract causality with reasonable performance. We understand causality extraction from requirements as a two-step problem: First, we need to detect if requirements have causal properties or not. Second, we need to understand and extract their causal relations. At present, though, we lack knowledge about the form and complexity of causality in requirements, which is necessary to develop a suitable approach addressing these two problems. We conduct an exploratory case study with 14,983 sentences from 53 requirements documents originating from 18 different domains and shed light on the form and complexity of causality in requirements. Based on our findings, we develop a tool-supported approach for causality detection (CiRA). This constitutes a first step towards causality extraction from NL requirements. We report on a case study and the resulting tool-supported approach for causality detection in requirements. Our case study corroborates, among other things, that causality is, in fact, a widely used linguistic pattern to describe system behavior, as about a third of the analyzed sentences are causal. We further demonstrate that our tool CiRA achieves a macro-F1 score of 82 % on real word data and that it outperforms related approaches with an average gain of 11.06 % in macro-Recall and 11.43 % in macro-Precision. Finally, we disclose our open data sets as well as our tool to foster the discourse on the automatic detection of causality in the RE community.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Jan 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 1; 2023: 2; 2024: 2; 2025: 0; 2026: 2.
11 papers.
- 2024Can LLMs Replace Manual Annotation of Software Engineering Artifacts?cited by 40
- 2024Enhancing Legal Compliance and Regulation Analysis with Large Language Modelscited by 10
- 2023Automated Action Model Acquisition from Narrative Textscited by 3
- 2021Transfer Learning for Mining Feature Requests and Bug Reports from Tweets and App Store Reviewscited by 2
- 2021Detecting Requirements Smells With Deep Learning: Experiences, Challenges and Future Workcited by 2
- 2021Fine-Grained Causality Extraction From Natural Language Requirements Using Recursive Neural Tensor Networkscited by 1
- 2021CATE: CAusality Tree Extractor from Natural Language Requirementscited by 1
- 2022Natural Language in Requirements Engineering for Structure Inference -- An Integrative Reviewcited by 1
- 2023EDeR: A Dataset for Exploring Dependency Relations Between Eventscited by 0
- 2026Automating the Detection of Requirement Dependencies Using Large Language Modelscited by 0
- 2026A2Z GameSpec-Bench: How Faithfully Can Coding Agents Generate Games from Game Design Specifications?cited by 0
- 2026A2Z GameSpec-Bench: How Faithfully Can Coding Agents Generate Games from Game Design Specifications?30 Sep 2026
- 2026Automating the Detection of Requirement Dependencies Using Large Language Models25 Feb 2026
- 2024Can LLMs Replace Manual Annotation of Software Engineering Artifacts?10 Aug 2024
- 2024Enhancing Legal Compliance and Regulation Analysis with Large Language Models26 Apr 2024
- 2023Automated Action Model Acquisition from Narrative Texts17 Jul 2023
- 2023EDeR: A Dataset for Exploring Dependency Relations Between Events4 Apr 2023
- 2022Natural Language in Requirements Engineering for Structure Inference -- An Integrative Review10 Feb 2022
- 2021Detecting Requirements Smells With Deep Learning: Experiences, Challenges and Future Work6 Aug 2021
- 2021Transfer Learning for Mining Feature Requests and Bug Reports from Tweets and App Store Reviews2 Aug 2021
- 2021CATE: CAusality Tree Extractor from Natural Language Requirements21 Jul 2021
- 2021Fine-Grained Causality Extraction From Natural Language Requirements Using Recursive Neural Tensor Networks21 Jul 2021