mlsanityData to 14 Oct 2026

Bridging AI and Carbon Capture: A Dataset for LLMs in Ionic Liquids and CBE Research

arXiv 2505.06964 ↗First posted 11 May 2025cs.AIcited by 0

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

Large Language Models (LLMs) have demonstrated exceptional performance in general knowledge and reasoning tasks across various domains. However, their effectiveness in specialized scientific fields like Chemical and Biological Engineering (CBE) remains underexplored. Addressing this gap requires robust evaluation benchmarks that assess both knowledge and reasoning capabilities in these niche areas, which are currently lacking. To bridge this divide, we present a comprehensive empirical analysis of LLM reasoning capabilities in CBE, with a focus on Ionic Liquids (ILs) for carbon sequestration - an emerging solution for mitigating global warming. We develop and release an expert - curated dataset of 5,920 examples designed to benchmark LLMs' reasoning in this domain. The dataset incorporates varying levels of difficulty, balancing linguistic complexity and domain-specific knowledge. Using this dataset, we evaluate three open-source LLMs with fewer than 10 billion parameters. Our findings reveal that while smaller general-purpose LLMs exhibit basic knowledge of ILs, they lack the specialized reasoning skills necessary for advanced applications. Building on these results, we discuss strategies to enhance the utility of LLMs for carbon capture research, particularly using ILs. Given the significant carbon footprint of LLMs, aligning their development with IL research presents a unique opportunity to foster mutual progress in both fields and advance global efforts toward achieving carbon neutrality by 2050.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 35 of its 98 references that are in the map. First posted on arXiv 11 May 2025.

Builds on

35 of 98 references.

References · 35

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  5. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  6. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  7. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  8. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  9. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  10. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
  11. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
  12. 2022Galactica: A Large Language Model for Sciencecited by 744
23 more
  1. 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 710
  2. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
  3. 2021Carbon Emissions and Large Neural Network Trainingcited by 567
  4. 2022Large Language Models Struggle to Learn Long-Tail Knowledgecited by 458
  5. 2023A Survey of Confidence Estimation and Calibration in Large Language Modelscited by 256
  6. 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 206
  7. 2023OpenAGI: When LLM Meets Domain Expertscited by 197
  8. 2023What can Large Language Models do in chemistry? A comprehensive benchmark on eight taskscited by 185
  9. 2023Sources of Hallucination by Large Language Models on Inference Taskscited by 169
  10. 2024Investigating Cultural Alignment of Large Language Modelscited by 143
  11. 2024Benchmarking LLMs via Uncertainty Quantificationcited by 126
  12. 202314 Examples of How LLMs Can Transform Materials Science and Chemistry: A Reflection on a Large Language Model Hackathoncited by 86
  13. 2023SeeGULL: A Stereotype Benchmark with Broad Geo-Cultural Coverage Leveraging Generative Modelscited by 66
  14. 2023Ethical Reasoning over Moral Alignment: A Case and Framework for In-Context Ethical Policies in LLMscited by 64
  15. 2024CULTURE-GEN: Revealing Global Cultural Perception in Language Models through Natural Language Promptingcited by 55
  16. 2024A Survey of Uncertainty Estimation in LLMs: Theory Meets Practicecited by 55
  17. 2023Are Personalized Stochastic Parrots More Dangerous? Evaluating Persona Biases in Dialogue Systemscited by 37
  18. 2023BioinspiredLLM: Conversational Large Language Model for the Mechanics of Biological and Bio-inspired Materialscited by 30
  19. 2023MeLM, a generative pretrained language modeling framework that solves forward and inverse mechanics problemscited by 29
  20. 2023Probing the Moral Development of Large Language Models through Defining Issues Testcited by 25
  21. 2021Scientific Language Models for Biomedical Knowledge Base Completion: An Empirical Studycited by 23
  22. 2023Generative Pretrained Autoregressive Transformer Graph Neural Network applied to the Analysis and Discovery of Novel Proteinscited by 10
  23. 2024Defining Knowledge: Bridging Epistemology and Large Language Modelscited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Training a Scientific Reasoning Model for Chemistry
  2. 2025ChemAU: Harness the Reasoning of LLMs in Chemical Research with Adaptive Uncertainty Estimation
  3. 2025MiST: Understanding the Role of Mid-Stage Scientific Training in Developing Chemical Reasoning Models
  4. 2026ChemDIRT: A Diversified Instruction, Representation, and Task Benchmark for Robust Chemistry-LLM Evaluation
  5. 2026From Knowledge to Action: Outcomes of the 2025 Large Language Model (LLM) Hackathon for Applications in Materials Science and Chemistry
  6. 2025SUPERChem: A Multimodal Reasoning Benchmark in Chemistry
  7. 2023Monte Carlo Thought Search: Large Language Model Querying for Complex Scientific Reasoning in Catalyst Design
  8. 2025AIonopedia: an LLM agent orchestrating multimodal learning for ionic liquid discovery