A Scalable Data-Driven Framework for Systematic Analysis of SEC 10-K Filings Using Large Language Models
Not on the map. Why?
Abstract (arXiv)
The number of companies listed on the NYSE has been growing exponentially, creating a significant challenge for market analysts, traders, and stockholders who must monitor and assess the performance and strategic shifts of a large number of companies regularly. There is an increasing need for a fast, cost-effective, and comprehensive method to evaluate the performance and detect and compare many companies' strategy changes efficiently. We propose a novel data-driven approach that leverages large language models (LLMs) to systematically analyze and rate the performance of companies based on their SEC 10-K filings. These filings, which provide detailed annual reports on a company's financial performance and strategic direction, serve as a rich source of data for evaluating various aspects of corporate health, including confidence, environmental sustainability, innovation, and workforce management. We also introduce an automated system for extracting and preprocessing 10-K filings. This system accurately identifies and segments the required sections as outlined by the SEC, while also isolating key textual content that contains critical information about the company. This curated data is then fed into Cohere's Command-R+ LLM to generate quantitative ratings across various performance metrics. These ratings are subsequently processed and visualized to provide actionable insights. The proposed scheme is then implemented on an interactive GUI as a no-code solution for running the data pipeline and creating the visualizations. The application showcases the rating results and provides year-on-year comparisons of company performance.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 15 of its 28 references that are in the map. First posted on arXiv 26 Sep 2024.
Builds on
15 of 28 references.
References · 15
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
- 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 742
- 2023Is ChatGPT a Good NLG Evaluator? A Preliminary Studycited by 422
- 2023Exploring the Use of Large Language Models for Reference-Free Text Quality Evaluation: An Empirical Studycited by 85
- 2023Large Language Models are Diverse Role-Players for Summarization Evaluationcited by 62
- 2024Financial Report Chunking for Effective Retrieval Augmented Generationcited by 46
- 2024UDA: A Benchmark Suite for Retrieval Augmented Generation in Real-world Document Analysiscited by 40
- 2024M-RAG: Reinforcing Large Language Model Performance through Retrieval-Augmented Generation with Multiple Partitionscited by 38
- 2023Making LLMs Worth Every Penny: Resource-Limited Text Classification in Bankingcited by 37
- 2024SEC-QA: A Systematic Evaluation Corpus for Financial QAcited by 17
- 2023UniGen: A Unified Generative Framework for Retrieval and Question Answering with Large Language Modelscited by 14
- 2023FloodBrain: Flood Disaster Reporting by Web-based Retrieval Augmented Generation with an LLMcited by 9
3 more
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.