mlsanityData to 7 Oct 2026

MacroLens: A Multi-Task Benchmark for Contextual Financial Reasoning under Macroeconomic Scenarios

arXiv 2606.24950 ↗First posted 23 Jun 2026cs.LG cs.AIcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Financial decision-making is contextual: forecasting prices, valuing companies, and assessing event exposure weigh price history, accounting fundamentals, macroeconomic regime, and contemporaneous text. A benchmark over these four signals is hard to build because finance violates four assumptions of time-series evaluation: text must be gated by its publication date to prevent look-ahead, quarterly fundamentals are reported with a one- to ninety-day lag, filing text is partly redundant with the numerical statement fields it accompanies, and macroeconomic regimes leak across calendar splits. No public benchmark addresses all four signals jointly. MacroLens covers 4,416 U.S. small- and micro-cap equities over 2021-2026. Seven tasks share one point-in-time panel of prices, 46.8M XBRL accounting facts, 53 macroeconomic series, 295,860 SEC filings, and 215,882 news articles, plus a scenario layer of 1,130 macroeconomic events across 49 types automatically detected and rendered as natural language. Tasks span contextual forecasting, public and private valuation, statement generation from fundamentals and descriptions, scenario-conditioned returns, and real-estate valuation. We evaluate 19 methods across six families spanning naive heuristics through time-series foundation models, fine-tuned LLM-based time-series models, and zero-shot large language models (LLMs), plus a five-step feature-context ablation on two frontier LLMs and a gradient-boosted baseline. MacroLens is released at https://huggingface.co/datasets/DeepAuto-AI/MacroLens.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 24 of its 45 references that are in the map. First posted on arXiv 23 Jun 2026.

Builds on

24 of 45 references.

References · 24

  1. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  2. 2018Datasheets for Datasetscited by 1,371
  3. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
  4. 2023A decoder-only foundation model for time-series forecastingcited by 650
  5. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  6. 2021Monash Time Series Forecasting Archivecited by 256
  7. 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 242
  8. 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 188
  9. 2025Chronos-2: From Univariate to Universal Forecastingcited by 158
  10. 2024FinBen: A Holistic Financial Benchmark for Large Language Modelscited by 140
  11. 2024ChatTime: A Unified Multimodal Time Series Foundation Model Bridging Numerical and Textual Datacited by 92
  12. 2024Croissant: A Metadata Format for ML-Ready Datasetscited by 79
12 more
  1. 2024Context is Key: A Benchmark for Forecasting with Essential Textual Informationcited by 78
  2. 2025Time-MQA: Time Series Multi-Task Question Answering with Context Enhancementcited by 74
  3. 2024Time-MMD: Multi-Domain Multimodal Dataset for Time Series Analysiscited by 65
  4. 2025Moirai 2.0: When Less Is More for Time Series Forecastingcited by 59
  5. 2025MTBench: A Multimodal Time Series Benchmark for Temporal Reasoning and Question Answeringcited by 50
  6. 2025FinTSB: A Comprehensive and Practical Benchmark for Financial Time Series Forecastingcited by 23
  7. 2024Multi-Modal Forecaster: Jointly Predicting Time Series and Textual Datacited by 20
  8. 2024Intervention-Aware Forecasting: Breaking Historical Limits from a System Perspectivecited by 16
  9. 2025SciTS: Scientific Time Series Understanding and Generation with LLMscited by 13
  10. 2026Fin-RATE: A Real-world Financial Analytics and Tracking Evaluation Benchmark for LLMs on SEC Filingscited by 8
  11. 2025EDINET-Bench: Evaluating LLMs on Complex Financial Tasks using Japanese Financial Statementscited by 6
  12. 2025Multimodal Language Models with Modality-Specific Experts for Financial Forecasting from Interleaved Sequences of Text and Time Seriescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025History Rhymes: Macro-Contextual Retrieval for Robust Financial Forecasting
  2. 2026MM-FinEval: A Multi-Task Multimodal Benchmark for Real-World Financial Forecasting
  3. 2026Are Large Language Models Reliable Reviewers? A Benchmark for Error Detection in Financial Documents
  4. 2025Reasoning on Time-Series for Financial Technical Analysis
  5. 2023BizBench: A Quantitative Reasoning Benchmark for Business and Finance
  6. 2025FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation
  7. 2025FinanceReasoning: Benchmarking Financial Numerical Reasoning More Credible, Comprehensive and Challenging
  8. 2026When Tables Go Crazy: Evaluating Multimodal Models on French Financial Documents