mlsanityData to 14 Oct 2026

MINT: A Universal Zero-Shot Predictor for Transaction Data

arXiv 2608.14198 ↗First posted 14 Aug 2026cs.LG cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Banks analyse sequential financial transaction data to perform many tasks, including fraud prevention, credit risk assessment and offer personalization. To improve the predictive accuracy of these tasks, Payments Foundation Models encode transaction sequence data as rich contextual embeddings, which can then be provided to task-specific models as features. However, these Foundation Models are not designed for flexible zero-shot reasoning across novel downstream prediction tasks, limiting their adaptability and utility. Existing LLM-based approaches to zero-shot prediction often fail to fully exploit the predictive signal within transaction data, while relying on costly text serialization or task-specific architectures that scale poorly. To address these limitations, we present the Multimodal Instruction Network for Transactions (MINT), a framework that connects a pretrained transaction sequence encoder to a decoder-only LLM through lightweight embedding injection, transaction-language alignment, and instruction tuning. We find that MINT achieves state-of-the-art predictive question-answering performance in both in-distribution and out-of-distribution questions, while substantially reducing input tokens, latency, and memory consumption compared to text-serialization baselines. Through comprehensive analyses of representations, alignment strategies, training data, and history length, we establish that compact transaction embeddings are a superior approach to transaction representation than text serialization for multimodal reasoning and zero-shot prediction tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 25 references that are in the map. First posted on arXiv 14 Aug 2026.

Builds on

11 of 25 references.

References · 11

  1. 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 311
  2. 2024ChatTS: Aligning Time Series with LLMs via Synthetic Data for Enhanced Understanding and Reasoningcited by 103
  3. 2020Tabular Transformers for Modeling Multivariate Time Seriescited by 77
  4. 2025SensorLM: Learning the Language of Wearable Sensorscited by 49
  5. 2020CoLES: Contrastive Learning for Event Sequences with Self-Supervisioncited by 32
  6. 2024Towards a Foundation Purchasing Model: Pretrained Generative Autoregression on Transaction Sequencescited by 11
  7. 2024Scalable Representation Learning for Multimodal Tabular Transactionscited by 5
  8. 2025Your Spending Needs Attention: Modeling Financial Habits with Transformerscited by 4
  9. 2025PANTHER: Generative Pretraining Beyond Language for Sequential User Behavior Modelingcited by 4
  10. 2025TREASURE: The Visa Payment Foundation Model for High-Volume Transaction Understandingcited by 3
  11. 2024Fine-grained Attention in Hierarchical Transformers for Tabular Time-seriescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Zero-Shot Question Answering over Financial Documents using Large Language Models
  2. 2025LATTE: Learning Aligned Transactions and Textual Embeddings for Bank Clients
  3. 2026UniFinEval: Towards Unified Evaluation of Financial Multimodal Models across Text, Images and Videos
  4. 2026FinixDoc: Rethinking Financial Document Parsing Beyond Saturated Benchmarks
  5. 2026Financial Transaction Retrieval and Contextual Evidence for Knowledge-Grounded Reasoning
  6. 2026FinAnchor: Aligned Multi-Model Representations for Financial Prediction
  7. 2026FinAcumen: Financial Multimodal Reasoning via Self-Evolving Experience Memory Harness
  8. 2025MultiFinRAG: An Optimized Multimodal Retrieval-Augmented Generation (RAG) Framework for Financial Question Answering