Towards LLM-guided Efficient and Interpretable Multi-linear Tensor Network Rank Selection
Not on the map. Why?
Abstract (arXiv)
We propose a novel framework that leverages large language models (LLMs) to guide the rank selection in tensor network models for higher-order data analysis. By utilising the intrinsic reasoning capabilities and domain knowledge of LLMs, our approach offers enhanced interpretability of the rank choices and can effectively optimise the objective function. This framework enables users without specialised domain expertise to utilise tensor network decompositions and understand the underlying rationale within the rank selection process. Experimental results validate our method on financial higher-order datasets, demonstrating interpretable reasoning, strong generalisation to unseen test data, and its potential for self-enhancement over successive iterations. This work is placed at the intersection of large language models and higher-order data analysis.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 21 of its 42 references that are in the map. First posted on arXiv 14 Oct 2024.
Builds on
21 of 42 references.
References · 21
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
- 2023Large Language Modelscited by 780
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
- 2016Tensor Ring Decompositioncited by 127
- 2017Tensor-Train Recurrent Neural Networks for Video Classificationcited by 59
9 more
- 2022LMPriors: Pre-Trained Language Models as Task-Specific Priorscited by 56
- 2020Quantum-inspired Machine Learning on high-energy physics datacited by 31
- 2018Missing Slice Recovery for Tensors Using a Low-rank Model in Embedded Spacecited by 17
- 2022Permutation Search of Tensor Network Structures via Local Samplingcited by 13
- 2023Alternating Local Enumeration (TnALE): Solving Tensor Network Structure Search with Fewer Evaluationscited by 12
- 2023SVDinsTN: A Tensor Network Paradigm for Efficient Structure Search from Regularized Modeling Perspectivecited by 9
- 2019Moving Object Detection under Discontinuous Change in Illumination Using Tensor Low-Rank and Invariant Sparse Decompositioncited by 8
- 2021More Efficient Sampling for Tensor Decomposition With Worst-Case Guaranteescited by 7
- 2024tnGPS: Discovering Unknown Tensor Network Structure Search Algorithms via Large Language Models (LLMs)cited by 5
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2025TensorLLM: Tensorising Multi-Head Attention for Enhanced Reasoning and Compression in LLMscited by 12
- 2026LLaVA-FA: Learning Fourier Approximation for Compressing Large Multimodal Modelscited by 11
- 2025TeRA: Vector-based Random Tensor Network for High-Rank Adaptation of Large Language Modelscited by 2
- 2026LLaVA-FA: Learning Fourier Approximation for Compressing Large Multimodal Models28 Jan 2026
- 2025TeRA: Vector-based Random Tensor Network for High-Rank Adaptation of Large Language Models3 Sep 2025
- 2025TensorLLM: Tensorising Multi-Head Attention for Enhanced Reasoning and Compression in LLMs26 Jan 2025
Similar, not cited
Close in wording, no citation either way
- 2023The Truth is in There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction
- 2025Domain-Aware Tensor Network Structure Search
- 2026Step-TP: A Grounded, Step-Level Dataset with Chain-of-Thought Reasoning for LLM-Guided Tensor Program Optimization
- 2024Tender: Accelerating Large Language Models via Tensor Decomposition and Runtime Requantization
- 2025LatentLLM: Attention-Aware Joint Tensor Compression
- 2024DoTA: Weight-Decomposed Tensor Adaptation for Large Language Models
- 2026Rethinking the Role of Tensor Decompositions in Post-Training LLM Compression
- 2026From Insight to Action: A Novel Framework for Interpretability-Guided Data Selection in Large Language Models