ILLC: Iterative Layer-by-Layer Compression for Enhancing Structural Faithfulness in SpArX
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
In the field of Explainable Artificial Intelligence (XAI), argumentative XAI approaches have been proposed to represent the internal reasoning process of deep neural networks in a more transparent way by interpreting hidden nodes as arguements. However, as the number of layers increases, existing compression methods simplify all layers at once, which lead to high accumulative information loss. To compensate for this, we propose an iterative layer-by-layer compression technique in which each layer is compressed separately and the reduction error in the next layer is immediately compensated for, thereby improving the overall input-output and structural fidelity of the model. Experiments on the Breast Cancer Diagnosis dataset show that, compared to traditional compression, the method reduces input-output and structural unfaithfulness, and maintains a more consistent attack-support relationship in the Argumentative Explanation scheme. This is significant because it provides a new way to make complex MLP models more compact while still conveying their internal inference logic without distortion.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 16 of its 26 references that are in the map. First posted on arXiv 5 Mar 2025.
Builds on
16 of 26 references.
References · 16
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 973
- 2017Channel Pruning for Accelerating Very Deep Neural Networkscited by 702
- 2019TabNet: Attentive Interpretable Tabular Learningcited by 648
- 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
- 2020Neural Additive Models: Interpretable Machine Learning with Neural Netscited by 319
4 more
- 2021Argumentative XAI: A Surveycited by 67
- 2020Interpreting Neural Networks as Gradual Argumentation Frameworks (Including Proof Appendix)cited by 39
- 2023SpArX: Sparse Argumentative Explanations for Neural Networks [Technical Report]cited by 18
- 2023ProtoArgNet: Interpretable Image Classification with Super-Prototypes and Argumentation [Technical Report]cited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Just CHOP: Embarrassingly Simple LLM Compression
- 2025Compressing Deep Neural Networks Using Explainable AI
- 2025SIRI: Scaling Iterative Reinforcement Learning with Interleaved Compression
- 2026Scalable Kronecker-Fisher Approximation: Efficient Hessian Analysis for Billion-Parameter Language Models Compression
- 2021ECQx: Explainability-Driven Quantization for Low-Bit and Sparse DNNs
- 2025Reasoning Models Can be Accurately Pruned Via Chain-of-Thought Reconstruction
- 2025ConCISE: Confidence-guided Compression in Step-by-step Efficient Reasoning
- 2025When Reasoning Meets Compression: Understanding the Effects of LLMs Compression on Large Reasoning Models