Multi-view Contrastive Self-Supervised Learning of Accounting Data Representations for Downstream Audit Tasks
Not on the map. Why?
Abstract (arXiv)
International audit standards require the direct assessment of a financial statement's underlying accounting transactions, referred to as journal entries. Recently, driven by the advances in artificial intelligence, deep learning inspired audit techniques have emerged in the field of auditing vast quantities of journal entry data. Nowadays, the majority of such methods rely on a set of specialized models, each trained for a particular audit task. At the same time, when conducting a financial statement audit, audit teams are confronted with (i) challenging time-budget constraints, (ii) extensive documentation obligations, and (iii) strict model interpretability requirements. As a result, auditors prefer to harness only a single preferably `multi-purpose' model throughout an audit engagement. We propose a contrastive self-supervised learning framework designed to learn audit task invariant accounting data representations to meet this requirement. The framework encompasses deliberate interacting data augmentation policies that utilize the attribute characteristics of journal entry data. We evaluate the framework on two real-world datasets of city payments and transfer the learned representations to three downstream audit tasks: anomaly detection, audit sampling, and audit documentation. Our experimental results provide empirical evidence that the proposed framework offers the ability to increase the efficiency of audits by learning rich and interpretable `multi-task' representations.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 24 of its 62 references that are in the map. First posted on arXiv 23 Sep 2021.
Builds on
24 of 62 references.
References · 24
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2017Neural Discrete Representation Learningcited by 4,712
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
- 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,382
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
- 2019Contrastive Multiview Codingcited by 1,301
- 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,066
- 2020What Makes for Good Views for Contrastive Learning?cited by 846
12 more
- 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 808
- 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 657
- 2020Contrastive Learning with Hard Negative Samplescited by 628
- 2020A Survey on Contrastive Self-supervised Learningcited by 554
- 2015Empirical Evaluation of Rectified Activations in Convolutional Networkcited by 519
- 2019Unsupervised Embedding Learning via Invariant and Spreading Instance Featurecited by 232
- 2019Scaling and Benchmarking Self-Supervised Visual Representation Learningcited by 201
- 2015Learning to See by Movingcited by 102
- 2020Data Augmenting Contrastive Learning of Speech Representations in the Time Domaincited by 63
- 2017Detection of Anomalies in Large Scale Accounting Data using Deep Autoencoder Networkscited by 18
- 2019Detection of Accounting Anomalies in the Latent Space using Adversarial Autoencoder Neural Networkscited by 13
- 2021NoiseVC: Towards High Quality Zero-Shot Voice Conversioncited by 4
Built on by
Citing papers per year: 2021: 2; 2022: 4; 2023: 0; 2024: 1; 2025: 1.
8 papers.
- 2022Federated and Privacy-Preserving Learning of Accounting Data in Financial Statement Auditscited by 8
- 2021Continual Learning for Unsupervised Anomaly Detection in Continuous Auditing of Financial Accounting Datacited by 7
- 2021Zero-shot Voice Conversion via Self-supervised Prosody Representation Learningcited by 6
- 2022Explaining Anomalies using Denoising Autoencoders for Financial Tabular Datacited by 4
- 2022Federated Continual Learning to Detect Accounting Anomalies in Financial Auditingcited by 4
- 2025Diffusion-Scheduled Denoising Autoencoders for Anomaly Detection in Tabular Datacited by 4
- 2022RESHAPE: Explaining Accounting Anomalies in Financial Statement Audits by enhancing SHapley Additive exPlanationscited by 2
- 2024Sampling Audit Evidence Using a Naive Bayes Classifiercited by 0
- 2025Diffusion-Scheduled Denoising Autoencoders for Anomaly Detection in Tabular Data1 Aug 2025
- 2024Sampling Audit Evidence Using a Naive Bayes Classifier21 Mar 2024
- 2022Federated Continual Learning to Detect Accounting Anomalies in Financial Auditing26 Oct 2022
- 2022Explaining Anomalies using Denoising Autoencoders for Financial Tabular Data21 Sep 2022
- 2022RESHAPE: Explaining Accounting Anomalies in Financial Statement Audits by enhancing SHapley Additive exPlanations19 Sep 2022
- 2022Federated and Privacy-Preserving Learning of Accounting Data in Financial Statement Audits26 Aug 2022
- 2021Continual Learning for Unsupervised Anomaly Detection in Continuous Auditing of Financial Accounting Data25 Dec 2021
- 2021Zero-shot Voice Conversion via Self-supervised Prosody Representation Learning27 Oct 2021