mlsanityData to 14 Oct 2026

Multi-view Contrastive Self-Supervised Learning of Accounting Data Representations for Downstream Audit Tasks

arXiv 2109.11201 ↗First posted 23 Sep 2021cs.LG cs.CEcited by 8

Not on the map. Why?

Abstract (arXiv)

International audit standards require the direct assessment of a financial statement's underlying accounting transactions, referred to as journal entries. Recently, driven by the advances in artificial intelligence, deep learning inspired audit techniques have emerged in the field of auditing vast quantities of journal entry data. Nowadays, the majority of such methods rely on a set of specialized models, each trained for a particular audit task. At the same time, when conducting a financial statement audit, audit teams are confronted with (i) challenging time-budget constraints, (ii) extensive documentation obligations, and (iii) strict model interpretability requirements. As a result, auditors prefer to harness only a single preferably `multi-purpose' model throughout an audit engagement. We propose a contrastive self-supervised learning framework designed to learn audit task invariant accounting data representations to meet this requirement. The framework encompasses deliberate interacting data augmentation policies that utilize the attribute characteristics of journal entry data. We evaluate the framework on two real-world datasets of city payments and transfer the learned representations to three downstream audit tasks: anomaly detection, audit sampling, and audit documentation. Our experimental results provide empirical evidence that the proposed framework offers the ability to increase the efficiency of audits by learning rich and interpretable `multi-task' representations.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 24 of its 62 references that are in the map. First posted on arXiv 23 Sep 2021.

Builds on

24 of 62 references.

References · 24

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  5. 2017Neural Discrete Representation Learningcited by 4,712
  6. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
  7. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
  8. 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,382
  9. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
  10. 2019Contrastive Multiview Codingcited by 1,301
  11. 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,066
  12. 2020What Makes for Good Views for Contrastive Learning?cited by 846
12 more
  1. 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 808
  2. 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 657
  3. 2020Contrastive Learning with Hard Negative Samplescited by 628
  4. 2020A Survey on Contrastive Self-supervised Learningcited by 554
  5. 2015Empirical Evaluation of Rectified Activations in Convolutional Networkcited by 519
  6. 2019Unsupervised Embedding Learning via Invariant and Spreading Instance Featurecited by 232
  7. 2019Scaling and Benchmarking Self-Supervised Visual Representation Learningcited by 201
  8. 2015Learning to See by Movingcited by 102
  9. 2020Data Augmenting Contrastive Learning of Speech Representations in the Time Domaincited by 63
  10. 2017Detection of Anomalies in Large Scale Accounting Data using Deep Autoencoder Networkscited by 18
  11. 2019Detection of Accounting Anomalies in the Latent Space using Adversarial Autoencoder Neural Networkscited by 13
  12. 2021NoiseVC: Towards High Quality Zero-Shot Voice Conversioncited by 4

Built on by

Cited by year

Citing papers per year: 2021: 2; 2022: 4; 2023: 0; 2024: 1; 2025: 1.

8 papers.