Steganography Beyond Space-Time with Chain of Multimodal AI
Not on the map. Why?
Abstract (arXiv)
Steganography is the art and science of covert writing, with a broad range of applications interwoven within the realm of cybersecurity. As artificial intelligence continues to evolve, its ability to synthesise realistic content emerges as a threat in the hands of cybercriminals who seek to manipulate and misrepresent the truth. Such synthetic content introduces a non-trivial risk of overwriting the subtle changes made for the purpose of steganography. When the signals in both the spatial and temporal domains are vulnerable to unforeseen overwriting, it calls for reflection on what, if any, remains invariant. This study proposes a paradigm in steganography for audiovisual media, where messages are concealed beyond both spatial and temporal domains. A chain of multimodal artificial intelligence is developed to deconstruct audiovisual content into a cover text, embed a message within the linguistic domain, and then reconstruct the audiovisual content through synchronising both auditory and visual modalities with the resultant stego text. The message is encoded by biasing the word sampling process of a language generation model and decoded by analysing the probability distribution of word choices. The accuracy of message transmission is evaluated under both zero-bit and multi-bit capacity settings. Fidelity is assessed through both biometric and semantic similarities, capturing the identities of the recorded face and voice, as well as the core ideas conveyed through the media. Secrecy is examined through statistical comparisons between cover and stego texts. Robustness is tested across various scenarios, including audiovisual resampling, face-swapping, voice-cloning and their combinations.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 40 of its 77 references that are in the map. First posted on arXiv 25 Feb 2025.
Builds on
40 of 77 references.
References · 40
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2016Adversarial examples in the physical worldcited by 1,762
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
28 more
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
- 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
- 2023A Watermark for Large Language Modelscited by 667
- 2018Learning Dexterous In-Hand Manipulationcited by 643
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
- 2019Defending Against Neural Fake Newscited by 553
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
- 2019Face X-ray for More General Face Forgery Detectioncited by 469
- 2018Video-to-Video Synthesiscited by 388
- 2018HiDDeN: Hiding Data With Deep Networkscited by 384
- 2016Deep Visual Foresight for Planning Robot Motioncited by 276
- 2018Deep Video Portraitscited by 265
- 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 256
- 2019Neural Voice Puppetry: Audio-driven Facial Reenactmentcited by 249
- 2020The Creation and Detection of Deepfakes: A Surveycited by 246
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2024Chain of Agents: Large Language Models Collaborating on Long-Context Taskscited by 201
- 2018X2Face: A network for controlling face generation by using images, audio, and pose codescited by 189
- 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 174
- 2017Neural Trojanscited by 151
- 2016Neural Photo Editing with Introspective Adversarial Networkscited by 109
- 2019Neural Linguistic Steganographycited by 73
- 2024Open-Source Conversational AI with SpeechBrain 1.0cited by 55
- 2023WavMark: Watermarking for Audio Generationcited by 41
- 2018Digital Watermarking for Deep Neural Networkscited by 37
- 2023Cyber Vaccine for Deepfake Immunitycited by 3
- 2022Bayesian Neural Networks for Reversible Steganographycited by 2
- 2024Steganography in Game Actionscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.