Fighting Fire with Fire: On the Feasibility of Protecting Exercises Against AI Cheating
Not on the map. Why?
Abstract (arXiv)
The widespread adoption of generative AI enables students to outsource cognitive effort to increasingly capable assistants, creating an illusion of competence while undermining the independent reasoning that education aims to cultivate. We investigate whether adversarial machine learning can be repurposed to protect educational exercises against such corrosive reliance. Our approach uses multimodal multiple-choice questions whose visual components can be protected with subtle visual perturbations that steer AI solvers toward designated incorrect answers. These responses form a statistical fingerprint: students who blindly copy a solver reproduce the induced answer pattern more frequently than genuine students. We study the feasibility of this paradigm under realistic black-box assistant assumptions using three of the most common state-of-the-art multimodal language models: Anthropic's Claude, Google's Gemini, and OpenAI's ChatGPT. By using accessible surrogate models, we optimize adversarial perturbations that induce consistent response patterns. Those patterns enable principled detection through statistical hypothesis testing. These findings establish both the promise and the limitations of fighting machine-assisted reasoning with the vulnerabilities of the machines themselves.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 39 references that are in the map. First posted on arXiv 2 Aug 2026.
Builds on
19 of 39 references.
References · 19
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2013Intriguing properties of neural networkscited by 5,114
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2018Robustness May Be at Odds with Accuracycited by 873
- 2016Delving into Transferable Adversarial Examples and Black-box Attackscited by 530
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 490
- 2025Humanity's Last Examcited by 467
- 2026Gemma 4 Technical Reportcited by 187
- 2023Raising the Cost of Malicious AI-Powered Image Editingcited by 160
- 2021Protecting Intellectual Property of Language Generation APIs with Lexical Watermarkcited by 78
- 2023Nightshade: Prompt-Specific Poisoning Attacks on Text-to-Image Generative Modelscited by 72
7 more
- 2023On the Learnability of Watermarks for Language Modelscited by 72
- 2025Adversarial Attacks against Closed-Source MLLMs via Feature Optimal Alignmentcited by 42
- 2023EditShield: Protecting Unauthorized Image Editing by Instruction-guided Diffusion Modelscited by 27
- 2023WatME: Towards Lossless Watermarking Through Lexical Redundancycited by 22
- 2024MMEvalPro: Calibrating Multimodal Benchmarks Towards Trustworthy and Efficient Evaluationcited by 17
- 2024GenAI Detection Tools, Adversarial Techniques and Implications for Inclusivity in Higher Educationcited by 13
- 2025Position: LLM Watermarking Should Align Stakeholders' Incentives for Practical Adoptioncited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Hierarchical Pedagogical Oversight: A Multi-Agent Adversarial Framework for Reliable AI Tutoring
- 2026Catching The Correct Answer Trap: Characterising AI Tutor Blind Spots When Analysing Student Reasoning
- 2026Hiding in Plain Sight: Detectability-Aware Antidistillation of Reasoning Models
- 2025Distractor Injection Attacks on Large Reasoning Models: Characterization and Defense
- 2025MSCR: Exploring the Vulnerability of LLMs' Mathematical Reasoning Abilities Using Multi-Source Candidate Replacement
- 2025RIDE: Difficulty Evolving Perturbation with Item Response Theory for Mathematical Reasoning
- 2026Evaluating the Semantic-to-Geometric Gap in Adversarial Defenses Against Vision-Language Model-Based Plagiarism
- 2025Turning Logic Against Itself : Probing Model Defenses Through Contrastive Questions