A Peek Behind the Curtain: Using Step-Around Prompt Engineering to Identify Bias and Misinformation in GenAI Models
On the map: LLM safety and security → Safety alignment, refusal and guardrails
Abstract (arXiv)
Step-around prompting is a form of adversarial prompt engineering in which a user strategically reframes, sequences, or contextualises requests to test whether a generative AI model's safety guardrails, alignment mechanisms, or bias mitigations can be undermined, inconsistently applied, or bypassed outright. This study examines this technique through the lens of academic ethics, situating it as a tool that has a clear impact on academic integrity, responsible conduct of research, duty of care to students, and institutional oversight of GenAI use in higher education. We argue that step-around prompting is one tool within the wider practice of audit, red-teaming, and institutional evaluation, and that its main value lies in documenting how representational, cultural, linguistic, disciplinary, and misinformation-related biases may appear across student-facing and research-facing uses of GenAI. To show why the ethical governance of this practice is required, we provide two illustrative examples of the technique in action, demonstrating how easily guardrails can be circumvented and what is at stake when they are. We clarify which bias categories are in scope and identify who should use the method and for what purposes. We conclude with an operational ethics-and-governance framework for controlled academic application, organised as two pillars (technical safeguards and ethical governance) and enacted through a decision and audit cycle that scales oversight to potential risk, grounded in harm minimisation, duty of care, transparency, proportionality, responsible disclosure, legal and contractual compliance, and student protection.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 38 of its 75 references that are in the map. First posted on arXiv 19 Mar 2025.
Builds on
38 of 75 references.
References · 38
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 729
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 619
- 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 492
- 2023Certifying LLM Safety against Adversarial Promptingcited by 266
- 2023PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Promptscited by 226
- 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 224
- 2023Large Language Models as General Pattern Machinescited by 197
- 2025Constitutional Classifiers: Defending against Universal Jailbreaks across Thousands of Hours of Red Teamingcited by 181
- 2023GPT detectors are biased against non-native English writerscited by 178
26 more
- 2018The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigationcited by 165
- 2024Collective Constitutional AI: Aligning a Language Model with Public Inputcited by 123
- 2024The Prompt Report: A Systematic Survey of Prompt Engineering Techniquescited by 121
- 2023Testing of Detection Tools for AI-Generated Textcited by 90
- 2023Fairness And Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, And Mitigation Strategiescited by 85
- 2024Red-Teaming for Generative AI: Silver Bullet or Security Theater?cited by 83
- 2023Specific versus General Principles for Constitutional AIcited by 47
- 2023GenAI Against Humanity: Nefarious Applications of Generative Artificial Intelligence and Large Language Modelscited by 42
- 2024Inverse Constitutional AI: Compressing Preferences into Principlescited by 41
- 2023Diversity of Thought Improves Reasoning Abilities of LLMscited by 25
- 2023Disinformation Capabilities of Large Language Modelscited by 25
- 2025Lessons From Red Teaming 100 Generative AI Productscited by 23
- 2024To Rely or Not to Rely? Evaluating Interventions for Appropriate Reliance on Large Language Modelscited by 18
- 2023Protecting Society from AI Misuse: When are Restrictions on Capabilities Warranted?cited by 16
- 2023Game of Tones: Faculty detection of GPT-4 generated content in university assessmentscited by 16
- 2024Attack Atlas: A Practitioner's Perspective on Challenges and Pitfalls in Red Teaming GenAIcited by 16
- 2024AI-generated faces influence gender stereotypes and racial homogenizationcited by 14
- 2024GenAI Detection Tools, Adversarial Techniques and Implications for Inclusivity in Higher Educationcited by 14
- 2023A "Perspectival" Mirror of the Elephant: Investigating Language Bias on Google, ChatGPT, YouTube, and Wikipediacited by 8
- 2023Generative AI for Hate Speech Detection: Evaluation and Findingscited by 7
- 2023Disinformation 2.0 in the Age of AI: A Cybersecurity Perspectivecited by 5
- 2024Deepfakes and Higher Education: A Research Agenda and Scoping Review of Synthetic Mediacited by 5
- 2021Words of Wisdom: Representational Harms in Learning From AI Communicationcited by 4
- 2023Accused: How students respond to allegations of using ChatGPT on assessmentscited by 4
- 2024Funhouse Mirror or Echo Chamber? A Methodological Approach to Teaching Critical AI Literacy Through Metaphorscited by 2
- 2025GenAI as Digital Plastic: Understanding Synthetic Media Through Critical AI Literacycited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Can Prompt Modifiers Control Bias? A Comparative Analysis of Text-to-Image Generative Models
- 2025Auditing the Ethical Logic of Generative AI Models
- 2024Mapping the Ethics of Generative AI: A Comprehensive Scoping Review
- 2026Rethinking Generative AI Literacy: An Integrative, Developmental, and Dialectical Framework for K-12 Teacher Education
- 2024Prompt and Prejudice
- 2025Data and AI governance: Promoting equity, ethics, and fairness in large language models
- 2025Empirical Evidence for Alignment Faking in a Small LLM and Prompt-Based Mitigation Techniques
- 2026Mitigating Prompt-Induced Cognitive Biases in General-Purpose AI for Software Engineering