mlsanityData to 14 Oct 2026

Context-Aware Pre-Deployment Evaluation of AI Systems: A Regulatory Framework for Nigerian Fintech

arXiv 2609.24016 ↗First posted 21 Sep 2026cs.AI cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

Commercial large language models are increasingly deployed across African fintech infrastructure for fraud detection and customer communication, yet no Nigerian or African continental regulatory instrument specifies what pre-deployment evaluation such systems must undergo before procurement. This paper reviews African fintech AI governance across global, continental, and Nigerian instruments, and shows that safety is affirmed as a principle while pre-deployment evaluation is operationally unspecified. Generic safety benchmarks cannot surface the failure modes most relevant to this domain, since none contain Nigerian institutional content or test for false positive misclassification of legitimate financial communications. These claims are demonstrated using SafeAlert, a purpose-built evaluation kit applied to six commercial models across three system prompt conditions. Results show that models resisting generic harmful content requests still produce complete fraud scripts under specific framing, and that several models misclassify most legitimate Nigerian bank communications as suspicious or fraudulent, a failure invisible to standard safety evaluation. The paper concludes with a regulatory framework proposing pre-deployment evaluation requirements for the CBN, NITDA, SEC, and the AU, arguing that the identified gap reflects an absence of regulatory specification, not a shortage of technical or financial resources.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 34 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

10 of 34 references.

References · 10

  1. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  2. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  3. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
  4. 2022Red Teaming Language Models with Language Modelscited by 1,026
  5. 2021Ethical and social risks of harm from Language Modelscited by 966
  6. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 701
  7. 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 422
  8. 2025Real-World Gaps in AI Governance Researchcited by 5
  9. 2025Assessing High-Risk AI Systems under the EU AI Act: From Legal Requirements to Technical Verificationcited by 4
  10. 2015Evaluating Classifiers in Detecting 419 Scams in Bilingual Cybercriminal Communitiescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Understanding and Mitigating Risks of Generative AI in Financial Services
  2. 2026FinVault: Benchmarking Financial Agent Safety in Execution-Grounded Environments
  3. 2026Agent Security Meets Regulatory Reality -- A Practitioner Systematization of Autonomous-Agent Threats and Controls in Regulated Financial Systems
  4. 2026Governing Agentic AI in FinTech
  5. 2026FinRED: An Expert-Guided Benchmark Generation and Evaluation Framework for Financial LLM Red-Teaming
  6. 2026When AI Meets Wall Street: A Survey on Trustworthy AI in Fintech ↗
  7. 2025Agentic AI for Financial Crime Compliance
  8. 2026Toward Pre-Deployment Assurance for Enterprise AI Agents: Ontology-Grounded Simulation and Trust Certification