mlsanityData to 14 Oct 2026

Prober.ai: Gated Inquiry-Based Feedback via LLM-Constrained Personas for Argumentative Writing Development

arXiv 2605.05598 ↗First posted 7 May 2026cs.AI cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

The proliferation of large language models (LLMs) in educational settings has paradoxically undermined the cognitive processes they purport to support. Students increasingly outsource critical thinking to AI assistants that generate polished text on demand, resulting in measurable cognitive debt and diminished argumentative reasoning skills. We present Prober.ai, a web-based writing environment that inverts the conventional AI-tutoring paradigm: rather than generating or rewriting student text, the system constrains an LLM (Gemini 3 Flash Preview) through persona-specific system prompts and structured JSON output schemas to produce only targeted, inquiry-based questions about argumentative weaknesses. A two-phase interaction architecture -- Challenge and Unlock -- implements a pedagogical friction mechanism whereby revision suggestions are gated behind mandatory student reflection. The system's design is grounded in Toulmin's argumentation theory, research on peer feedforward questioning mechanisms, and evidence on AI-supported feedback in writing instruction. A functional prototype was developed in 36 hours during the NY EdTech Hackathon (March 2026), where it was awarded second place. We describe the system architecture, the prompt engineering methodology for constraining LLM output to pedagogically aligned JSON schemas, and discuss implications for scalable, cognition-preserving AI integration in writing education.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 1 of its 20 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

1 of 20 references.

References · 1

  1. 2025Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Taskcited by 106

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Critical Inker: Scaffolding Critical Thinking in AI-Assisted Writing Through Socratic Questioning
  2. 2026PaperMentor: A Human-Centered Multi-Agent Writing Tutor for AI Research Papers on Overleaf
  3. 2026FOXGLOVE: Understanding Goal-Oriented and Anchored Writing Feedback from Experts and LLMs on Argumentative Essays
  4. 2025Voice Interaction With Conversational AI Could Facilitate Thoughtful Reflection and Substantive Revision in Writing
  5. 2025EducationQ: Evaluating LLMs' Teaching Capabilities Through Multi-Agent Dialogue Framework
  6. 2025Exploring LLM-Generated Feedback for Economics Essays: How Teaching Assistants Evaluate and Envision Its Use
  7. 2025Chrysalis: A Unified System for Comparing Active Teaching and Passive Learning with AI Agents in Education
  8. 2024Ruffle&Riley: Insights from Designing and Evaluating a Large Language Model-Based Conversational Tutoring System