The Model Is Not the Product: A Dual-Pillar Architecture for Local-First Psychological Coaching
Not on the map. Why?
Abstract (arXiv)
Existing language model applications struggle to meet the demand for emotionally oriented support, primarily due to their inability to maintain deep, persistent context across sessions. This report introduces Psych LM, an iOS application that validates the thesis that, for such applications, the surrounding architecture is paramount. Psych LM runs a local, on-device language model within a purpose-built, local-first runtime designed for behavioral and life-coaching applications. The system achieves the practical effect of a near-infinite context window through an automated, user-inspectable memory corpus that converts conversations into structured memory cards, including facts, goals, and events, and dynamically injects them into the prompt via semantic and vector search. As such, the system can be defined as an active-learning, retrieval-augmented generative, on-device architecture. This architecture delivers four primary contributions: a local-first design where privacy is a core property; a detailed description of the memory corpus for persistent context of key user information; a deterministic orchestration layer that provides a stable behavioral spine independent of the model's internal state; and a benchmark framework focused on evaluating the integrated system's reliability under realistic operating conditions. The R and D process confirms that complex, context-aware interaction can be reliably achieved under the strict constraints of a mobile environment by prioritizing architectural control and resource management over simple model size.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 16 references that are in the map. First posted on arXiv 23 May 2026.
Builds on
12 of 16 references.
References · 12
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 619
- 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 431
- 2024The Faiss librarycited by 376
- 2024MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Casescited by 223
- 2024On-Device Language Models: A Comprehensive Reviewcited by 104
- 2024The opportunities and risks of large language models in mental healthcited by 54
- 2022On the Privacy of Mental Health Apps: An Empirical Investigation and its Implications for Apps Developmentcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Advancing Conversational Psychotherapy: Integrating Privacy, Dual-Memory, and Domain Expertise with Large Language Models
- 2026Emotion-Attended Stateful Memory (EASM):The Architecture for Hyper-Personalization at Scale
- 2026Retrieval-Augmented Generation in LLMs for Mental Health: Quantifying the Incremental Contribution of Retrieval Within a Layered Safety Architecture
- 2025PsycholexTherapy: Simulating Reasoning in Psychotherapy with Small Language Models in Persian
- 2024Domain-Specific Improvement on Psychotherapy Chatbot Using Assistant
- 2026ENPMR-Bench: Benchmarking Proactive Memory Retrieval for Emotional Support Agents
- 2025Understanding Users' Privacy Perceptions Towards LLM's RAG-based Memory
- 2026From Stateless to Situated: Building a Psychological World for LLM-Based Agents