# SWE-Sharp-Bench: A Reproducible Benchmark for C# Software Engineering Tasks

arXiv: https://arxiv.org/abs/2511.02352 · HTML: https://mlsanity.com/paper/2511.02352/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use.
- First posted on arXiv 4 Nov 2025.

## Placed in

- LLM agents and tool use / [Software engineering coding agents](https://mlsanity.com/agents/software-engineering-coding-agents/)

## Built on by (most cited first, 4 of 4)

- [SWE-rebench V2: Language-Agnostic SWE Task Collection at Scale](https://mlsanity.com/paper/2602.23866/) (2026)
- [REAP: Automatic Curation of Coding Agent Benchmarks from Interactive Production Usage](https://mlsanity.com/paper/2604.01527/) (2026)
- [MobileDev-Bench: A Benchmark for Issue Resolution in Mobile Application Development](https://mlsanity.com/paper/2603.24946/) (2026)
- [ACE-Bench: A Lightweight Benchmark for Evaluating Azure SDK Usage Correctness](https://mlsanity.com/paper/2604.09564/) (2026)

## Abstract (arXiv)

AI coding agents have shown great progress on Python software engineering benchmarks like SWE-Bench, and for other languages like Java and C in benchmarks like Multi-SWE-Bench. However, C# -- a prominent enterprise language ranking #5 in the TIOBE index -- remains absent from such benchmarks. We introduce SWE-Sharp-Bench, a reproducible software engineering benchmark for C# featuring 150 instances from 17 repositories. Evaluating identical model-agent configurations across languages reveals a significant performance gap: while 70% of Python tasks in SWE-Bench Verified are solved, only 40% of our C# tasks are resolved. We open-source SWE-Sharp-Bench and our entire curation pipeline.