mlsanityData to 7 Oct 2026

β3-IRT: A New Item Response Model and its Applications

arXiv 1903.04016 ↗First posted 10 Mar 2019stat.ML cs.LGcited by 17

Not on the map. Why?

Abstract (arXiv)

Item Response Theory (IRT) aims to assess latent abilities of respondents based on the correctness of their answers in aptitude test items with different difficulty levels. In this paper, we propose the β3-IRT model, which models continuous responses and can generate a much enriched family of Item Characteristic Curve (ICC). In experiments we applied the proposed model to data from an online exam platform, and show our model outperforms a more standard 2PL-ND model on all datasets. Furthermore, we show how to apply β3-IRT to assess the ability of machine learning classifiers. This novel application results in a new metric for evaluating the quality of the classifier's probability estimates, based on the inferred difficulty and discrimination of data instances.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Mar 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 3; 2022: 0; 2023: 2; 2024: 4; 2025: 2; 2026: 6.

17 papers.

Sort:

  1. 2024Fairness Evaluation with Item Response Theorycited by 7
  2. 2024Scalable Learning of Item Response Theory Modelscited by 6
  3. 2026Confident Rankings with Fewer Items: Adaptive LLM Evaluation with Continuous Scorescited by 4
  4. 2024TaskEval: Assessing Difficulty of Code Generation Tasks for Large Language Modelscited by 3
  5. 2021Unsupervised Anomaly Detection Ensembles using Item Response Theorycited by 2
  6. 2023β4-IRT: A New β3-IRT with Enhanced Discrimination Estimationcited by 2
  7. 2023Comprehensive Algorithm Portfolio Evaluation using Item Response Theorycited by 2
  8. 2026Efficient Benchmarking Is Just Feature Selection and Multiple Regressioncited by 1
  9. 2021Neurons learn slower than they thinkcited by 0
  10. 2021Deep Learning-Based Estimation and Goodness-of-Fit for Large-Scale Confirmatory Item Factor Analysiscited by 0
  11. 2024On Evaluation of Vision Datasets and Models using Human Competency Frameworkscited by 0
  12. 2025A Dynamic, Ordinal Gaussian Process Item Response Theoretic Modelcited by 0
5 more
  1. 2025Enhancing Essay Cohesion Assessment: A Novel Item Response Theory Approachcited by 0
  2. 2026The Masked Advantage: Uncovering Local-Language Access to Cultural Knowledge in LLMscited by 0
  3. 2026Item Response Scaling Laws: A Measurement Theory Approach for Efficient and Generalizable Neural Scaling Estimationcited by 0
  4. 2026BayesAME: Bayesian Active Model Evaluationcited by 0
  5. 2026Every Wrong Answer Counts: Option-Level Psychometrics for LLM Multiple-Choice Benchmarkscited by 0