Evaluating risk prediction models: the Predictiveness curve and its geometric summaries

Clicks: 1
ID: 315949
2026
Article Quality & Performance Metrics
Overall Quality
Not rated
Combines reader engagement with the AI quality analysis. This article has not been analysed, so there is no overall score — reader engagement is measured and shown alongside.
AI Quality Assessment
Not analyzed
Readership in this journal

Ranked #271 of 305 articles by views in american journal of epidemiology

Most read Least read

Bar heights use a square-root scale. Only the 120 most-read articles are drawn; the journal has 305 in total.

Mint this article as an NFT
Not yet minted

Create a permanent, verifiable on-chain record of this article on the Scimatic Network. The NFT is held in your Journament account, and you can withdraw it to your own wallet at any time.

5 SUSD one-off · no wallet required
Abstract
Risk prediction models are widely used, but their evaluation is dominated by discrimination-based measures such as the ROC curve and AUC, which provide limited insight into how risks are distributed across the population. We extend the predictiveness curve to risk prediction models, characterize its geometry, and derive three geometric summaries-the Pietra index, Gini index, and scaled Brier score. To obtain well-calibrated and stable risk estimates, we implement a three-step prediction post-processing procedure consisting of cross-validation, isotonic recalibration, and bootstrap averaging. We illustrate the approach using toy examples and a nationwide Taiwan cohort of 23 839 lung cancer patients, in whom a Cox model was used to estimate five-year fatality risk. The three indices captured complementary aspects of performance and supported purpose-specific model choice: Pietra for minimizing the gray zone, Gini for maximizing separation, and scaled Brier for increasing certainty. In the lung cancer application, the final post-processed model showed broad risk stratification: 25.2% of patients were very low risk (<10% fatality) and 50.2% high risk (>75% fatality), whereas only 4.8% were near the average risk. Overall, the predictiveness curve and its geometric summaries provide a population-oriented framework for transparent, purpose-specific evaluation of risk prediction models.
Reference Key
openalex_W7163403615 Use this key to autocite in the manuscript while using SciMatic Manuscript Manager or Thesis Manager
Authors W‐J Chiu, D F-C Tsai, Chun‐Ju Chiang, Wen-Chung Lee
Journal american journal of epidemiology
Year 2026
DOI
10.1093/aje/kwag123
URL
Keywords Keywords not found

Citations

No citations found. To add a citation, contact the admin at info@scimatic.org

No comments yet. Be the first to comment on this article.