Monte Carlo conformal prediction for quantifying uncertainty in radio galaxy classification under ambiguous ground truth
Clicks: 2
ID: 315048
2026
Article Quality & Performance Metrics
Overall Quality
Not rated
Combines reader engagement with the AI quality analysis. This
article has not been analysed, so there is no overall score —
reader engagement is measured and shown alongside.
Reader Engagement
Popular Article
0.3
/100
2 views
1 readers
AI Quality Assessment
Not analyzed
Readership in this journal
PopularRanked #8 of 29 articles by views in RAS Techniques and Instruments
Most read
Least read
Bar heights use a square-root scale.
Mint this article as an NFT
Not yet mintedCreate a permanent, verifiable on-chain record of this article on the Scimatic Network. The NFT is held in your Journament account, and you can withdraw it to your own wallet at any time.
5
SUSD
one-off · no wallet required
Abstract
Abstract Dramatically increasing data volumes are forcing astronomers to adopt automated methods for the identification and classification of astronomical objects. Although deep-learning models are often well-suited to this task, obtaining a measure of uncertainty on their predictions is challenging. Here we consider the suitability of Monte Carlo conformal prediction (MCCP) set size and confidence as measures of model uncertainty for the astronomical classification of radio galaxies. We demonstrate this approach using model predictions from a pre-trained radio galaxy foundation model, fine-tuned on a smaller set of labelled radio galaxies. We calibrate the MCCP by obtaining annotator-derived soft label distributions, i.e. probability distributions over classes instead of single class assignments, for each of these labelled radio galaxies and compare the resulting set sizes and confidence scores to predictive entropy measures for each galaxy obtained using a supervised Bayesian deep-learning model trained using Hamiltonian Monte Carlo (HMC). The comparison reveals only a weak correlation between the measures. We suggest that this indicates that MCCP and predictive entropy capture fundamentally different aspects of the total uncertainty, and conclude that the applicability of MCCP in this context is severely limited by the practical considerations associated with obtaining soft label distributions for specialised classifications.
| Reference Key |
openalex_W7162577772
Use this key to autocite in the manuscript while using
SciMatic Manuscript Manager or Thesis Manager
|
|---|---|
| Authors | Alex Walls, James Barry, Devina Mohan, Anna M M Scaife |
| Journal | RAS Techniques and Instruments |
| Year | 2026 |
| DOI |
10.1093/rasti/rzag033
|
| URL | |
| Keywords | Keywords not found |
Citations
No citations found. To add a citation, contact the admin at info@scimatic.org
Comments
No comments yet. Be the first to comment on this article.