Oops, you're using an old version of your browser so some of the features on this page may not be displaying properly.

MINIMAL Requirements: Google Chrome 24+Mozilla Firefox 20+Internet Explorer 11Opera 15–18Apple Safari 7SeaMonkey 2.15-2.23

Poster Display session 2

1312 - Predictive tools in adjuvant breast cancer – what is the standard of evidence supporting their utility? A literature review examining validation of Adjuvant!, Cancermath and NHS Predict

Date

29 Sep 2019

Session

Poster Display session 2

Topics

Tumour Site

Breast Cancer

Presenters

Alice Loft

Citation

Annals of Oncology (2019) 30 (suppl_5): v55-v98. 10.1093/annonc/mdz240

Authors

A.R. Loft1, R.M. Strother2

Author affiliations

  • 1 Oncology, Christchurch Hospital, 8014 - Christchurch/NZ
  • 2 Oncology Dept, Christchurch Hospital, 8014 - Christchurch/NZ
More

Resources

Abstract 1312

Background

Predictive online calculators are used by clinicians as decision aids in early breast cancer (EBC). While use statistics for these calculators have not been published, as of 2017 NHS Predict was being accessed more than 20,000 times a month. These predictive tools have not had accuracy & benefit of use prospectively confirmed in EBC, yet use of calculators has been encouraged in EBC guidelines. It is important to understand the populations informing model development & validation, to understand how data bias may impact predictions in under-represented subpopulations. This work sought to elucidate the risk of bias in model development & validation for 3 online EBC calculators (NHS Predict, Adjuvant! & Cancermath), in an effort to highlight sub-populations where calculated risk & therefore treatment benefit estimates may be less reliable.

Methods

A literature search was conducted in PubMed, search terms were “predict*” “adjuvant” “breast” & “algorithm”. Results were screened for relevance to the three predictive tools under scrutiny & additional references were extracted from relevant papers. Using a modified CHARMS checklist, the relevant sections of the development & validation papers were extracted.

Results

6 development & 24 validation papers were reviewed as summarised in the TableTable:

264P

PredictAdjuvantCancermath
Development population size & date range5694 1977-200837,968 1977-2007499,724 1977-2007
Aged <35 in development population2% (111)0>0.5%
Aged >65 in development population32% (1781)0>17%
Tumour size >5cm in development population5% (287)00
Number of validation studies10133
% retrospective100100100
Total number of patients in validation studies19,86419,61811,203
Age >65 in validations35% (7134)42% (8313)40% (4519)
Age <35 in validations16% (3235)8% (1518)9% (1007)
Tumour size >5cm in validations5% (287)5% (1015)6% (634)
Universal exclusionsMulti-focal, inflammatory, maleMulti-focal, inflammatory, maleMulti-focal, inflammatory, male
Neoadjuvant chemotherapy not an exclusion1 study (121 patients)00
Overall conclusions of validation authorsEarlier versions under-predicted mortality in women <35 Poor performance in tumours >5cm.Poor performance in general in: <35 and >65 More advanced disease Malay ethnicity Overly optimistic survival predictions across subgroups in UK population.Poor performance in < 35 Systematically under-predicted mortality, especially for ER-negative tumours.
.

Conclusions

All 3 predictive tools have under-represented groups in their development cohorts, specifically those under 35 & over 65 years old, as well as larger tumours. Validation studies consistently demonstrate worse performance in these groups. However, due to inconsistent methodology in validation studies, quantitating the summary performance within & across tools is difficult. These predictive tools should be used with caution in under-represented populations. More work is required to look at clinical utility of tools as well as their statistical performance.

Clinical trial identification

Editorial acknowledgement

Legal entity responsible for the study

The authors.

Funding

Has not received any funding.

Disclosure

All authors have declared no conflicts of interest.

This site uses cookies. Some of these cookies are essential, while others help us improve your experience by providing insights into how the site is being used.

For more detailed information on the cookies we use, please check our Privacy Policy.

Customise settings
  • Necessary cookies enable core functionality. The website cannot function properly without these cookies, and you can only disable them by changing your browser preferences.