Abstract 1312
Background
Predictive online calculators are used by clinicians as decision aids in early breast cancer (EBC). While use statistics for these calculators have not been published, as of 2017 NHS Predict was being accessed more than 20,000 times a month. These predictive tools have not had accuracy & benefit of use prospectively confirmed in EBC, yet use of calculators has been encouraged in EBC guidelines. It is important to understand the populations informing model development & validation, to understand how data bias may impact predictions in under-represented subpopulations. This work sought to elucidate the risk of bias in model development & validation for 3 online EBC calculators (NHS Predict, Adjuvant! & Cancermath), in an effort to highlight sub-populations where calculated risk & therefore treatment benefit estimates may be less reliable.
Methods
A literature search was conducted in PubMed, search terms were “predict*” “adjuvant” “breast” & “algorithm”. Results were screened for relevance to the three predictive tools under scrutiny & additional references were extracted from relevant papers. Using a modified CHARMS checklist, the relevant sections of the development & validation papers were extracted.
Results
6 development & 24 validation papers were reviewed as summarised in the TableTable:
264P
Predict | Adjuvant | Cancermath | |
---|---|---|---|
Development population size & date range | 5694 1977-2008 | 37,968 1977-2007 | 499,724 1977-2007 |
Aged <35 in development population | 2% (111) | 0 | >0.5% |
Aged >65 in development population | 32% (1781) | 0 | >17% |
Tumour size >5cm in development population | 5% (287) | 0 | 0 |
Number of validation studies | 10 | 13 | 3 |
% retrospective | 100 | 100 | 100 |
Total number of patients in validation studies | 19,864 | 19,618 | 11,203 |
Age >65 in validations | 35% (7134) | 42% (8313) | 40% (4519) |
Age <35 in validations | 16% (3235) | 8% (1518) | 9% (1007) |
Tumour size >5cm in validations | 5% (287) | 5% (1015) | 6% (634) |
Universal exclusions | Multi-focal, inflammatory, male | Multi-focal, inflammatory, male | Multi-focal, inflammatory, male |
Neoadjuvant chemotherapy not an exclusion | 1 study (121 patients) | 0 | 0 |
Overall conclusions of validation authors | Earlier versions under-predicted mortality in women <35 Poor performance in tumours >5cm. | Poor performance in general in: <35 and >65 More advanced disease Malay ethnicity Overly optimistic survival predictions across subgroups in UK population. | Poor performance in < 35 Systematically under-predicted mortality, especially for ER-negative tumours. |
Conclusions
All 3 predictive tools have under-represented groups in their development cohorts, specifically those under 35 & over 65 years old, as well as larger tumours. Validation studies consistently demonstrate worse performance in these groups. However, due to inconsistent methodology in validation studies, quantitating the summary performance within & across tools is difficult. These predictive tools should be used with caution in under-represented populations. More work is required to look at clinical utility of tools as well as their statistical performance.
Clinical trial identification
Editorial acknowledgement
Legal entity responsible for the study
The authors.
Funding
Has not received any funding.
Disclosure
All authors have declared no conflicts of interest.
Resources from the same session
5887 - Factors of importance in procuring tumoroids from colorectal liver metastasis biopsies for precision medicine.
Presenter: Lars Henrik Jensen
Session: Poster Display session 2
Resources:
Abstract
2196 - FUSAFE individual patient data meta-analysis (MA) to assess the performance of dihydropyrimidine dehydrogenase (DPD) gene polymorphisms for predicting grade 4-5 fluoropyrimidine (FP) toxicity
Presenter: Marie-Christine Etienne-Grimaldi
Session: Poster Display session 2
Resources:
Abstract
2859 - Treatments (tx) after progression to first-line FOLFOXIRI + bevacizumab (bev) in metastatic colorectal cancer (mCRC) patients (pts): A pooled analysis of TRIBE and TRIBE-2 studies by GONO.
Presenter: Daniele Rossini
Session: Poster Display session 2
Resources:
Abstract
3888 - Randomized phase III study of sequential treatment with capecitabine or 5-fluorouracil (FP) plus bevacizumab (BEV) followed by the addition with oxaliplatin (OX) versus initial combination with OX+FP+ BEV in the first-line chemotherapy for metastatic colorectal cancer: The C-cubed study
Presenter: Takeshi Nagasaka
Session: Poster Display session 2
Resources:
Abstract
1065 - Early tumour shrinkage (ETS), depth of response (DpR) and associated survival outcomes in patients (pts) with RAS wild type (WT) metastatic colorectal cancer (mCRC) classified according to Köhne prognostic category: retrospective analysis of the panitumumab (Pmab) PRIME study
Presenter: Andrea Sartore-Bianchi
Session: Poster Display session 2
Resources:
Abstract
1702 - Randomized phase II trial of CAPOX with planned oxaliplatin stop-and-go strategy as adjuvant chemotherapy after curative resection of colon cancer (CCOG-1302 study)
Presenter: Hiroyuki Yokoyama
Session: Poster Display session 2
Resources:
Abstract
5104 - A metabolomic recurrence score for risk-stratification of elderly patients (pts) with early colorectal cancer (eCRC)
Presenter: Samantha Di Donato
Session: Poster Display session 2
Resources:
Abstract
5285 - RAS mutant allele fraction in plasma predicts benefit to anti-angiogenic based first line treatment in metastatic colorectal cancer
Presenter: Giulia Martini
Session: Poster Display session 2
Resources:
Abstract
1790 - Impact of prophylactic systemic antibiotics (SA) on outcome of patients (pts) with RAS-wildtype (RAS-wt) metastatic colorectal carcinoma (mCRC) treated with cetuximab-based first-line therapy. Subgroup analysis of the german non-interventional study ERBITAG
Presenter: Stephan Sahm
Session: Poster Display session 2
Resources:
Abstract
3059 - Intraoperative chemotherapy with 5-FU for colorectal cancer patients receiving curative resection (IOCCRC): A randomized, multicenter, prospective, phase III trial
Presenter: Rongxin Zhang
Session: Poster Display session 2
Resources:
Abstract