Abstract 1312
Background
Predictive online calculators are used by clinicians as decision aids in early breast cancer (EBC). While use statistics for these calculators have not been published, as of 2017 NHS Predict was being accessed more than 20,000 times a month. These predictive tools have not had accuracy & benefit of use prospectively confirmed in EBC, yet use of calculators has been encouraged in EBC guidelines. It is important to understand the populations informing model development & validation, to understand how data bias may impact predictions in under-represented subpopulations. This work sought to elucidate the risk of bias in model development & validation for 3 online EBC calculators (NHS Predict, Adjuvant! & Cancermath), in an effort to highlight sub-populations where calculated risk & therefore treatment benefit estimates may be less reliable.
Methods
A literature search was conducted in PubMed, search terms were “predict*” “adjuvant” “breast” & “algorithm”. Results were screened for relevance to the three predictive tools under scrutiny & additional references were extracted from relevant papers. Using a modified CHARMS checklist, the relevant sections of the development & validation papers were extracted.
Results
6 development & 24 validation papers were reviewed as summarised in the TableTable:
264P
Predict | Adjuvant | Cancermath | |
---|---|---|---|
Development population size & date range | 5694 1977-2008 | 37,968 1977-2007 | 499,724 1977-2007 |
Aged <35 in development population | 2% (111) | 0 | >0.5% |
Aged >65 in development population | 32% (1781) | 0 | >17% |
Tumour size >5cm in development population | 5% (287) | 0 | 0 |
Number of validation studies | 10 | 13 | 3 |
% retrospective | 100 | 100 | 100 |
Total number of patients in validation studies | 19,864 | 19,618 | 11,203 |
Age >65 in validations | 35% (7134) | 42% (8313) | 40% (4519) |
Age <35 in validations | 16% (3235) | 8% (1518) | 9% (1007) |
Tumour size >5cm in validations | 5% (287) | 5% (1015) | 6% (634) |
Universal exclusions | Multi-focal, inflammatory, male | Multi-focal, inflammatory, male | Multi-focal, inflammatory, male |
Neoadjuvant chemotherapy not an exclusion | 1 study (121 patients) | 0 | 0 |
Overall conclusions of validation authors | Earlier versions under-predicted mortality in women <35 Poor performance in tumours >5cm. | Poor performance in general in: <35 and >65 More advanced disease Malay ethnicity Overly optimistic survival predictions across subgroups in UK population. | Poor performance in < 35 Systematically under-predicted mortality, especially for ER-negative tumours. |
Conclusions
All 3 predictive tools have under-represented groups in their development cohorts, specifically those under 35 & over 65 years old, as well as larger tumours. Validation studies consistently demonstrate worse performance in these groups. However, due to inconsistent methodology in validation studies, quantitating the summary performance within & across tools is difficult. These predictive tools should be used with caution in under-represented populations. More work is required to look at clinical utility of tools as well as their statistical performance.
Clinical trial identification
Editorial acknowledgement
Legal entity responsible for the study
The authors.
Funding
Has not received any funding.
Disclosure
All authors have declared no conflicts of interest.
Resources from the same session
4413 - Infigratinib versus gemcitabine plus cisplatin multicenter, open-label, randomized, phase 3 study in patients with advanced cholangiocarcinoma with FGFR2 gene fusions/translocations: the PROOF trial
Presenter: Ghassan Abou-Alfa
Session: Poster Display session 2
Resources:
Abstract
4710 - Phase 3 (COSMIC-312) study of cabozantinib (C) in combination with atezolizumab (A) vs sorafenib (S) in patients (pts) with advanced hepatocellular carcinoma (aHCC) who have not received previous systemic anticancer therapy
Presenter: Lorenza Rimassa
Session: Poster Display session 2
Resources:
Abstract
5509 - A Randomized Controlled, Open label, Adaptive Phase-3 Trial to Evaluate Safety and Efficacy of EndoTAG-1 Plus Gemcitabine versus Gemcitabine alone in Patients with Measurable Locally Advanced and/or Metastatic Adenocarcinoma of the Pancreas Failed on FOLFIRINOX Treatment (NCT03126435)
Presenter: Li-Tzong Chen
Session: Poster Display session 2
Resources:
Abstract
1463 - Modified FOLFOX versus modified FOLFOX plus nivolumab and ipilimumab in patients with previously untreated advanced or metastatic adenocarcinoma of the stomach or gastroesophageal junction – Moonlight, a randomized phase 2 trial of the German Gastric Group of the AIO.
Presenter: Sylvie Lorenzen
Session: Poster Display session 2
Resources:
Abstract
2392 - GLOW: Randomized Phase 3 Study of Zolbetuximab + CAPOX Compared With Placebo + CAPOX as First-line Treatment of Patients With CLD18.2⁺/HER2⁻ Locally Advanced Unresectable or Metastatic Gastric or Gastroesophageal Junction (GEJ) Adenocarcinoma
Presenter: Manish Shah
Session: Poster Display session 2
Resources:
Abstract
5217 - PRODIGE67_UCGI33 ARION: Association of Radiochemotherapy and Immunotherapy for the treatment of unresectable Oesophageal caNcer: a comparative randomized phase II trial
Presenter: Rosine Guimbaud
Session: Poster Display session 2
Resources:
Abstract
1726 - Randomized phase II trial of weekly paclitaxel + ramucirumab versus weekly nab-paclitaxel + ramucirumab for unresectable advanced or recurrent gastric cancer with peritoneal dissemination refractory to first-line therapy: WJOG10617G/P-SELECT
Presenter: Kenro Hirata
Session: Poster Display session 2
Resources:
Abstract
2279 - FRONTiER: A Feasibility Trial of Nivolumab With Neoadjuvant CF or DCF Therapy for Locally Advanced Esophageal Carcinoma
Presenter: Shun Yamamoto
Session: Poster Display session 2
Resources:
Abstract
4912 - A phase Ib/II study of AK104, a PD-1/CTLA-4 Bispecific Antibody, Combined With mXELOX as First-line Therapy for Advanced Gastric or Gastroesophageal Junction (GEJ) Adenocarcinoma
Presenter: Jiafu Ji
Session: Poster Display session 2
Resources:
Abstract
3780 - Perioperative atezolizumab in combination with FLOT versus FLOT alone in patients with resectable esophagogastric adenocarcinoma: DANTE, a randomized, open-label phase II trial of the German Gastric Group of the AIO and the SAKK.
Presenter: Salah-Eddin Al-Batran
Session: Poster Display session 2
Resources:
Abstract