Abstract 4787
Background
Comparison of options from clinical decision-support (CDS) systems and decisions made in practice may be biased towards the treating institution. In this retrospective study, bias was minimized by blinding evaluators to the source of treatment recommendations, either Watson for Oncology® (WFO®) or treatments patients received at Bumrungrad International Hospital (BIH), a user of WFO®.
Methods
Treatments given were compared to therapeutic options provided by WFO®. Treatments that were identical to WFO® “recommended” (green, acceptable) were not evaluated further. Paired treatments were evaluated independently in a blinded fashion by each oncologist before consensus ranking of each pair as either acceptable, acceptable alternatives, or unacceptable treatment. The consensus for each treatment was compared to WFO®, with WFO® “for consideration” (yellow, acceptable alternative), and “not recommended” (red, unacceptable). Chi-squared tests analyzed the association between risk factors and discordant recommendations.
Results
Of 228 treatments given to patients with lung, colon, breast and rectal cancers, 174 were identical to WFO® acceptable (green) and not evaluated further; 54 non-identical pairs were evaluated (Table). Overall, 88.6% of decisions were either the same or viewed as equally acceptable by oncologists; oncologists preferred 3.9% of BIH treatments and 4.4% of WFO treatments. In cases where reasons for discordance were provided, 70% were due to BIH oncologist preference, 20% to patient preference and 10% to WFO treatment availability. We found no association between discordant recommendations and patient age or stage of cancer.Table: 1435P
Treatments | N (%) 228 Total |
---|---|
Treatments are identical | 174 (76.3%) |
Oncologists’ Evaluations | |
Acceptable alternatives | 28 (12.3%) |
BIH Preferred | 9 (3.9%) |
WFO Preferred | 10 (4.4%) |
Both WFO and BIH-Rx unacceptable | 7 (3.1%) |
Conclusions
This blinded study suggests WFO®’s therapeutic options are at as least as good as (or are an acceptable alternative to) treatments in practice. Blinding evaluators to source of treatment may minimize bias in comparisons of CDS systems and decisions made in practice.
Clinical trial identification
Editorial acknowledgement
Legal entity responsible for the study
Bumrungrad International Hospital.
Funding
Bumrungrad International Hospital.
Disclosure
All authors have declared no conflicts of interest.
Resources from the same session
5877 - Efficacy of anti-PD(L)1 treatment in patients with metastatic urothelial cancer based on mRNA- and protein- based PD-L1 determination: Results from the multicentric, retrospective FOsMIC trial
Presenter: Jonas Jarczyk
Session: Poster Display session 3
Resources:
Abstract
5204 - A differential bladder microbiota composition is associated with tumor grade in bladder cancer.
Presenter: Monica Parra-Grande
Session: Poster Display session 3
Resources:
Abstract
4904 - Molecular characterization of metastatic urothelial carcinoma (mUC) in prior or current smokers (PCS) vs non-smokers (NS)
Presenter: Victor Sacristan Santos
Session: Poster Display session 3
Resources:
Abstract
5370 - Evaluation of different diagnostic methods for identification of FGFR alteration in advanced urothelial carcinomas: Proficiency Results based on multiple RNA extraction kits and mutation detection methods
Presenter: Veronika Weyerer
Session: Poster Display session 3
Resources:
Abstract
2579 - Title: Genomic characterization of non-schistosomiasis-related squamous cell carcinoma (NSR-SCC) of the urinary bladder: a retrospective study of potential prognostic and predictive biomarkers
Presenter: Esmail Al-ezzi
Session: Poster Display session 3
Resources:
Abstract
2203 - TiNivo: Tivozanib combined with nivolumab results in prolonged progression free survival in patients with metastatic renal cell carcinoma (mRCC). Final Results.
Presenter: Philippe Barthelemy
Session: Poster Display session 3
Resources:
Abstract
4712 - First-Line Pembrolizumab (pembro) Monotherapy for Advanced Non‒Clear Cell Renal Cell Carcinoma (nccRCC): Updated Follow-Up for KEYNOTE-427 Cohort B
Presenter: Cristina Suárez
Session: Poster Display session 3
Resources:
Abstract
2091 - First-Line Pembrolizumab (pembro) Monotherapy in Advanced Clear Cell Renal Cell Carcinoma (ccRCC): Updated Follow-Up For KEYNOTE-427 Cohort A
Presenter: James Larkin
Session: Poster Display session 3
Resources:
Abstract
2368 - Association Between Depth of Response and Overall Survival: Exploratory Analysis in Patients With Previously Untreated Advanced Renal Cell Carcinoma (aRCC) in CheckMate 214
Presenter: Viktor Grünwald
Session: Poster Display session 3
Resources:
Abstract
6008 - Quality of life in previously untreated patients with advanced renal cell carcinoma (aRCC) in CheckMate 214: updated results
Presenter: David Cella
Session: Poster Display session 3
Resources:
Abstract