Abstract 4787
Background
Comparison of options from clinical decision-support (CDS) systems and decisions made in practice may be biased towards the treating institution. In this retrospective study, bias was minimized by blinding evaluators to the source of treatment recommendations, either Watson for Oncology® (WFO®) or treatments patients received at Bumrungrad International Hospital (BIH), a user of WFO®.
Methods
Treatments given were compared to therapeutic options provided by WFO®. Treatments that were identical to WFO® “recommended” (green, acceptable) were not evaluated further. Paired treatments were evaluated independently in a blinded fashion by each oncologist before consensus ranking of each pair as either acceptable, acceptable alternatives, or unacceptable treatment. The consensus for each treatment was compared to WFO®, with WFO® “for consideration” (yellow, acceptable alternative), and “not recommended” (red, unacceptable). Chi-squared tests analyzed the association between risk factors and discordant recommendations.
Results
Of 228 treatments given to patients with lung, colon, breast and rectal cancers, 174 were identical to WFO® acceptable (green) and not evaluated further; 54 non-identical pairs were evaluated (Table). Overall, 88.6% of decisions were either the same or viewed as equally acceptable by oncologists; oncologists preferred 3.9% of BIH treatments and 4.4% of WFO treatments. In cases where reasons for discordance were provided, 70% were due to BIH oncologist preference, 20% to patient preference and 10% to WFO treatment availability. We found no association between discordant recommendations and patient age or stage of cancer.Table: 1435P
Treatments | N (%) 228 Total |
---|---|
Treatments are identical | 174 (76.3%) |
Oncologists’ Evaluations | |
Acceptable alternatives | 28 (12.3%) |
BIH Preferred | 9 (3.9%) |
WFO Preferred | 10 (4.4%) |
Both WFO and BIH-Rx unacceptable | 7 (3.1%) |
Conclusions
This blinded study suggests WFO®’s therapeutic options are at as least as good as (or are an acceptable alternative to) treatments in practice. Blinding evaluators to source of treatment may minimize bias in comparisons of CDS systems and decisions made in practice.
Clinical trial identification
Editorial acknowledgement
Legal entity responsible for the study
Bumrungrad International Hospital.
Funding
Bumrungrad International Hospital.
Disclosure
All authors have declared no conflicts of interest.
Resources from the same session
3524 - Cabazitaxel For Octogenarian Patients With Metastatic Castration-Resistant Prostate Cancer (MCRPC).
Presenter: Paolo Tralongo
Session: Poster Display session 3
Resources:
Abstract
5637 - External Validation of a Prognostic Score in First-Line Metastastic Castration-Resistant Prostate Cancer (mCRPC)
Presenter: David Lorente
Session: Poster Display session 3
Resources:
Abstract
3228 - Treatment outcomes of 3rd treatment in a real-world metastatic castration resistant prostate cancer (mCRPC) population: results from the Dutch CAPRI-registry
Presenter: Jessica Notohardjo
Session: Poster Display session 3
Resources:
Abstract
4695 - Pelvic lymph node dissection and its extent on survival benefit in prostate cancer patients with a risk of lymph node invasion>5%: a propensity score matching analysis from SEER database
Presenter: Junru Chen
Session: Poster Display session 3
Resources:
Abstract
4438 - Multi-institutional evaluation of therapeutic management for oligometastatic cancer prostate recurrence with choline-PET/CT
Presenter: Morgane Guibert-broudic
Session: Poster Display session 3
Resources:
Abstract
4574 - Safety of new androgen receptor inhibitors (ARi) in patients with nonmetastatic castration-resistant prostate cancer (nmCRPC): a network meta-analysis of randomized controlled trials (RCT)
Presenter: Amelia Altavilla
Session: Poster Display session 3
Resources:
Abstract
3816 - Real-world use of radium-223 for treatment of metastatic castration resistant-prostate cancer (mCRPC): results from the Dutch CAPRI registry
Presenter: Malou Kuppen
Session: Poster Display session 3
Resources:
Abstract
5180 - A phase 2a study of radium-223 dichloride (Ra-223) alone or in combination with abiraterone acetate or enzalutamide in metastatic castration-resistant prostate cancer (mCRPC)
Presenter: Daniel Petrylak
Session: Poster Display session 3
Resources:
Abstract
1067 - Adding ADT to PSMA-PET/CT-guided SBRT for oligometastatic prostate cancer improves distant progression-free survival
Presenter: Carole Mercier
Session: Poster Display session 3
Resources:
Abstract
5529 - Safety and efficacy of Ac-225-PSMA-617 in metastatic castration resistant prostate cancer (mCRPC) after failure of Lu-177-PSMA
Presenter: Robert Tauber
Session: Poster Display session 3
Resources:
Abstract