Abstract 4787
Background
Comparison of options from clinical decision-support (CDS) systems and decisions made in practice may be biased towards the treating institution. In this retrospective study, bias was minimized by blinding evaluators to the source of treatment recommendations, either Watson for Oncology® (WFO®) or treatments patients received at Bumrungrad International Hospital (BIH), a user of WFO®.
Methods
Treatments given were compared to therapeutic options provided by WFO®. Treatments that were identical to WFO® “recommended” (green, acceptable) were not evaluated further. Paired treatments were evaluated independently in a blinded fashion by each oncologist before consensus ranking of each pair as either acceptable, acceptable alternatives, or unacceptable treatment. The consensus for each treatment was compared to WFO®, with WFO® “for consideration” (yellow, acceptable alternative), and “not recommended” (red, unacceptable). Chi-squared tests analyzed the association between risk factors and discordant recommendations.
Results
Of 228 treatments given to patients with lung, colon, breast and rectal cancers, 174 were identical to WFO® acceptable (green) and not evaluated further; 54 non-identical pairs were evaluated (Table). Overall, 88.6% of decisions were either the same or viewed as equally acceptable by oncologists; oncologists preferred 3.9% of BIH treatments and 4.4% of WFO treatments. In cases where reasons for discordance were provided, 70% were due to BIH oncologist preference, 20% to patient preference and 10% to WFO treatment availability. We found no association between discordant recommendations and patient age or stage of cancer.Table: 1435P
Treatments | N (%) 228 Total |
---|---|
Treatments are identical | 174 (76.3%) |
Oncologists’ Evaluations | |
Acceptable alternatives | 28 (12.3%) |
BIH Preferred | 9 (3.9%) |
WFO Preferred | 10 (4.4%) |
Both WFO and BIH-Rx unacceptable | 7 (3.1%) |
Conclusions
This blinded study suggests WFO®’s therapeutic options are at as least as good as (or are an acceptable alternative to) treatments in practice. Blinding evaluators to source of treatment may minimize bias in comparisons of CDS systems and decisions made in practice.
Clinical trial identification
Editorial acknowledgement
Legal entity responsible for the study
Bumrungrad International Hospital.
Funding
Bumrungrad International Hospital.
Disclosure
All authors have declared no conflicts of interest.
Resources from the same session
3611 - Phase II trial of SM 88 in Non-Metastatic Biochemical Recurrent Prostate Cancer.
Presenter: Benjamin Gartrell
Session: Poster Display session 3
Resources:
Abstract
2492 - A phase 1 study of Ad5 PSA/MUC-1/Brachyury Vaccine in Patients with Metastatic Castration Resistant Prostate Cancer (mCRPC)
Presenter: Marijo Bilusic
Session: Poster Display session 3
Resources:
Abstract
3142 - Multicenter Phase I Trial of a DNA Vaccine Encoding the Androgen Receptor Ligand Binding Domain (pTVG-AR, MVI-118) in Patients with Metastatic Prostate Cancer
Presenter: Douglas McNeel
Session: Poster Display session 3
Resources:
Abstract
4327 - Impact of germline mutations in Homologous Recombination (HR) genes on the response to Radium-223 for metastatic castration resistant prostate cancer (mCRPC)
Presenter: Elena Castro
Session: Poster Display session 3
Resources:
Abstract
3600 - Serum biomarkers of bone metabolism in metastatic castration-resistant prostate cancer (mCRPC) patients (pts) treated with Radium-223 (Ra223): Results from a prospective multicentre study
Presenter: Nuria Romero Laorden
Session: Poster Display session 3
Resources:
Abstract
3742 - Prognostic value of tumor suppression genes (TP53, PTEN, Rb) in metastatic hormone sensitive prostate cancer
Presenter: Miguel Gonzalez Velez
Session: Poster Display session 3
Resources:
Abstract
2643 - Germline sequencing of advanced prostate cancer patients in the BARCODE2 trial
Presenter: Sarah Benafif
Session: Poster Display session 3
Resources:
Abstract
4349 - Impact of treatment sequence in patients (pts) with metastatic castration-resistant prostate cancer (mCRPC): data from the prospective PROREPAIR-B study.
Presenter: Carlo Cattrini
Session: Poster Display session 3
Resources:
Abstract
3301 - Implications of Single Nucleotide Polymorphisms (SNPs) in Androgen Related-Genes in Outcome of metastatic castration-resistant prostate cancer (mCRPC) patients treated with Abiraterone (Abi) and Enzalutamide (Enza)
Presenter: Isabel Aragon
Session: Poster Display session 3
Resources:
Abstract
2275 - Activating mutations in AKT1/PIK3CA are associated with poor clinical outcomes in metastatic prostate cancer (mPC)
Presenter: Simon Fu
Session: Poster Display session 3
Resources:
Abstract