Abstract 4787
Background
Comparison of options from clinical decision-support (CDS) systems and decisions made in practice may be biased towards the treating institution. In this retrospective study, bias was minimized by blinding evaluators to the source of treatment recommendations, either Watson for Oncology® (WFO®) or treatments patients received at Bumrungrad International Hospital (BIH), a user of WFO®.
Methods
Treatments given were compared to therapeutic options provided by WFO®. Treatments that were identical to WFO® “recommended” (green, acceptable) were not evaluated further. Paired treatments were evaluated independently in a blinded fashion by each oncologist before consensus ranking of each pair as either acceptable, acceptable alternatives, or unacceptable treatment. The consensus for each treatment was compared to WFO®, with WFO® “for consideration” (yellow, acceptable alternative), and “not recommended” (red, unacceptable). Chi-squared tests analyzed the association between risk factors and discordant recommendations.
Results
Of 228 treatments given to patients with lung, colon, breast and rectal cancers, 174 were identical to WFO® acceptable (green) and not evaluated further; 54 non-identical pairs were evaluated (Table). Overall, 88.6% of decisions were either the same or viewed as equally acceptable by oncologists; oncologists preferred 3.9% of BIH treatments and 4.4% of WFO treatments. In cases where reasons for discordance were provided, 70% were due to BIH oncologist preference, 20% to patient preference and 10% to WFO treatment availability. We found no association between discordant recommendations and patient age or stage of cancer.Table: 1435P
Treatments | N (%) 228 Total |
---|---|
Treatments are identical | 174 (76.3%) |
Oncologists’ Evaluations | |
Acceptable alternatives | 28 (12.3%) |
BIH Preferred | 9 (3.9%) |
WFO Preferred | 10 (4.4%) |
Both WFO and BIH-Rx unacceptable | 7 (3.1%) |
Conclusions
This blinded study suggests WFO®’s therapeutic options are at as least as good as (or are an acceptable alternative to) treatments in practice. Blinding evaluators to source of treatment may minimize bias in comparisons of CDS systems and decisions made in practice.
Clinical trial identification
Editorial acknowledgement
Legal entity responsible for the study
Bumrungrad International Hospital.
Funding
Bumrungrad International Hospital.
Disclosure
All authors have declared no conflicts of interest.
Resources from the same session
5056 - Phase 2 study of 2 dosing regimens of cemiplimab, a human monoclonal anti–PD-1, in metastatic cutaneous squamous cell carcinoma (mCSCC)
Presenter: Danny Rischin
Session: Poster Display session 3
Resources:
Abstract
5710 - Avelumab for advanced Merkel cell carcinoma in the Netherlands; a nationwide survey
Presenter: Sonja Levy
Session: Poster Display session 3
Resources:
Abstract
3152 - Health-related quality of life in patients with metastatic Merkel cell carcinoma receiving second-line or later avelumab treatment: 36-month follow-up data
Presenter: Sandra D'Angelo
Session: Poster Display session 3
Resources:
Abstract
5715 - A Phase 2, Randomized Study of Nivolumab (NIVO) and Ipilimumab (IPI) versus NIVO, IPI and Stereotactic Body Radiation Therapy (SBRT) for Metastatic Merkel Cell Carcinoma (MCC, NCT03071406) – a preliminary report.
Presenter: Sungjune Kim
Session: Poster Display session 3
Resources:
Abstract
2854 - Real-world impact of immune checkpoint inhibitors in metastatic uveal melanoma
Presenter: Kalijn Bol
Session: Poster Display session 3
Resources:
Abstract
2928 - Immune checkpoint inhibitors in a cohort of 206 metastatic uveal melanomas patients
Presenter: Mathilde Saint-Ghislain
Session: Poster Display session 3
Resources:
Abstract
1235 - Incidence and survival of Uveal Melanoma occurring as single cancer versus its occurrence as a first or second primary neoplasm
Presenter: Ahmad Alfaar
Session: Poster Display session 3
Resources:
Abstract
3615 - Validation of a Clinicopathological and Gene Expression Profile (CP-GEP) Model for Sentinel Lymph Node Metastasis in Primary Cutaneous Melanoma
Presenter: Evalyn Mulder
Session: Poster Display session 3
Resources:
Abstract
1793 - External validation of the 8th Edition Melanoma Staging System of the American Joint Committee on Cancer (AJCC) using the Surveillance, Epidemiology and End Results (SEER) Program
Presenter: Angelina Tjokrowidjaja
Session: Poster Display session 3
Resources:
Abstract
4278 - Clinical factors and overall survival (OS) associated with patterns of metastases (mets) in melanoma patients (pts).
Presenter: Ines Pires da Silva
Session: Poster Display session 3
Resources:
Abstract