Abstract 4787
Background
Comparison of options from clinical decision-support (CDS) systems and decisions made in practice may be biased towards the treating institution. In this retrospective study, bias was minimized by blinding evaluators to the source of treatment recommendations, either Watson for Oncology® (WFO®) or treatments patients received at Bumrungrad International Hospital (BIH), a user of WFO®.
Methods
Treatments given were compared to therapeutic options provided by WFO®. Treatments that were identical to WFO® “recommended” (green, acceptable) were not evaluated further. Paired treatments were evaluated independently in a blinded fashion by each oncologist before consensus ranking of each pair as either acceptable, acceptable alternatives, or unacceptable treatment. The consensus for each treatment was compared to WFO®, with WFO® “for consideration” (yellow, acceptable alternative), and “not recommended” (red, unacceptable). Chi-squared tests analyzed the association between risk factors and discordant recommendations.
Results
Of 228 treatments given to patients with lung, colon, breast and rectal cancers, 174 were identical to WFO® acceptable (green) and not evaluated further; 54 non-identical pairs were evaluated (Table). Overall, 88.6% of decisions were either the same or viewed as equally acceptable by oncologists; oncologists preferred 3.9% of BIH treatments and 4.4% of WFO treatments. In cases where reasons for discordance were provided, 70% were due to BIH oncologist preference, 20% to patient preference and 10% to WFO treatment availability. We found no association between discordant recommendations and patient age or stage of cancer.Table: 1435P
Treatments | N (%) 228 Total |
---|---|
Treatments are identical | 174 (76.3%) |
Oncologists’ Evaluations | |
Acceptable alternatives | 28 (12.3%) |
BIH Preferred | 9 (3.9%) |
WFO Preferred | 10 (4.4%) |
Both WFO and BIH-Rx unacceptable | 7 (3.1%) |
Conclusions
This blinded study suggests WFO®’s therapeutic options are at as least as good as (or are an acceptable alternative to) treatments in practice. Blinding evaluators to source of treatment may minimize bias in comparisons of CDS systems and decisions made in practice.
Clinical trial identification
Editorial acknowledgement
Legal entity responsible for the study
Bumrungrad International Hospital.
Funding
Bumrungrad International Hospital.
Disclosure
All authors have declared no conflicts of interest.
Resources from the same session
5368 - Durvalumab and Paclitaxel Combination for treatment of metastatic triple negative breast cancer is safe with very promising efficacy
Presenter: Hazem Ghebeh
Session: Poster Display session 3
Resources:
Abstract
1520 - A prospective cohort study on the pharmacokinetics of nivolumab in metastatic non-small cell lung cancer, melanoma, and renal cell cancer patients
Presenter: Daan Hurkmans
Session: Poster Display session 3
Resources:
Abstract
1603 - Safety and clinical activity of subcutaneously (SC) administered anti-PD-1 antibody PF-06801591 in phase I dose-expansion cohorts of locally advanced or metastatic non-small-cell lung cancer (NSCLC) and urothelial carcinoma (UC)
Presenter: Byoung Cho
Session: Poster Display session 3
Resources:
Abstract
3922 - Development of the Functional Assessment of Cancer Therapy-Immune Checkpoint Modulator (FACT-ICM): A scale to measure quality of life in cancer patients treated with ICMs
Presenter: Aaron Hansen
Session: Poster Display session 3
Resources:
Abstract
2408 - Immune checkpoint inhibitors (ICIs) as “chemotherapy (Ctx) sensitization” strategy in advanced solid tumors
Presenter: Francisco Javier Ros Montana
Session: Poster Display session 3
Resources:
Abstract
3612 - Validation of progression-free survival (PFS) as surrogate endpoint in randomised trials of immune checkpoint inhibitors in advanced solid cancers
Presenter: Peey Sei Kok
Session: Poster Display session 3
Resources:
Abstract
3827 - Pharmacokinetic (PK) analysis of weight-based and fixed dose cemiplimab in patients (pts) with advanced malignancies
Presenter: Michael Migden
Session: Poster Display session 3
Resources:
Abstract
2120 - A burst of highly differentiated CD4 TL identifies a subset of fast progressors, and correlates with hyperprogressive disease in NSCLC patients treated with ICI
Presenter: Hugo Arasanz
Session: Poster Display session 3
Resources:
Abstract
4254 - Nivolumab treatment in advanced non-small cell lung cancer (aNSCLC): a French nationwide retrospective cohort (UNIVOC Study)
Presenter: Christos Chouaid
Session: Poster Display session 3
Resources:
Abstract
1084 - Dissociated responses in patients with metastatic solid tumors treated with immunotherapy
Presenter: Pauline Vaflard
Session: Poster Display session 3
Resources:
Abstract