Abstract 4787
Background
Comparison of options from clinical decision-support (CDS) systems and decisions made in practice may be biased towards the treating institution. In this retrospective study, bias was minimized by blinding evaluators to the source of treatment recommendations, either Watson for Oncology® (WFO®) or treatments patients received at Bumrungrad International Hospital (BIH), a user of WFO®.
Methods
Treatments given were compared to therapeutic options provided by WFO®. Treatments that were identical to WFO® “recommended” (green, acceptable) were not evaluated further. Paired treatments were evaluated independently in a blinded fashion by each oncologist before consensus ranking of each pair as either acceptable, acceptable alternatives, or unacceptable treatment. The consensus for each treatment was compared to WFO®, with WFO® “for consideration” (yellow, acceptable alternative), and “not recommended” (red, unacceptable). Chi-squared tests analyzed the association between risk factors and discordant recommendations.
Results
Of 228 treatments given to patients with lung, colon, breast and rectal cancers, 174 were identical to WFO® acceptable (green) and not evaluated further; 54 non-identical pairs were evaluated (Table). Overall, 88.6% of decisions were either the same or viewed as equally acceptable by oncologists; oncologists preferred 3.9% of BIH treatments and 4.4% of WFO treatments. In cases where reasons for discordance were provided, 70% were due to BIH oncologist preference, 20% to patient preference and 10% to WFO treatment availability. We found no association between discordant recommendations and patient age or stage of cancer.Table: 1435P
Treatments | N (%) 228 Total |
---|---|
Treatments are identical | 174 (76.3%) |
Oncologists’ Evaluations | |
Acceptable alternatives | 28 (12.3%) |
BIH Preferred | 9 (3.9%) |
WFO Preferred | 10 (4.4%) |
Both WFO and BIH-Rx unacceptable | 7 (3.1%) |
Conclusions
This blinded study suggests WFO®’s therapeutic options are at as least as good as (or are an acceptable alternative to) treatments in practice. Blinding evaluators to source of treatment may minimize bias in comparisons of CDS systems and decisions made in practice.
Clinical trial identification
Editorial acknowledgement
Legal entity responsible for the study
Bumrungrad International Hospital.
Funding
Bumrungrad International Hospital.
Disclosure
All authors have declared no conflicts of interest.
Resources from the same session
5705 - External validation and longitudinal extension of the LIPI (Lung Immune Prognostic Index) for immunotherapy outcomes in advanced non-small cell lung cancer.
Presenter: Jakob Riedl
Session: Poster Display session 3
Resources:
Abstract
5758 - Changes of TCR Repertoire in Metastatic Renal Cell Carcinoma and Metastatic Melanoma Patients Treated with Nivolumab
Presenter: Martin Klabusay
Session: Poster Display session 3
Resources:
Abstract
1743 - Expression of MHC class I, HLA-A and HLA-B identifies immune activated breast tumors with favorable outcome
Presenter: María Del Mar Noblejas López
Session: Poster Display session 3
Resources:
Abstract
2219 - Prognostic Significance of Tumor Tissue NeuGcGM3 Ganglioside Expression and Predictive Value of Circulating Tumor Cell Count Monitoring in Patients Receiving Racotumomab Immunotherapy
Presenter: Necdet Üskent
Session: Poster Display session 3
Resources:
Abstract
2996 - Evolution of Myeloid-Derived Suppressor Cells and Objective Response Rate in Relapsed/Refractory Diffuse Large B Cell Lymphoma (R/R DLBCL) patients after receiving immunotherapy
Presenter: Carlos Jiménez Cortegana
Session: Poster Display session 3
Resources:
Abstract
2110 - A Phase Ia/Ib trial of the anti-programmed death-ligand 1 (PD-L1) human monoclonal antibody (mAb), CS1001, in patients (pts) with advanced solid tumors or lymphomas
Presenter: Lin Shen
Session: Poster Display session 3
Resources:
Abstract
3515 - Results from a randomised Phase 1/2 trial evaluating the safety and antitumour activity of anti-PD-1 (MEDI0680)/anti-PD-L1 (durvalumab) vs anti-PD-1 (nivolumab) alone in metastatic clear cell renal cell carcinoma (ccRCC)
Presenter: Martin Voss
Session: Poster Display session 3
Resources:
Abstract
3566 - Pembrolizumab in Advanced Rare Cancers
Presenter: Aung Naing
Session: Poster Display session 3
Resources:
Abstract
3567 - High clinical benefit rates of pembrolizumab in very rare sarcoma histotypes: first results of the AcSé Pembrolizumab study
Presenter: Jean-Yves Blay
Session: Poster Display session 3
Resources:
Abstract
2421 - Lenvatinib plus PD-1 blockade in advanced bile tract carcinoma.
Presenter: Jianzhen Lin
Session: Poster Display session 3
Resources:
Abstract