Abstract 4787
Background
Comparison of options from clinical decision-support (CDS) systems and decisions made in practice may be biased towards the treating institution. In this retrospective study, bias was minimized by blinding evaluators to the source of treatment recommendations, either Watson for Oncology® (WFO®) or treatments patients received at Bumrungrad International Hospital (BIH), a user of WFO®.
Methods
Treatments given were compared to therapeutic options provided by WFO®. Treatments that were identical to WFO® “recommended” (green, acceptable) were not evaluated further. Paired treatments were evaluated independently in a blinded fashion by each oncologist before consensus ranking of each pair as either acceptable, acceptable alternatives, or unacceptable treatment. The consensus for each treatment was compared to WFO®, with WFO® “for consideration” (yellow, acceptable alternative), and “not recommended” (red, unacceptable). Chi-squared tests analyzed the association between risk factors and discordant recommendations.
Results
Of 228 treatments given to patients with lung, colon, breast and rectal cancers, 174 were identical to WFO® acceptable (green) and not evaluated further; 54 non-identical pairs were evaluated (Table). Overall, 88.6% of decisions were either the same or viewed as equally acceptable by oncologists; oncologists preferred 3.9% of BIH treatments and 4.4% of WFO treatments. In cases where reasons for discordance were provided, 70% were due to BIH oncologist preference, 20% to patient preference and 10% to WFO treatment availability. We found no association between discordant recommendations and patient age or stage of cancer.Table: 1435P
Treatments | N (%) 228 Total |
---|---|
Treatments are identical | 174 (76.3%) |
Oncologists’ Evaluations | |
Acceptable alternatives | 28 (12.3%) |
BIH Preferred | 9 (3.9%) |
WFO Preferred | 10 (4.4%) |
Both WFO and BIH-Rx unacceptable | 7 (3.1%) |
Conclusions
This blinded study suggests WFO®’s therapeutic options are at as least as good as (or are an acceptable alternative to) treatments in practice. Blinding evaluators to source of treatment may minimize bias in comparisons of CDS systems and decisions made in practice.
Clinical trial identification
Editorial acknowledgement
Legal entity responsible for the study
Bumrungrad International Hospital.
Funding
Bumrungrad International Hospital.
Disclosure
All authors have declared no conflicts of interest.
Resources from the same session
1242 - Monalizumab in combination with cetuximab in patients (pts) with recurrent or metastatic (R/M) head and neck cancer (SCCHN) previously treated or not with PD-(L)1 inhibitors (IO): 1-year survival data.
Presenter: Roger Cohen
Session: Poster Display session 3
Resources:
Abstract
4703 - Updated results of a phase II study evaluating accelerator-based boron neutron capture therapy (AB-BNCT) with borofalan(10B) (SPM-011) in recurrent squamous cell carcinoma (R-SCC-HN) and recurrent and locally advanced non-SCC (R/LA-nSCC-HN) of the head and neck
Presenter: Katsumi Hirose
Session: Poster Display session 3
Resources:
Abstract
3638 - Phase 3 KEYNOTE-048 Study of First-Line (1L) Pembrolizumab (P) for Recurrent/Metastatic (R/M) Head and Neck Squamous Cell Carcinoma (HNSCC): Asia vs Non-Asia Subgroup (subgrp) Analysis
Presenter: Makoto Tahara
Session: Poster Display session 3
Resources:
Abstract
2954 - Integrated data review evaluating safety, pharmacokinetics (PK) and immunogenicity of RM-1929 photoimmunotherapy (PIT) in subjects with locoregional, recurrent head and neck squamous cell carcinoma (rHNSCC).
Presenter: Jennifer Johnson
Session: Poster Display session 3
Resources:
Abstract
3629 - First line versus second line immunotherapy in recurrent/metastatic squamous cell carcinoma of the head and neck
Presenter: Caroline Even
Session: Poster Display session 3
Resources:
Abstract
767 - Sensitizing HRAS overexpressing head and neck squamous cell carcinoma (HNSCC) to chemotherapy
Presenter: Theodoros Rampias
Session: Poster Display session 3
Resources:
Abstract
4985 - A Single-Arm, Open-Label, Multicenter, Phase IIIb Clinical Trial with Nivolumab in Subjects with Recurrent or Metastatic Platinum-refractory Squamous Cell Carcinoma of the Head and Neck.
Presenter: Paolo Bossi
Session: Poster Display session 3
Resources:
Abstract
1564 - Long-term Results of Phase 2 Trial of Reduced Modified Clinical Target Volume in Low-risk Nasopharyngeal Carcinoma Treated with Intensity Modulated Radiotherapy
Presenter: Jingjing Miao
Session: Poster Display session 3
Resources:
Abstract
3356 - To compare two oral mucosa contouring methods in predicting acute oral mucocitis in nasopharyngeal carcinoma treated with helical tomotherapy
Presenter: Yuan-Yuan Chen
Session: Poster Display session 3
Resources:
Abstract
1984 - Induction chemotherapy (IC) followed by concurrent chemoradiotherapy (CCRT) in nasopharyngeal carcinoma (NPC)
Presenter: Gizem Kaval
Session: Poster Display session 3
Resources:
Abstract