Abstract 4787
Background
Comparison of options from clinical decision-support (CDS) systems and decisions made in practice may be biased towards the treating institution. In this retrospective study, bias was minimized by blinding evaluators to the source of treatment recommendations, either Watson for Oncology® (WFO®) or treatments patients received at Bumrungrad International Hospital (BIH), a user of WFO®.
Methods
Treatments given were compared to therapeutic options provided by WFO®. Treatments that were identical to WFO® “recommended” (green, acceptable) were not evaluated further. Paired treatments were evaluated independently in a blinded fashion by each oncologist before consensus ranking of each pair as either acceptable, acceptable alternatives, or unacceptable treatment. The consensus for each treatment was compared to WFO®, with WFO® “for consideration” (yellow, acceptable alternative), and “not recommended” (red, unacceptable). Chi-squared tests analyzed the association between risk factors and discordant recommendations.
Results
Of 228 treatments given to patients with lung, colon, breast and rectal cancers, 174 were identical to WFO® acceptable (green) and not evaluated further; 54 non-identical pairs were evaluated (Table). Overall, 88.6% of decisions were either the same or viewed as equally acceptable by oncologists; oncologists preferred 3.9% of BIH treatments and 4.4% of WFO treatments. In cases where reasons for discordance were provided, 70% were due to BIH oncologist preference, 20% to patient preference and 10% to WFO treatment availability. We found no association between discordant recommendations and patient age or stage of cancer.Table: 1435P
Treatments | N (%) 228 Total |
---|---|
Treatments are identical | 174 (76.3%) |
Oncologists’ Evaluations | |
Acceptable alternatives | 28 (12.3%) |
BIH Preferred | 9 (3.9%) |
WFO Preferred | 10 (4.4%) |
Both WFO and BIH-Rx unacceptable | 7 (3.1%) |
Conclusions
This blinded study suggests WFO®’s therapeutic options are at as least as good as (or are an acceptable alternative to) treatments in practice. Blinding evaluators to source of treatment may minimize bias in comparisons of CDS systems and decisions made in practice.
Clinical trial identification
Editorial acknowledgement
Legal entity responsible for the study
Bumrungrad International Hospital.
Funding
Bumrungrad International Hospital.
Disclosure
All authors have declared no conflicts of interest.
Resources from the same session
4822 - Efficiacy of different nutritional intervention on nutritional status and quality of life for local advanced nasopharyngeal carcinoma patients: a prospective clinical trial
Presenter: Yuan-yuan Chen
Session: Poster Display session 3
Resources:
Abstract
2628 - Apatinib in treating patients with platinum-resistant or platinum-refractory recurrent or metastatic nasopharyngeal carcinoma
Presenter: Changjuan Tao
Session: Poster Display session 3
Resources:
Abstract
4887 - Impact of tumor site and adjuvant radiotherapy on survival of adenoid cystic carcinoma: a SEER database analysis
Presenter: Jason Tasoulas
Session: Poster Display session 3
Resources:
Abstract
2634 - Efficacy and safety of anlotinib for patients with recurrent and/or metastatic salivary gland carcinomas
Presenter: Wen Jiang
Session: Poster Display session 3
Resources:
Abstract
3568 - ACCURACY a phase (P) 2 trial of AL101, a pan-Notch inhibitor, in recurrent/metastatic (R/M) adenoid cystic carcinoma (ACC) patients (pts) with Notch activating mutations (Notch act mut): preliminary safety and efficacy data.
Presenter: Renata Ferrarotto
Session: Poster Display session 3
Resources:
Abstract
683 - Pathologic Staging Changes in Oral Cavity Squamous Cell Carcinoma—Stage Migration and Implications for Adjuvant Treatment
Presenter: Zain Husain
Session: Poster Display session 3
Resources:
Abstract
563 - Expression of immune response biomarkers in head and neck squamous cell carcinoma (HNSCC) in irradiated area
Presenter: Carole Pflumio
Session: Poster Display session 3
Resources:
Abstract
4030 - HLA-Ligandome analysis reveals target antigens of oropharyngeal squamous cell carcinoma
Presenter: Simon Laban
Session: Poster Display session 3
Resources:
Abstract
2979 - Topographical distribution of sentinel lymph nodes in early tongue squamous cell carcinomas
Presenter: Hiroyuki Goda
Session: Poster Display session 3
Resources:
Abstract
3517 - Role of follow-up (FU) FDG-PET/CT (FU-FDG-PET/CT) in patients with locoregionally advanced squamous cell carcinoma of the head and neck (LA-HNSCC) treated with chemotherapy and radiotherapy (RT), either concurrent (CRT) or sequential (ST).
Presenter: Bert Van Den Heuvel
Session: Poster Display session 3
Resources:
Abstract