Abstract 4787
Background
Comparison of options from clinical decision-support (CDS) systems and decisions made in practice may be biased towards the treating institution. In this retrospective study, bias was minimized by blinding evaluators to the source of treatment recommendations, either Watson for Oncology® (WFO®) or treatments patients received at Bumrungrad International Hospital (BIH), a user of WFO®.
Methods
Treatments given were compared to therapeutic options provided by WFO®. Treatments that were identical to WFO® “recommended” (green, acceptable) were not evaluated further. Paired treatments were evaluated independently in a blinded fashion by each oncologist before consensus ranking of each pair as either acceptable, acceptable alternatives, or unacceptable treatment. The consensus for each treatment was compared to WFO®, with WFO® “for consideration” (yellow, acceptable alternative), and “not recommended” (red, unacceptable). Chi-squared tests analyzed the association between risk factors and discordant recommendations.
Results
Of 228 treatments given to patients with lung, colon, breast and rectal cancers, 174 were identical to WFO® acceptable (green) and not evaluated further; 54 non-identical pairs were evaluated (Table). Overall, 88.6% of decisions were either the same or viewed as equally acceptable by oncologists; oncologists preferred 3.9% of BIH treatments and 4.4% of WFO treatments. In cases where reasons for discordance were provided, 70% were due to BIH oncologist preference, 20% to patient preference and 10% to WFO treatment availability. We found no association between discordant recommendations and patient age or stage of cancer.Table: 1435P
Treatments | N (%) 228 Total |
---|---|
Treatments are identical | 174 (76.3%) |
Oncologists’ Evaluations | |
Acceptable alternatives | 28 (12.3%) |
BIH Preferred | 9 (3.9%) |
WFO Preferred | 10 (4.4%) |
Both WFO and BIH-Rx unacceptable | 7 (3.1%) |
Conclusions
This blinded study suggests WFO®’s therapeutic options are at as least as good as (or are an acceptable alternative to) treatments in practice. Blinding evaluators to source of treatment may minimize bias in comparisons of CDS systems and decisions made in practice.
Clinical trial identification
Editorial acknowledgement
Legal entity responsible for the study
Bumrungrad International Hospital.
Funding
Bumrungrad International Hospital.
Disclosure
All authors have declared no conflicts of interest.
Resources from the same session
2888 - Development and validation a nomogram based on pathological microscopic features to predict survival in nasopharyngeal carcinoma and guide treatment decision
Presenter: Kuiyuan Liu
Session: Poster Display session 3
Resources:
Abstract
3607 - Deep learning in nasopharyngeal carcinoma: a retrospective cohort study of 3D convolutional neural networks on magnetic resonance imaging
Presenter: Meng Yun Qiang
Session: Poster Display session 3
Resources:
Abstract
5848 - Combined androgen blockade in patients with advanced androgen receptor–positive salivary gland carcinoma: Exploratory biomarker analyses
Presenter: Chihiro Fushimi
Session: Poster Display session 3
Resources:
Abstract
4484 - Classification of esthesioneuroblastoma (ENB) based on chromosome (chr) arm gain and loss (CNA) in the setting of a hypomutated genomic landscape
Presenter: Russell Madison
Session: Poster Display session 3
Resources:
Abstract
5753 - Trastuzumab plus docetaxel in patients with advanced HER2–positive salivary duct carcinoma: Exploratory biomarker analyses
Presenter: Hideaki Takahashi
Session: Poster Display session 3
Resources:
Abstract
3373 - Development and characterization of salivary gland cancer organoid cultures
Presenter: Wim Boxtel
Session: Poster Display session 3
Resources:
Abstract
3118 - A parent-of-origin effect of the RB1 mutations in retinoblastoma with low penetrance and variable expressivity
Presenter: Ekaterina Alekseeva
Session: Poster Display session 3
Resources:
Abstract
4512 - The humanistic burden reported by patients diagnosed with Recurrent/Metastatic Squamous Cell Carcinoma of the Head and Neck (R/M SCCHN) in Europe
Presenter: Prianka Singh
Session: Poster Display session 3
Resources:
Abstract
3961 - Concurrent Chemotherapy and External Radiation Therapy: An Open Label Non-Inferiority Phase III Randomized Controlled Trial of Weekly versus Three Weekly Cisplatin and Radical Radiotherapy in Locally Advanced Head and Neck Squamous Cell Carcinoma: CONCERT trial
Presenter: ATUL SHARMA
Session: Poster Display session 3
Resources:
Abstract
3973 - A randomized phase II study on the OPTimization of IMmunotherapy in squamous carcinoma of the head and neck (SCCHN) – OPTIM (AIO-KHT-0117)
Presenter: Viktor Grünwald
Session: Poster Display session 3
Resources:
Abstract