Abstract 4787
Background
Comparison of options from clinical decision-support (CDS) systems and decisions made in practice may be biased towards the treating institution. In this retrospective study, bias was minimized by blinding evaluators to the source of treatment recommendations, either Watson for Oncology® (WFO®) or treatments patients received at Bumrungrad International Hospital (BIH), a user of WFO®.
Methods
Treatments given were compared to therapeutic options provided by WFO®. Treatments that were identical to WFO® “recommended” (green, acceptable) were not evaluated further. Paired treatments were evaluated independently in a blinded fashion by each oncologist before consensus ranking of each pair as either acceptable, acceptable alternatives, or unacceptable treatment. The consensus for each treatment was compared to WFO®, with WFO® “for consideration” (yellow, acceptable alternative), and “not recommended” (red, unacceptable). Chi-squared tests analyzed the association between risk factors and discordant recommendations.
Results
Of 228 treatments given to patients with lung, colon, breast and rectal cancers, 174 were identical to WFO® acceptable (green) and not evaluated further; 54 non-identical pairs were evaluated (Table). Overall, 88.6% of decisions were either the same or viewed as equally acceptable by oncologists; oncologists preferred 3.9% of BIH treatments and 4.4% of WFO treatments. In cases where reasons for discordance were provided, 70% were due to BIH oncologist preference, 20% to patient preference and 10% to WFO treatment availability. We found no association between discordant recommendations and patient age or stage of cancer.Table: 1435P
Treatments | N (%) 228 Total |
---|---|
Treatments are identical | 174 (76.3%) |
Oncologists’ Evaluations | |
Acceptable alternatives | 28 (12.3%) |
BIH Preferred | 9 (3.9%) |
WFO Preferred | 10 (4.4%) |
Both WFO and BIH-Rx unacceptable | 7 (3.1%) |
Conclusions
This blinded study suggests WFO®’s therapeutic options are at as least as good as (or are an acceptable alternative to) treatments in practice. Blinding evaluators to source of treatment may minimize bias in comparisons of CDS systems and decisions made in practice.
Clinical trial identification
Editorial acknowledgement
Legal entity responsible for the study
Bumrungrad International Hospital.
Funding
Bumrungrad International Hospital.
Disclosure
All authors have declared no conflicts of interest.
Resources from the same session
4600 - Patterns and outcomes related to rapid progressive disease in a cohort of advanced solid tumors treated with immune checkpoint inhibitors (ICIs).
Presenter: Lucio Ghiglione
Session: Poster Display session 3
Resources:
Abstract
3547 - Real World Outcomes of Immune-Related Adverse Events (irAEs) among Patients Receiving Immune Checkpoint Inhibitors (ICIs) in Hospital Settings
Presenter: Saby George
Session: Poster Display session 3
Resources:
Abstract
1124 - Sex-based heterogeneity of efficacy of anticancer immunotherapy
Presenter: Fabio Conforti
Session: Poster Display session 3
Resources:
Abstract
4133 - Comparative efficacy and safety of PD-1/PD-L1 inhibitors for patients with solid tumors: a systematic review and Bayesian network meta-analysis
Presenter: Qingyuan Huang
Session: Poster Display session 3
Resources:
Abstract
2548 - Excess weight and efficacy of anti-PD-1 antibodies in advanced cancer patients
Presenter: Jacobo Rogado
Session: Poster Display session 3
Resources:
Abstract
2228 - Safety and efficacy of anti-PD-1 inhibitor ABBV-181 in lung and head and neck carcinoma
Presenter: Antoine Italiano
Session: Poster Display session 3
Resources:
Abstract
2333 - Efficacy and safety of immune checkpoint inhibitors (ICIs) for treatment of advanced solid tumours in octogenarian patients
Presenter: Soraya Mebarki
Session: Poster Display session 3
Resources:
Abstract
4847 - Association of programmed cell death 1 (PD-1) inhibitor therapy with overall survival (OS) in stage IV melanoma treated with targeted therapies
Presenter: Aracelis Torres
Session: Poster Display session 3
Resources:
Abstract
2215 - Clinical outcomes of immune checkpoint inhibitors in older and younger patients with advanced solid tumours in a real-life setting
Presenter: Pauline Corbaux
Session: Poster Display session 3
Resources:
Abstract
2881 - Impact of corticosteroids and antibiotics on efficacy of immune-checkpoint inhibitors in advanced non-small cell lung cancer
Presenter: Joaquin Mosquera Martinez
Session: Poster Display session 3
Resources:
Abstract