Abstract 4787
Background
Comparison of options from clinical decision-support (CDS) systems and decisions made in practice may be biased towards the treating institution. In this retrospective study, bias was minimized by blinding evaluators to the source of treatment recommendations, either Watson for Oncology® (WFO®) or treatments patients received at Bumrungrad International Hospital (BIH), a user of WFO®.
Methods
Treatments given were compared to therapeutic options provided by WFO®. Treatments that were identical to WFO® “recommended” (green, acceptable) were not evaluated further. Paired treatments were evaluated independently in a blinded fashion by each oncologist before consensus ranking of each pair as either acceptable, acceptable alternatives, or unacceptable treatment. The consensus for each treatment was compared to WFO®, with WFO® “for consideration” (yellow, acceptable alternative), and “not recommended” (red, unacceptable). Chi-squared tests analyzed the association between risk factors and discordant recommendations.
Results
Of 228 treatments given to patients with lung, colon, breast and rectal cancers, 174 were identical to WFO® acceptable (green) and not evaluated further; 54 non-identical pairs were evaluated (Table). Overall, 88.6% of decisions were either the same or viewed as equally acceptable by oncologists; oncologists preferred 3.9% of BIH treatments and 4.4% of WFO treatments. In cases where reasons for discordance were provided, 70% were due to BIH oncologist preference, 20% to patient preference and 10% to WFO treatment availability. We found no association between discordant recommendations and patient age or stage of cancer.Table: 1435P
Treatments | N (%) 228 Total |
---|---|
Treatments are identical | 174 (76.3%) |
Oncologists’ Evaluations | |
Acceptable alternatives | 28 (12.3%) |
BIH Preferred | 9 (3.9%) |
WFO Preferred | 10 (4.4%) |
Both WFO and BIH-Rx unacceptable | 7 (3.1%) |
Conclusions
This blinded study suggests WFO®’s therapeutic options are at as least as good as (or are an acceptable alternative to) treatments in practice. Blinding evaluators to source of treatment may minimize bias in comparisons of CDS systems and decisions made in practice.
Clinical trial identification
Editorial acknowledgement
Legal entity responsible for the study
Bumrungrad International Hospital.
Funding
Bumrungrad International Hospital.
Disclosure
All authors have declared no conflicts of interest.
Resources from the same session
3186 - The landscape of immuno-oncology clinical trials in China
Presenter: Dawei Wu
Session: Poster Display session 3
Resources:
Abstract
3468 - Clinical Significance of Immune-related Creatine Phosphokinase Increase Associated with Anti PD1/PD-L1 immunotherapies.
Presenter: Samia Hajem
Session: Poster Display session 3
Resources:
Abstract
3836 - Thyroid toxicity and anti-thyroid antibodies as predictive markers for patients treated with anti-PD1 checkpoint therapy
Presenter: Wim Meer
Session: Poster Display session 3
Resources:
Abstract
1343 - Treatment-related adverse events and tolerability in patients with advanced renal cell carcinoma treated with first-line combination therapy with checkpoint inhibitors
Presenter: Thura Win Htut
Session: Poster Display session 3
Resources:
Abstract
5783 - Immune-related adverse events (irAEs) with single-agent PD-1 vs PD-L1 inhibitors: a meta-analysis of 8,730 patients from clinical trials
Presenter: Guru Sonpavde
Session: Poster Display session 3
Resources:
Abstract
5422 - EULAR recommendations for the diagnosis and the management of rheumatic immune-related adverse events due to cancer immunotherapy
Presenter: Marie Kostine
Session: Poster Display session 3
Resources:
Abstract
1202 - Radiographic characteristics and poor prognostic factors of interstitial lung disease (ILD) in nivolumab-treated patients with non-small cell lung cancer (NSCLC)
Presenter: Shinichi Sasaki
Session: Poster Display session 3
Resources:
Abstract
2749 - Use of Checkpoint Inhibitors (CPI) in Allogeneic Stem Cell Transplant Recipients: An Institutional Experience and A Systemic Review of the Literature
Presenter: Chantal Saberian
Session: Poster Display session 3
Resources:
Abstract
3256 - Deep Learning Radiomics distinguishes intrapulmonary Disease from Metastases in Immunotherapy-treated Melanoma Patients
Presenter: Thi Dan Linh Nguyen-Kim
Session: Poster Display session 3
Resources:
Abstract
5031 - Sarcoidosis-Like Reaction Mimics Progression in patients treated with immune checkpoint inhibitors
Presenter: Sophie Hans
Session: Poster Display session 3
Resources:
Abstract