Abstract 4787
Background
Comparison of options from clinical decision-support (CDS) systems and decisions made in practice may be biased towards the treating institution. In this retrospective study, bias was minimized by blinding evaluators to the source of treatment recommendations, either Watson for Oncology® (WFO®) or treatments patients received at Bumrungrad International Hospital (BIH), a user of WFO®.
Methods
Treatments given were compared to therapeutic options provided by WFO®. Treatments that were identical to WFO® “recommended” (green, acceptable) were not evaluated further. Paired treatments were evaluated independently in a blinded fashion by each oncologist before consensus ranking of each pair as either acceptable, acceptable alternatives, or unacceptable treatment. The consensus for each treatment was compared to WFO®, with WFO® “for consideration” (yellow, acceptable alternative), and “not recommended” (red, unacceptable). Chi-squared tests analyzed the association between risk factors and discordant recommendations.
Results
Of 228 treatments given to patients with lung, colon, breast and rectal cancers, 174 were identical to WFO® acceptable (green) and not evaluated further; 54 non-identical pairs were evaluated (Table). Overall, 88.6% of decisions were either the same or viewed as equally acceptable by oncologists; oncologists preferred 3.9% of BIH treatments and 4.4% of WFO treatments. In cases where reasons for discordance were provided, 70% were due to BIH oncologist preference, 20% to patient preference and 10% to WFO treatment availability. We found no association between discordant recommendations and patient age or stage of cancer.Table: 1435P
Treatments | N (%) 228 Total |
---|---|
Treatments are identical | 174 (76.3%) |
Oncologists’ Evaluations | |
Acceptable alternatives | 28 (12.3%) |
BIH Preferred | 9 (3.9%) |
WFO Preferred | 10 (4.4%) |
Both WFO and BIH-Rx unacceptable | 7 (3.1%) |
Conclusions
This blinded study suggests WFO®’s therapeutic options are at as least as good as (or are an acceptable alternative to) treatments in practice. Blinding evaluators to source of treatment may minimize bias in comparisons of CDS systems and decisions made in practice.
Clinical trial identification
Editorial acknowledgement
Legal entity responsible for the study
Bumrungrad International Hospital.
Funding
Bumrungrad International Hospital.
Disclosure
All authors have declared no conflicts of interest.
Resources from the same session
2171 - CCND1 Amplification Contributes to Immunosuppression in Head and Neck Squamous Cell Carcinoma and the Association with a Poor Response to Immune Checkpoint Inhibitors
Presenter: Chloe Huang
Session: Poster Display session 3
Resources:
Abstract
2624 - Efficacy of PD-1/PD-L1 inhibitors in the treatment of non-small cell lung cancer patients with sensitive genes mutation
Presenter: Hui-Juan Cui
Session: Poster Display session 3
Resources:
Abstract
3494 - Neutrophil to Lymphocyte Ratio (NLR) kinetics as predictors of outcomes in metastatic renal cell carcinoma (mRCC) and non-small cell lung cancer (NSCLC) patients treated with nivolumab (N).
Presenter: Audrey Simonaggio
Session: Poster Display session 3
Resources:
Abstract
3964 - Predictive markers of checkpoint inhibitor activity in adult metastatic solid tumours
Presenter: Alexandra Pender
Session: Poster Display session 3
Resources:
Abstract
3041 - Blood-based TMB (bTMB) correlates with tissue-based TMB (tTMB) in a multi-cancer Phase I IO Cohort
Presenter: Daniel Araujo
Session: Poster Display session 3
Resources:
Abstract
3910 - Analysis of Molecular Profile Complexities for Immunotherapy Decision Support
Presenter: Robert Dóczi
Session: Poster Display session 3
Resources:
Abstract
4836 - The Role of Tumor Neoantigens in the Differential Response to Immunotherapy (IO) in EGFR and BRAF Mutated Lung Cancers - Quantity or Quality?
Presenter: Katrina Case
Session: Poster Display session 3
Resources:
Abstract
1929 - Impact of previous corticosteroid (CS) exposure on efficacy of Programmed Cell Death-(Ligand) 1 blockade in patients with advanced Non-Small-Cell Lung Cancer (NSCLC): a single Center retrospective analysis
Presenter: Fabrizio Nelli
Session: Poster Display session 3
Resources:
Abstract
2601 - Comparison 18F-FDG-PET/CT criteria for prediction of therapy response and clinical outcome in patients with metastatic melanoma treated with Ipilimumab and PD-1 inhibitors
Presenter: Sabrina Vari
Session: Poster Display session 3
Resources:
Abstract
3628 - Predictive model for survival in advanced non-small-cell lung cancer (NSCLC) treated with frontline pembrolizumab
Presenter: Xabier Mielgo Rubio
Session: Poster Display session 3
Resources:
Abstract