Abstract 4787
Background
Comparison of options from clinical decision-support (CDS) systems and decisions made in practice may be biased towards the treating institution. In this retrospective study, bias was minimized by blinding evaluators to the source of treatment recommendations, either Watson for Oncology® (WFO®) or treatments patients received at Bumrungrad International Hospital (BIH), a user of WFO®.
Methods
Treatments given were compared to therapeutic options provided by WFO®. Treatments that were identical to WFO® “recommended” (green, acceptable) were not evaluated further. Paired treatments were evaluated independently in a blinded fashion by each oncologist before consensus ranking of each pair as either acceptable, acceptable alternatives, or unacceptable treatment. The consensus for each treatment was compared to WFO®, with WFO® “for consideration” (yellow, acceptable alternative), and “not recommended” (red, unacceptable). Chi-squared tests analyzed the association between risk factors and discordant recommendations.
Results
Of 228 treatments given to patients with lung, colon, breast and rectal cancers, 174 were identical to WFO® acceptable (green) and not evaluated further; 54 non-identical pairs were evaluated (Table). Overall, 88.6% of decisions were either the same or viewed as equally acceptable by oncologists; oncologists preferred 3.9% of BIH treatments and 4.4% of WFO treatments. In cases where reasons for discordance were provided, 70% were due to BIH oncologist preference, 20% to patient preference and 10% to WFO treatment availability. We found no association between discordant recommendations and patient age or stage of cancer.Table: 1435P
Treatments | N (%) 228 Total |
---|---|
Treatments are identical | 174 (76.3%) |
Oncologists’ Evaluations | |
Acceptable alternatives | 28 (12.3%) |
BIH Preferred | 9 (3.9%) |
WFO Preferred | 10 (4.4%) |
Both WFO and BIH-Rx unacceptable | 7 (3.1%) |
Conclusions
This blinded study suggests WFO®’s therapeutic options are at as least as good as (or are an acceptable alternative to) treatments in practice. Blinding evaluators to source of treatment may minimize bias in comparisons of CDS systems and decisions made in practice.
Clinical trial identification
Editorial acknowledgement
Legal entity responsible for the study
Bumrungrad International Hospital.
Funding
Bumrungrad International Hospital.
Disclosure
All authors have declared no conflicts of interest.
Resources from the same session
3190 - GI101, a novel triple-targeting bispecific CD80-IgG4-IL2variant fusion protein, elicits synergistic anti-tumor effects in preclinical models
Presenter: Jae Chan Park
Session: Poster Display session 3
Resources:
Abstract
4062 - Phase 1b, open-label, dose-escalation study of M9241 (NHS-IL12) plus avelumab in patients (pts) with advanced solid tumors
Presenter: Julius Strauss
Session: Poster Display session 3
Resources:
Abstract
5777 - THOR-707, a novel not-alpha IL-2, promotes all key immune system anti-tumoral actions of IL-2 without eliciting vascular leak syndrome (VLS)
Presenter: Marcos Milla
Session: Poster Display session 3
Resources:
Abstract
5047 - A phase I clinical trial of malignant pleural mesothelioma treated with locally delivered autologous anti-FAP-targeted CAR T-cells
Presenter: Alessandra Curioni
Session: Poster Display session 3
Resources:
Abstract
1679 - HPV16 E6-specific TCR-T armored with checkpoint blockade in the treatment of cervical cancer
Presenter: Paul Bryson
Session: Poster Display session 3
Resources:
Abstract
1133 - the Mutant Neoantigen Specific T Cell Is a Personalized Immunotherapy in Refractory Solid Tumor
Presenter: Qi Song
Session: Poster Display session 3
Resources:
Abstract
3338 - NY-ESO-1 and LAGE1A –an emerging target for cell therapies in solid tumours
Presenter: Ioanna Eleftheriadou
Session: Poster Display session 3
Resources:
Abstract
3089 - Targeting myeloid-derived suppressor cells and T cells: combination treatment with MTL-CEBPA and PD-1 antibody in a mouse syngeneic CT26 model
Presenter: Mikael Sodergren
Session: Poster Display session 3
Resources:
Abstract
5991 - Master Checkpoint Cbl-b Inhibition: Anti-tumor Efficacy in a Murine Colorectal Cancer Model Following siRNA-based Cell Therapy
Presenter: Kathrin Thell
Session: Poster Display session 3
Resources:
Abstract
5007 - Functional systemic CD4 immunity is required for clinical responses to PD-L1/PD-1 blockade therapy
Presenter: Miren Zuazo
Session: Poster Display session 3
Resources:
Abstract