Abstract 4787
Background
Comparison of options from clinical decision-support (CDS) systems and decisions made in practice may be biased towards the treating institution. In this retrospective study, bias was minimized by blinding evaluators to the source of treatment recommendations, either Watson for Oncology® (WFO®) or treatments patients received at Bumrungrad International Hospital (BIH), a user of WFO®.
Methods
Treatments given were compared to therapeutic options provided by WFO®. Treatments that were identical to WFO® “recommended” (green, acceptable) were not evaluated further. Paired treatments were evaluated independently in a blinded fashion by each oncologist before consensus ranking of each pair as either acceptable, acceptable alternatives, or unacceptable treatment. The consensus for each treatment was compared to WFO®, with WFO® “for consideration” (yellow, acceptable alternative), and “not recommended” (red, unacceptable). Chi-squared tests analyzed the association between risk factors and discordant recommendations.
Results
Of 228 treatments given to patients with lung, colon, breast and rectal cancers, 174 were identical to WFO® acceptable (green) and not evaluated further; 54 non-identical pairs were evaluated (Table). Overall, 88.6% of decisions were either the same or viewed as equally acceptable by oncologists; oncologists preferred 3.9% of BIH treatments and 4.4% of WFO treatments. In cases where reasons for discordance were provided, 70% were due to BIH oncologist preference, 20% to patient preference and 10% to WFO treatment availability. We found no association between discordant recommendations and patient age or stage of cancer.Table: 1435P
Treatments | N (%) 228 Total |
---|---|
Treatments are identical | 174 (76.3%) |
Oncologists’ Evaluations | |
Acceptable alternatives | 28 (12.3%) |
BIH Preferred | 9 (3.9%) |
WFO Preferred | 10 (4.4%) |
Both WFO and BIH-Rx unacceptable | 7 (3.1%) |
Conclusions
This blinded study suggests WFO®’s therapeutic options are at as least as good as (or are an acceptable alternative to) treatments in practice. Blinding evaluators to source of treatment may minimize bias in comparisons of CDS systems and decisions made in practice.
Clinical trial identification
Editorial acknowledgement
Legal entity responsible for the study
Bumrungrad International Hospital.
Funding
Bumrungrad International Hospital.
Disclosure
All authors have declared no conflicts of interest.
Resources from the same session
2262 - Real world experience of Nivolumab therapy in Metastatic Renal Cancer patients: a 3 year multi-centre review
Presenter: Joanna Hack
Session: Poster Display session 3
Resources:
Abstract
4441 - “A pilot study of tremelimumab (treme) with or without cryoablation (cryo) in patients (pts) in metastatic renal cell carcinoma (mRCC).”
Presenter: Matthew Campbell
Session: Poster Display session 3
Resources:
Abstract
2613 - Lenvatinib (Len) alone or in combination with Everolimus (Eve) in heavily pretreated patients (pts) with metastatic renal cell carcinoma (mRCC) after immune checkpoint inhibitors (ICI) and VEGFR-targeted therapies: A single-institution experience
Presenter: Andrew Wiele
Session: Poster Display session 3
Resources:
Abstract
3249 - Weight loss is an underestimated adverse event with cabozantinib in patients with metastastic renal cell carcinoma (mRCC).
Presenter: Emeline Colomba
Session: Poster Display session 3
Resources:
Abstract
2405 - Impact of corticosteroids on nivolumab activity in metastatic clear cell renal cell carcinoma.
Presenter: Felix Lefort
Session: Poster Display session 3
Resources:
Abstract
4020 - Skeletal muscle loss as an adverse event during Cabozantinib treatment in patients with metastatic renal cell carcinoma
Presenter: Carolina Alves Costa Silva
Session: Poster Display session 3
Resources:
Abstract
2407 - Long term relative survival (RS) in patients with primary metastatic kidney cancer (primary mRCC): an analysis of 2,167 patients from the Austrian National Cancer Registry (ANCR).
Presenter: Monika Hackl
Session: Poster Display session 3
Resources:
Abstract
2470 - Advanced renal cell carcinoma: first results from the prospective research platform CARAT for patients with mRCC in Germany
Presenter: Peter Goebell
Session: Poster Display session 3
Resources:
Abstract
1533 - Are immune checkpoint inhibitors a valid option for papillary Renal Cell Carcinoma? Transcriptomic characterization of the immune infiltrate
Presenter: Manon De Vries-brilland
Session: Poster Display session 3
Resources:
Abstract
3367 - Treatment-Free Survival, With and Without Toxicity, as a Novel Outcome Applied to Immuno-Oncology Agents in Advanced Renal Cell Carcinoma
Presenter: Meredith Regan
Session: Poster Display session 3
Resources:
Abstract