Abstract 4787
Background
Comparison of options from clinical decision-support (CDS) systems and decisions made in practice may be biased towards the treating institution. In this retrospective study, bias was minimized by blinding evaluators to the source of treatment recommendations, either Watson for Oncology® (WFO®) or treatments patients received at Bumrungrad International Hospital (BIH), a user of WFO®.
Methods
Treatments given were compared to therapeutic options provided by WFO®. Treatments that were identical to WFO® “recommended” (green, acceptable) were not evaluated further. Paired treatments were evaluated independently in a blinded fashion by each oncologist before consensus ranking of each pair as either acceptable, acceptable alternatives, or unacceptable treatment. The consensus for each treatment was compared to WFO®, with WFO® “for consideration” (yellow, acceptable alternative), and “not recommended” (red, unacceptable). Chi-squared tests analyzed the association between risk factors and discordant recommendations.
Results
Of 228 treatments given to patients with lung, colon, breast and rectal cancers, 174 were identical to WFO® acceptable (green) and not evaluated further; 54 non-identical pairs were evaluated (Table). Overall, 88.6% of decisions were either the same or viewed as equally acceptable by oncologists; oncologists preferred 3.9% of BIH treatments and 4.4% of WFO treatments. In cases where reasons for discordance were provided, 70% were due to BIH oncologist preference, 20% to patient preference and 10% to WFO treatment availability. We found no association between discordant recommendations and patient age or stage of cancer.Table: 1435P
Treatments | N (%) 228 Total |
---|---|
Treatments are identical | 174 (76.3%) |
Oncologists’ Evaluations | |
Acceptable alternatives | 28 (12.3%) |
BIH Preferred | 9 (3.9%) |
WFO Preferred | 10 (4.4%) |
Both WFO and BIH-Rx unacceptable | 7 (3.1%) |
Conclusions
This blinded study suggests WFO®’s therapeutic options are at as least as good as (or are an acceptable alternative to) treatments in practice. Blinding evaluators to source of treatment may minimize bias in comparisons of CDS systems and decisions made in practice.
Clinical trial identification
Editorial acknowledgement
Legal entity responsible for the study
Bumrungrad International Hospital.
Funding
Bumrungrad International Hospital.
Disclosure
All authors have declared no conflicts of interest.
Resources from the same session
3361 - Providing a nurse-led telephone intervention for patients treated with oral anticancer medication: symptom management and adherence monitoring
Presenter: Etienne Minvielle
Session: Poster Display session 3
Resources:
Abstract
3937 - Chronological evaluation of health-related quality of life and physical symptoms in postoperative pancreatic cancer patients up to 12 months
Presenter: Naoko Sato
Session: Poster Display session 3
Resources:
Abstract
5620 - Understanding the patients’ Experiences of Radiation Therapy: A Qualitative Study on Prostate Cancer Patients
Presenter: Sakarias Johansson
Session: Poster Display session 3
Resources:
Abstract
1792 - Effect of Kegel exercises on prevention of urinary and fecal incontinence in patients with prostate cancer undergoing radiotherapy
Presenter: Aydan Uravylioglu
Session: Poster Display session 3
Resources:
Abstract
2169 - The Meaning of Responsibility – a Secondary Analysis of Patients and Caregivers Calls to an Oncology Emergency Telephone
Presenter: Heidi Jacobsen
Session: Poster Display session 3
Resources:
Abstract
4587 - Cognitive function changes and Associated Factors in Patients Receiving Chemotherapy
Presenter: Elif Dil
Session: Poster Display session 3
Resources:
Abstract
1981 - Prevention of dental complications in patients with multiple myeloma (MM) receiving bisphosphonates treatment
Presenter: CESCA PUIGMARTI
Session: Poster Display session 3
Resources:
Abstract
2725 - Safety profile of oral netupitant/palonosetron in hematopoietic stem cell transplantation recipients.
Presenter: Marina Bosch - Damas
Session: Poster Display session 3
Resources:
Abstract
5112 - Symptomatic and toxicity management of cancer patients using a telephone support model led by the oncology nurse
Presenter: Gemma Simó
Session: Poster Display session 3
Resources:
Abstract
1365 - Symptom cluster of fatigue, sleep disturbance and depression and its impact on quality of life among Chinese breast cancer patients undergoing adjuvant chemotherapy: A cross-sectional study
Presenter: Xiaole HE
Session: Poster Display session 3
Resources:
Abstract