1834P - Accuracy of recommendations by a conversational Artificial Intelligence (AI) cancer mentor application (app): A multi-disciplinary, multi-institutional evaluation report

Background

The first conversational AI Cancer mentor app was recently launched by Belong.life, a global oncology social network for cancer patients (pts) and caregivers. The app objectives are to provide uninterrupted support and guidance with empathetic, relevant information in cancer management. Belong’s unique and large datasets of pts to physicians and pts to pts interactions provide the basis for the AI platform, adding information from current guidelines, supplying solid up to date data with wide understanding of pts diverse cancer journeys.

Methods

Belong members enquiries, replied by the AI Cancer mentor were validated by 9 oncology experts in solid and haematological cancers, affiliated to various medical centres. 578 member enquiries coupled with the AI Cancer mentor replies, were randomly chosen and distributed according to cancer groups: Breast, Gastrointestinal, Pancreatic, Genitourinary, Musculoskeletal, Haematology and Radiation therapy. The oncologists assessed the AI mentor accuracy of recommendations by relevance and helpfulness, aligning them to evidence-based medicine and current international guidelines.

Results

527/578 (91.18%) AI Cancer mentor replies received a positive validation for their suitable and relevant recommendations. Conversely, 46/578 (7.96%) received a negative validation, while only 5/578 (0.86%) graded as not helpful. Minor variations were noticed in the cancer groups, with positive validations as follows: Genitourinary 100%, Breast 95.7%, Pancreatic 92%, Musculoskeletal 91.2%, Radiation therapy 88%, Gastrointestinal 86.4%, Haematological cancers 84%.

Conclusions

The reported accuracy (91.18%) on 578 pts enquiries and AI Cancer mentor replies, evaluated by a multi-disciplinary, multi-institutional oncologist group, are very promising, indicating that the Belong’s AI cancer mentor provides valuable and reliable recommendations. The findings offered insights into the AI mentor’s performance across a wide group of cancers. Based on this report, the addition of an AI mentor in cancer care, provides helpful, relevant guidance on pts diverse cancer journeys, while supporting oncologists in their pts management.

Clinical trial identification

Editorial acknowledgement

Legal entity responsible for the study

The authors.

Funding

Has not received any funding.

Disclosure

B. Haikin, D.A. Vorobiof: Financial Interests, Personal, Full or part-time Employment: Belong.life. All other authors have declared no conflicts of interest.