408P - The Asian sarcoma consortium sarcoma preceptorship program: A program evaluation study utilizing the Kirkpatrick model (Level 1 and 2)

Background

Sarcomas are a heterogeneous group of uncommon malignancies that are rarely encountered in most general oncology clinics and most general oncologists have very little experience in dealing with them. The Asian Sarcoma Consortium (ASC) is an international study group of oncologists specializing in sarcomas. The group has decided to start a Sarcoma Preceptorship Program. Its goal is increased awareness of the multidisciplinary approach in sarcomas. Objective is to conduct a program evaluation using the first 2 levels of the Kirkpatrick Model, involving Level 1 – focusing on satisfaction surveys of the participants and Level 2 – focusing on amount of information gained through a pre-test and a post-test.

Methods

Activities included didactic lectures, multidisciplinary case discussions and a summative multidisciplinary case presentation at the conclusion. Evaluation was done using satisfaction survey forms and a pre- and post-test. Novartis did their own survey & results were included in analysis, but had no direct participation in conduct of program.

Results

31 persons mostly Oncologists from University/Government Hospitals participated. 50% were consultants. Satisfaction surveys were optimistic, with ASC forms showing high level of satisfaction for the time and scope. Satisfaction level was high when helpfulness of topics was considered. Faculty response showed similar trends. Ratings remained consistent when the Novartis evaluation data were included. Areas for improvement included time management, content, language barriers and inconsistencies in facilitation. Results from pre-test and post-test showed test scores lower in post-test. Coefficient of Test reliability showed that pre-test was highly reliable but not post-test, the causes included external factors like time allotment for the post-test and presence of distractions.

Conclusions

The program was successful in terms of participant and faculty satisfaction. Results were supported by Novartis data. Certain areas for improvement were identified and recommendations were made.

Clinical trial identification

Editorial acknowledgement

Legal entity responsible for the study

Asian Sarcoma Consortium.

Funding

Asian Sarcoma Consortium Novartis Pharma.

Disclosure

F.Y. Gracieux Jr.: Honoraria (self), RTD Speaker: Roche Philippines; Honoraria (self), Conference Speaker, RTD Speaker: Novartis Philippines; Honoraria (self), Webinar Moderator; RTD Speaker: Boehringer Ingelheim; Honoraria (self), Conference Speaker: GSK Philippines; Honoraria (self), Conference Speaker: Beacon Bangladesh; Honoraria (self), Conference Speaker; RTD Speaker: Roche Malaysia; Honoraria (self), Conference Speaker: Roche Myanmar.