Validity Evidence for Direct Observation of Procedural Skills in Paediatric Gastroscopy

Objectives: Direct observation of procedural skills (DOPS) are competence-assessment tools in endoscopy. Formative paediatric gastroscopy DOPS were implemented into the UK curriculum in 2016 but lack validity evidence; we aimed to assess validity evidence using a recognised contemporary validity framework. Methods: We performed a prospective UK-wide analysis of formative paediatric gastroscopy DOPS submitted to the e-Portfolio over one year. Internal structure validity was assessed using inter-item correlations between DOPS items, average domain and skillset scores and with the overall competency rating. Overall competence scores and mean DOPS scores were compared by trainee seniority and procedure count (discriminative validity). Receiver operating characteristic curve (ROC) analysis was performed to explore if DOPS scores could be used to delineate procedural competency (consequential validity). Results: 157 DOPS assessments were completed by 20 trainers for 17 trainees. Strengths of correlations varied between DOPS components, with overall competency correlating most with technical-predominant items, domains and skillsets. Both the overall assessor's rating and mean DOPS scores increased with trainee seniority (P 

from Gastroenterology via xlomafota13 on Inoreader https://ift.tt/2msOVt7
via IFTTT