Conjoint Professor Nicky Hudson

© 2015 Informa UK Ltd.Background: This study was undertaken to improve assessment practice on OSCEs through collaboration across geographically dispersed medical schools in Australia.Methods: A total of eleven OSCE stations were co-developed by four medical schools and used in summative 2011 and 2012 examinations for the assessment of clinical performance in the early clinical and exit OSCEs in each schools medical course. Partial Credit Rasch Model was used to evaluate the psychometric properties of the shared OSCE data. Evaluation of the quality assurance reports was used to determine the beneficial impact of the collaborative benchmarking exercise on learning and teaching outcomes.Results: The data for each examination demonstrated sufficient fit to the Rasch model with infit mean square values ranging from 0.88 to 0.99. Person separation (1.25-1.63) indices indicated good reliability. Evaluation of perceived benefits showed that the benchmarking process was successful as it highlighted common curriculum areas requiring specific focus and provided comparable data on the quality of teaching at the participating medical schools.Conclusion: This research demonstrates the validity of the psychometric data and benefits of evaluating clinical competence across medical schools without the enforcement of a prescriptive national curriculum or assessment.

© 2015 Informa UK Ltd.Background: Benchmarking among medical schools is essential, but may result in unwanted effects. Aim: To apply a conceptual framework to selected benchmarking activities of medical schools. Methods: We present an analogy between the effects of assessment on student learning and the effects of benchmarking on medical school educational activities. A framework by which benchmarking can be evaluated was developed and applied to key current benchmarking activities in Australia and New Zealand. Results: The analogy generated a conceptual framework that tested five questions to be considered in relation to benchmarking: what is the purpose? what are the attributes of value? what are the best tools to assess the attributes of value? what happens to the results? and, what is the likely "institutional impact" of the results? If the activities were compared against a blueprint of desirable medical graduate outcomes, notable omissions would emerge. Conclusion: Medical schools should benchmark their performance on a range of educational activities to ensure quality improvement and to assure stakeholders that standards are being met. Although benchmarking potentially has positive benefits, it could also result in perverse incentives with unforeseen and detrimental effects on learning if it is undertaken using only a few selected assessment tools.

Objective: All senior medical students at the University of Wollongong undertake a longitudinal integrated community-based clerkship, supervised by experienced general practitioners in a regional or rural community. This study investigates the influence of the longitudinal integrated clerkship model of medical education on scholarship among preceptors in these practice communities. Design: General practitioner preceptors were interviewed after the first student cohort had completed their 38-week placements. Analysis of transcripts identified themes supporting clinical scholarship among preceptors. The entire transcript for each preceptor was analysed, permitting a quantitative determination of each theme. Quotations supporting the themes were selected. Setting: The setting was the primary health care practices supervising the longitudinal integrated clerkship medical students. Participants: Twenty-six preceptors who supervised longitudinal integrated clerkship medical students in rural and regional New South Wales participated. None had previously been involved in this model of medical education. Main outcome measure: The study looked for evidence of clinical scholarship among preceptors supervising students in the longitudinal medical student clerkship. Results: Thematic analysis of interview transcripts revealed evidence of clinical scholarship in regional/rural clinical medicine. The 'practice' was validated as a place where scholarship occurs, an 'academy of learning' and part of the university. About half of the preceptors believed the longitudinal integrated clerkship gave students a deeper link with the community. Two thirds of participants perceived an improved quality of care in their practice. Conclusion: Longitudinal integrated clerkships in teaching communities of practice provide the opportunity for emergence of clinical scholarship among preceptors supporting the learning needs of medical students. © 2014 National Rural Health Alliance Inc.

Clinical placement learning experiences are integral to all health and medical curricula as a means of integrating theory into practice and preparing graduates to deliver safe, high-quality care to health consumers. A growing challenge for education providers is to access sufficient clinical placements with experienced supervisors who are skilled at maximising learning opportunities for students. This paper reports on the development and evaluation of an innovative online learning program aimed at enhancing student and clinical supervisors' preparedness for effective workplace-based learning. The evidence-based learning program used 'story-telling' as the learning framework. The stories, which were supported by a range of resources, aimed to engage the learners in understanding student and supervisor responsibilities, as well as the expectations and competencies needed to support effective learning in the clinical environment. Evaluation of this program by the learners and stakeholders clearly indicated that they felt authentically 'connected' with the characters in the stories and developed insights that suggested effective learning had occurred.