123.04 Improving health management performance in Serbia: External evaluation of learning outcomes after training

Thursday, April 30, 2009
James Flemming (The Hilton Istanbul Hotel )
Vesna Bjegovic Mikanovic School of Medicine, University of Belgrade, Serbia and Montenegro
Zorica Terzic Supic School of Medicine, University of Belgrade, Serbia and Montenegro
Jelena Marinkovic School of Medicine, University of Belgrade, Serbia and Montenegro
Aim. The aim of this study is to analyze the learning outcomes after a specific training programme by the means of external assessment.
Methods. The study was conducted in 2007 with cohort of 107 managers from 20 Serbian general hospitals. They attended the training programme with 4 modules on health management. Three independent external evaluators did appraisal of applied management learning, six months after the training was done. They assessed the quality of two SWOT analyses done by managers – the first during the training programme and the second six months later. They also assessed the quality of integral strategic plan developed as an outcome of applied management learning after six months. The internal consistency of answers regarding the SWOT analysis and strategic plans given by three evaluators was acceptable (for SWOT analyses: between 0.50 and 1.00 and for integral strategic plans: higher than 0.90). A multiple linear regression served to determine predictors of higher quality of the integral strategic plans done by managers. Improvement in different skills of SWOT analysis served as independent variables.
Results. Evaluators assessed SWOT analyses six months after training programme as much better than those done during the training. (P < 0.001). The quality of the strategic plans comprising hospitals’ mission, SMART goals and action plan, could be explained with six predictors relating to a level of improvement in SWOT analysis skills in assessment of: internal environment, external environment, hospital performances, application of technical rules in SWOT, connection between external factors and hospital’s mission and goals, and capability to recommend future strategies.
Conclusion. External evaluation of training outcomes has found improvement in all aspects of SWOT analysis done by managers. Later, improved skills of managers in detailed analyses of internal and external environment of hospitals within SWOT are significant predictors of all components in strategic planning.

Learning Objectives: Recognize the importance of training evaluation and evaluation of learning outcomes Analyze the importance of strategic planning and quality of strategic plan Discuss the importance of evaluation results for improving the specific training programme

Sub-Theme: Training multidisciplinary health workers