Background: Projects are the main financing mechanism within the EU Community Action Programme for Public Health. This paper reports the process of establishing and validating evaluation criteria for projects submitted for funding within this programme, to ensure that projects selected for funding confirm with quality standards. Method: A provisional evaluation checklist was developed assessing 3 aspects of project quality: policy and contextual relevance (5 criteria, scored 0-8), technical quality (5 criteria, scored 0-6) and management quality (6 criteria, scored 0-5). The checklist was validated on individual peer review data of 215 and 151 applications submitted for funding in response to the Calls for Proposals of 2007 and 2008, respectively. Results: Principal component analyses on both the 2007 and 2008 data give a 3 component solution which largely coincides with the dimensions of contextual relevance, technical quality and management quality. Reliability analyses show high Cronbach alphas (> 0.86) for each of the three scales. Discriminant analyses indicate that all three the dimensions contributed to the decision to fund a project, yet that the relative contribution of the individual criteria to the funding decision is different in 2007 and 2008, with innovation, content specification, EU added value and geographical coverage contributing most consistently to the success of an application. Conclusion: The criteria to select project proposals for funding within the EU Health Programme have a sufficient level of construct and predictive validity, and can be used reliably.
Van den Broucke, S. (2012). L’évaluation de projets de santé par la Commission européenne: Les évaluateurs évalués. IPSY DAY, Louvain-la-Neuve. https://hdl.handle.net/2078.5/62015