Monitoring and Assessment

Related Files

Guide for P2P impact assessment

Last Change: 11/05/2017
Publisher: ERA-LEARN

Evaluation and impact assessment has become an imperative need for all P2Ps.

Evaluation and impact assessment has become an imperative need for all P2Ps. Following a process of consultation with the P2P community, ERA-LEARN 2020 has published a Guide for P2P impact assessment (Deliverable 3.4a) drawing on relevant evaluation theories and good practices. As impact evaluation is a complex and constantly evolving topic, it is strongly advised that this Guide be read in conjunction with Deliverable D3.4b “Background document on P2P evaluation / impact assessment”, which provides additional information on the concepts used in the Guide as well as examples from P2P-relevant work. Naturally, the Background Document is a living document that can and should be updated in the course of ERA-LEARN 2020 reflecting on the evolving needs for evaluation / impact assessment of P2Ps.

More ... Less ...

Category: Manual

Background document on P2P evaluation / impact assessment

Last Change: 11/05/2017
Publisher: ERA-LEARN

This document is the Background Document that accompanies the ‘Short Guide on P2P evaluation / impact assessment’ (Deliverable D3.4a).

This document is the Background Document that accompanies the ‘Short Guide on P2P evaluation / impact assessment’ (Deliverable D3.4a). As such it provides additional information on a number of the concepts used in the Guide as well as examples from P2Ps relevant work. Naturally, the Background Document is a living document that can and should be updated in the course of ERA-LEARN 2020 reflecting on the rising needs for evaluation / impact assessment of P2Ps. It is also important to note that the term ‘impact assessment’ in the Guide and this Background Document is seen in the wider sense addressing also evaluation of an intervention’s effectiveness, efficiency, etc. as well as its outputs and outcomes. Thus, the terms ‘evaluation’ and ‘impact assessment’ are used interchangeably.

More ... Less ...

Category: Manual

Policy Brief on impact assessment of networks – 2015

Last Change: 20/11/2015
Publisher: ERA-LEARN

The Brief draws on the results of two strands of research: Strand 1: advanced statistical analysis of existing evidence and data collected through the 2013 IP ...

The Brief draws on the results of two strands of research:

  • Strand 1: advanced statistical analysis of existing evidence and data collected through the 2013 IPTS NETWATCH impact survey (Doussineau, et al. 2013), the Commission’s surveys carried out annually (Niehoff 2014; Bertrand and Niehoff 2013; Jekova and Niehoff 2012); and
  • Strand 2: a small scale survey based on interviews of JPI members (26 in total).
More ... Less ...

Category: Policy Brief

Partnerships in research and innovation can produce various types of impacts ranging from scientific/technological impacts on the specific research area addressed; to economic impacts that denote changes at the organisational and national budgetary levels; to cultural/attitudinal and conceptual or policy-related impacts reflecting changes to mind-sets on how a research issue should be addressed or behaviours concerning international collaboration, for instance. Connectivity and capacity building impacts are no less important, both for project beneficiaries and the members of the networks themselves. Structural changes in the national or trans-national landscape can be both a prerequisite as well as an impact of these partnerships.

Common practice in the evaluation of research programmes reflects the notion that the impact of the whole programme is the aggregate impact of the component projects. P2Ps, however, are not programmes; they are networks. Their very existence and the way a network is designed, structured and operated will produce additional impacts (sometimes called ‘process impacts’). Any framework for P2P evaluation should allow for a variety of impact types to be assessed.

By the end of 2017, more than 570 joint calls were launched by P2P networks with a combined investment of some Euro 5.8 billion in more than 6,400 transnational projects. Most of the networks, and/or the national funding organisations, have some form of monitoring system for the projects that are spawned from Joint Calls but assessment of their economic, societal and/or environmental impacts is less common. Identifying and measuring the impact of this huge investment has become imperative for the future sustainability of both national and EU funding for P2P actions. The need for a common framework for P2P impact assessment as well as a central system for project-level impact assessment is increasingly acknowledged.

ERA-LEARN 2020 has been supporting P2P networks, and associated national funding organisations, in their impact assessment activities, both of the supported projects and the networks themselves. This has been carried out through the development and publication of annual monitoring reports and impact briefs, the identification of good practice case examples, the development of special guidance and tools, the collection of existing monitoring and assessment studies and the development of a central system for P2P project level impact assessment. This work is carried out in close collaboration with the P2P community, mainly through special workshops that seek to gain insights as well as provide training to the P2P community.

ERA-LEARN 2020 Workshop on evaluation and impact assessment of P2Ps (18/05/2016)

Assessing the impacts of public-to-public networks in research and innovation (such as JPIs, ERA-NETs, Art. 185s) is vital for building a convincing case and establishing the added value of these networks compared with national or other European initiatives. Significant work has been done in this area in recent years, especially for ERA-NETs. 
Discussions at the 2015 Annual Joint Programming conference (Brussels, 14-15 Jan. 2016) highlighted the importance of establishing a common understanding in relation to the impact assessment of P2Ps and the need to work towards building a uniform impact assessment framework which builds on accumulated knowledge and experience.
A workshop was held in May 2016 dedicated to the impact assessment of P2Ps, with its aim being:

  • To establish a common understanding in relation to the impact assessment of P2Ps
  • To work towards building a common framework for assessing the impacts of P2Ps

Further information about the workshop, as well as copies of the presentation, can be found here.