Monitoring and impact assessment of networks
Monitoring and impact assessment of networks
A more systematic, and integrated, approach to the monitoring & assessment of P2P networks is being implemented within the ERA-LEARN 2020 project. The outputs of this include both an annual monitoring report and focussed impact assessment reports on specific topics.
Going forward, the monitoring and assessment activities will gradually be extended to include the co-funded projects and learning materials.
Guide for P2P impact assessment
Evaluation and impact assessment has become an imperative need for all P2Ps. Following a process of consultation with the P2P community, ERA-LEARN 2020 has published a Guide for P2P impact assessment (Deliverable 3.4a) drawing on relevant evaluation theories and good practices. As impact evaluation is a complex and constantly evolving topic, it is strongly advised that this Guide be read in conjunction with Deliverable D3.4b “Background document on P2P evaluation / impact assessment”, which provides additional information on the concepts used in the Guide as well as examples from P2P-relevant work. Naturally, the Background Document is a living document that can and should be updated in the course of ERA-LEARN 2020 reflecting on the evolving needs for evaluation / impact assessment of P2Ps.
Download "Guide for P2P impact assessment " here.
Download Background document on P2P evaluation / impact assessment here.
Updated Policy Brief on the Impacts of Networks 2016
ERA-LEARN 2020 conducted two large scale surveys in 2016 in order to capture the overall experience of participating in ERA-NETs (covering all the different versions of the scheme over the years). The results are presented in the "Updated Report on the Impacts of Networks 2016".
Overall, the ERA-NET scheme has managed to mobilise a critical mass of resources and establish durable cooperation among countries around certain societal challenges and research topics. However, more efforts are needed at the national level for the scheme to realise its full potential. To achieve their ultimate goal, ERA-NETs need to focus on excellence, but at the same time, they need to pursue objectives beyond that, by increasing efforts to attract policy attention and support, primarily at the national level, so that they become influential actors at the European / international arena. Read more here.
ERA-LEARN 2020 Draft Framework for P2P evaluation and Impact assessment
There is wide consensus within the P2P community that evaluation and impact assessment of P2Ps and their supported projects is of major importance not only in view of improving performance but for enabling strategic decisions to be made. A number of P2Ps have developed relevant frameworks while others have already engaged in assessment the impacts of supported projects. Drawing upon international evaluation and impact assessment practice, this framework tries to bring all efforts together in a comprehensive framework that can be applied in all P2Ps. It will be presented at the Annual Joint Programming Conference, Brussels, 22-23 November 2016 with the purpose of receiving comments for further improvement and final validation.
The Framework can be downloaded here.
2nd Annual Report on P2P Partnerships (2016)
The 2nd ERA-LEARN 2020 annual report on public-public (P2P) networks in Europe covers the 12 month period from July 2015 to the end of June 2016. It also aims to present the cumulative and emerging position on joint calls since the launch of the P2P movement in 2003 and provides a spotlight on the Cofund instrument, presenting a picture of the investment and results of the Cofunds to date. The report can be downloaded here.
1st Annual Report on P2P Partnerships (2015)
The 1st ERA-LEARN 2020 annual report on public-public (P2P) networks in Europe covers the 18 month period from the start of Horizon 2020 in January 2014 to the end of June 2015. It also aims to present the cumulative and emerging position on joint calls since the launch of the P2P movement in 2003 including not only the ERA-NETs but also the Article 185 initiatives and the Joint Programming Initiatives (JPI).
The report can be downloaded here.
Policy Brief on Impact Assessment of Networks 2015
The results coming from the impact assessment exercise carried out by ERA-LEARN 2020 in 2015 are presented and discussed in detail in the report "Policy Brief on impact assessment of networks – 2015", which can be downloaded here.
You may also find the executive summary as a separate document here.
The Policy Brief draws on the results of two strands of research: Strand 1 – advanced statistical analysis of existing evidence and data collected through recent impact surveys, and Strand 2 - a small scale survey based on interviews of JPI members.
Despite the different stages of development of the JPIs, and their relatively young age, there is already some perceived evidence in a variety of impacts in relation to connectivity, capacity building, and attitudinal changes, as well as conceptual and structural impacts. Alongside these impacts, certain factors emerge as important, affecting the degree of impact achievement. Among them, strategic and operational alignment (or programme interoperability) are key, both as regards success factors as well as anticipated impacts. This is confirmed both by the JPI as well as ERA-NET community.
ERA-LEARN 2020 Workshop on evaluation and impact assessment of P2Ps
Assessing the impacts of public-to-public networks in research and innovation (such as JPIs, ERA-NETs, Art. 185s) is vital for building a convincing case and establishing the added value of these networks compared with national or other European initiatives. Significant work has been done in this area in recent years, especially for ERA-NETs.
Discussions at the 2015 Annual Joint Programming conference (Brussels, 14-15 Jan. 2016) highlighted the importance of establishing a common understanding in relation to the impact assessment of P2Ps and the need to work towards building a uniform impact assessment framework which builds on accumulated knowledge and experience.
A workshop was held in May 2016 dedicated to the impact assessment of P2Ps, with its aim being:
- To establish a common understanding in relation to the impact assessment of P2Ps
- To work towards building a common framework for assessing the impacts of P2Ps
Further information about the workshop, as well as copies of the presentation, can be found here.
Last update: November 2016