Research & Innovation
Research and Innovation Observatory – Horizon 2020 Policy Support Facility

Service tools

Navigation path

MLE on Ex-post Evaluation of Business R&I Grant Schemes



MLE Ex-post evaluation of business R&I grant schemes report

The 'Policy Support Facility' (PSF) was set up by the Directorate-General for Research & Innovation (RTD) of the European Commission under the European Framework Programme for Research and Innovation 'Horizon 2020', in order to support Member States and associated countries in designing, implementing and evaluating reforms of the national science, technology and innovation systems. One of the services offered by the PSF are Mutual Learning Exercises (MLE) which are a project-based learning processes whereby over a period of about six months participating countries jointly examine a challenge-driven policy question in detail. The MLEs involve information acquisition and information sharing activities. The purpose of this particular MLE was to improve the exchange of information and identification of good practices between the participating countries (Denmark, Germany, Norway, Spain and Sweden) and in this way contribute to put in place better systems for the ex-post evaluations of business R&I grant schemes. This MLE discussed various examples of what some regard as the “golden standard” in evaluation. The three key observations were: evaluations using econometric analyses are far from standardized and complex to perform; econometric analyses are very demanding in terms of data-availability and quality; the obstacles regarding access to data and data confidentiality are far from being removed in only but a few cases. While the trend towards econometric analysis continues unabated, it was consensus within the group that it would need to be balanced with an understanding of behavioural effects, i.e. the “innovation journey of firms”, of the use of R&D and innovation grants. Thus, some of the main challenges and questions discussed by this MLE group included: the use of econometric analyses from other domains, as for example education and labour market studies; how to deal with the interaction of various schemes used in combination and how to measure and understand behavioural effects.


Opening workshop

23 February 2016
European Commission, DG RTD
DG RTD building, 21 rue du Champ de Mars, 1050 Ixelles, Brussels

The day started with a presentation of the PSF and MLE exercise by the EC; thereafter 10 minute-presentations about the national policy challenges by participating countries were held and a state-of-play on the subject matter was discussed. At the end of the workshop a project plan was developed.

First country visit – How to benefit from evaluating R&D grants/schemes I: Strategic approaches and challenges related to data management

26 April 2016
CDTI – centro para el Desarrollo Tecnológico Industrial, Calle Cid, 4, 28001, Madrid, Spain

The morning session was composed of three themes, firstly evaluation as a strategic issue, secondly monitoring – a tool for evaluations and finally why econometrics is important. Thereafter the focus was on how to disentangle the joint effect of different schemes and international dimensions.

Second country visit – How to benefit from evaluating R&D grants/schemes II: Strategic approaches and challenges related to data management

3 May 2016
Ministry of Higher Education and Research, Danish Agency for Science, Technology and Innovation, DASTI, Bredgade 40, DK-1260 København

During the morning session the strategic approach towards the choice of the evaluation framework was presented as well as an introduction to the Danish R&D data infrastructure; later issues concerned with multiple participation, additionally and credibility were discussed.

Final workshop on Ex-post evaluation of business R&I grant schemes

30 May 2016
European Commission, DG RTD
DG RTD, Square Frère Orban, 1040 Etterbeek, Brussels

The final workshop was used to present results of the MLE participants' survey and as a feedback session on the MLE instrument; the structure of the final report was discussed together with future plans.

Dissemination Workshop MLE on Ex-post evaluation of business R&I grant schemes

3 November 2016
European Commission, DG RTD
Brussels, Belgium

Experts and participants discussed their findings. It was recognized that despite differences, many of the challenges are shared. The willingness to maintain this learning community was expressed. A new project-based MLE on business R&D grants evaluation will be launched in the beginning of 2017.

Last update: 22/05/2019 | Top | Legal notice | Contact | Search