REvaluation Podcast
REvaluation Podcast
fteval
REvaluation Special #1: Can we just have more causal methods in the evaluation of innovation and research policies?
55 minutes Posted May 24, 2025 at 11:00 pm.
Intro
Impulse by Regina Fuchs: if you want hard facts, you need to plan strategically
Impluse by Clara Calero-Medina: Open science, CoARA and the Barcelona Declaration
Impulse by Guido Bünstorf: Great methodological toolkit is available, but we lack of application
Impulse by Reinhilde Veugelers: we also need to look at spillovers
Discussion start: how these spillovers can be grasped
Policy makers should have access to longitudinal data too
Be responsible, open and transparent
Need for more robust evidence is obvious - but should we really design policy in a way that their evaluation allows RCTs?
Subjects should be part of the story - let's work collaboratively!
From this point questions of the audience were collected: How can we get policy-makers to commission these studies?
Isn't impactful research sometimes neglected?
Practitioners would love to do more, but it's just not possible (time, money, will) -> rather incremental change than RCT push?
Responses from the panellists on question round 1
Question round 2: Issues of attributability vs. causality.
We have an evaluation culture with standards and triangulations. Evaluations and clients are of a good shape, but maybe too many questions are asked.
Final words by Clara Calero-Medina: There is also responsibility in interpreting results, regardless of the method.
Outro
0:00
55:36
Download MP3
Show notes
Whether it is business innovation or basic research, new quantitative methods or new micro-level and register data open up opportunities to investigate the relationships between policies and their intended effects. The aim of the panel is to facilitate an exchange on methods and data for causal evaluation in various innovation and research policies. Which opportunities can we identify, which challenges remain for an increased use of these methodological approaches in evaluations in the medium...