Large-scale measurement instruments on medium and long-term training effects adapted to the needs of a variety of target groups and different fields/domain

Authors

Löfström, Erika, Tammeleht, Anu & Kyllönen, Simo

Description

This document explains why evaluating the effectiveness of research ethics and integrity (REI) training is essential. It stresses that training must genuinely improve learners’ knowledge, skills, and behaviour, and that offering ineffective training is itself unethical. Measuring effectiveness is compared to conducting research: it requires clear questions, appropriate tools, and sound interpretation. The report presents a broad set of measurement instruments for short-, mid-, and long-term learning effects across different contexts, disciplines, and training formats. These tools range from self-assessments to authentic tasks and qualitative methods, aiming to capture learning relative to training goals while considering feasibility and the potential influence of AI.

It is emphasised that the compiled tools form a practical but non-exhaustive toolkit for evaluating REI training at multiple levels, from immediate reactions to long-term behavioural change. Choosing the right tool depends on the training’s aims, format, activities, and the facilitator’s expertise; often, combining tools offers a clearer picture. The recommendations highlight aligning training design with evaluation, using tools as part of pedagogy, enabling comparisons across programmes, and applying multiple methods over time for stronger evidence. Long-term measurement ideally occurs at national or institutional scale. An example is used to illustrate how short-, mid-, and long-term tools can be integrated to build a comprehensive, multi-point assessment of training impact.