PrEval Symposium 2024
Strengthening Extremism Prevention, Democracy Promotion, and Civic Education through Evaluation
PrEval Symposium 2024 on November 14 and 15 at the VKU Forum in Berlin and via livestream
Promoting learning, building bridges, strengthening prevention – this was and still is the motto of the PrEval Network’s work. It is also the unofficial motto of the PrEval Monitor, which was published at the beginning of November and brings together the project’s findings and recommendations. The Monitor is not a fixed set of recommendations – rather, it is an opportunity for discussion and dialogue, as project coordinator Julian Junk (HöMS/PRIF) emphasized in his opening speech at the PrEval Symposium 2024. PrEval is a “place of learning” that brings together different stakeholders and wants to continue to promote constructive exchange in the field.
Discussion and dialogue were therefore also the focus of the symposium, which was based on the Monitor regarding both content and structure. The PrEval colleagues from GPPi, PRIF and IKG kicked things off. As part of the “Zukunftswerkstatt” on Evaluation Research, they are working on monitoring and analyzing (international) evaluation capacities. Their data show: Evaluation benefits from transparency, independence, an overarching evaluation strategy and sufficient resources. And: networking is worthwhile – as a look at international best practices in the 14 country contexts examined shows. Currently, another PrEval study is being conducted at the University of Duisburg-Essen, which is investigating the relationship between civic education and extremism prevention in different organizational and country contexts. The first results were presented at the symposium.
The focal point of the first day was the welcoming address by State Secretary Juliane Seifert from the Federal Ministry of the Interior and Community (BMI). She spoke of a “democracy to make” instead of a “democracy to go” and emphasized that democracy is actively shaped by its citizens. This also applies to those involved in the prevention of extremism, in democracy promotion and civic education, whose work and contribution to quality management play a key role in strengthening a “democracy under pressure”. The work of the PrEval Network makes an important contribution here, the State Secretary underlined.
Previous trends and new approaches in evaluation research are the focus of the PrEval sub-project at DeZIM. An analysis of the last 20 years shows that particularly mixed methods approaches are gaining in importance and should therefore be part of the standard portfolio of evaluators from now on. Methodological opportunities also arise from new technologies, above all Artificial Intelligence (AI). Jan Ulrich Hense presented initial insights from his “PrEval Expertise”, which is still in progress and deals in detail with the opportunities and limitations of AI in evaluation. One conclusion can be given in advance: the question is not whether AI can be used in evaluation, but rather how it should be used.
The afternoon of the first day was dedicated to the PrEval “Zukunftswerkstätten” on a Helpdesk and Knowledge Networks. Colleagues from Violence Prevention Network and i-unito presented preliminary ideas and proposed formats for the implementation of specific support services and put these up for discussion. One prerequisite emerged as fundamental for all formats: they must be geared towards the needs of practitioners, have a low threshold and ideally be accessible free of charge.
Practitioners, practitioners, and practitioners again: this is the primary target group whose needs are the focus of the evaluation database designed as part of PrEval. Marcus Kober (DFK) presented the results of the previous surveys and thus the prerequisites for needs-based implementation. Andreas Uhl (IKG) then presented an initial version of such a database, which uses AI-supported filtering. It became clear in the discussion with the audience that a database on evaluation experiences cannot and should not stand alone, but must be supplemented by an appropriate accompanying program and suitable formats.
The Symposium’s program concluded with insights into the PrEval pilot studies, which are dedicated to civic education on the one hand and cooperation in security-relevant contexts on the other.
First up was a panel discussion on the evaluation of digital formats of civic education and the digital evaluation of civic education. Andrea Prytula (DeZIM), Susanne Johansson (PRIF), Luisa Schmidt (Das NETTZ) and Marcus Kindlinger (UDE) answered questions from moderator Götz Nordbruch. The central challenge of both pilot studies proved to be that not all methods of analog evaluations can be transferred to the digital space and that evaluations in this context are therefore generally more complex. One of many opportunities, however, would be to playfully link digital evaluation with certain digital content – for example in the context of gaming.
In the last panel of the PrEval Symposium, our colleague Svetla Koynova (Violence Prevention Network), together with experienced practitioners from the “Aussteigerprogramm Sachsen”, shed light on the challenges of impact evaluations in multi-agency approaches. Key findings from the PrEval pilot study were discussed under the title “Who has (how much) impact?” One conclusion arose: whether police, social work or tattoo removals – every level of a support network has an influence on the clients and contributes to the overall result.
The practice partners reported an intensive and enriching exchange in their collaboration with PrEval. In particular, the critical reflection of methods and counseling approaches helped to sharpen their own practice. At the same time, it became clear that many initial concerns – for example about the resources and effort involved in an evaluation – were unfounded.
Juliane Kanitz (i-unito) provided an inspiring conclusion to the Symposium: With an interactive input, she presented an evaluation design that focuses on cooperation between security authorities and civil society. Her core message: in cooperation contexts, evaluation means more than just looking at quality. Reflecting on implicit reservations and expectations is just as important as addressing explicit, visible components – ideally in advance of the actual cooperation.
The PrEval team would like to thank all participants and contributors for an exciting and stimulating Symposium 2024! We look forward to welcoming you again next year. In the meantime, we cordially invite you to participate in PrEval.
Thursday, 14. November 2024
13:00 Uhr
Eröffnung und Vorstellung des PrEval-Monitors
Julian Junk (HöMS/PRIF)
13:30 Uhr
Mapping und Monitoring von Evaluationskapazitäten: Evaluation stärken und weiterentwickeln
Andreas Uhl & Ian Kattein (IKG)
14:15 Uhr
Pause
15:00 Uhr
Grußwort von Staatssekretärin Juliane Seifert (BMI)
15:15 Uhr
Evaluationspraxis international: Erkenntnisse, Trends und Innovationen aus dem Internationalen Monitoring
Sarah Bressan (GPPi), Lotta Rahlf (PRIF), Myrte van Veldhuizen (UDE)
16:15 Uhr
Pause
16:30 Uhr
Entwicklungen und Trends in der internationalen Evaluationsforschung: Von Methoden bis KI
Olaf Kleist (DeZIM) & Jan Ulrich Hense
17:15 Uhr
Unterstützungsformate für lernorientierte Qualitätssicherung und Evaluation: Erfahrungen und Umsetzungshorizonte
Janusz Biene-Clément (i-unito), Moritz Lorenz (i-unito), Maximilian Ruf (Violence Prevention Network), Lina Hartmann (Violence Prevention Network), David Tschöp (Violence Prevention Network)
18:15 Uhr
Austausch und gemeinsames Abendessen
19:00 Uhr
Programmende
Friday, 15. November 2024
9:00 Uhr
Begrüßung
9:15 Uhr
Voraussetzungen und Perspektiven für eine Evaluationsdatenbank
Marcus Kober (DFK), Andreas Uhl (IKG), Julian Junk (HöMS/PRIF)
10:00 Uhr
Evaluieren in konstanter Bewegung: Evaluation politischer Bildung im und zum Digitalen
Susanne Johansson (PRIF), Marcus Kindlinger (Universität Duisburg-Essen), Andrea Prytula (DeZIM), Luisa Schmidt (Das NETTZ), Michelle Chávez (basa e.V.), Götz Nordbruch
10:45 Uhr
Pause
11:15 Uhr
Evaluationsdesigns für Multi-Agency-Kontexte: Empfehlungen für die Umsetzung formativer wirkungsorientierter Evaluationen
Juliane Kanitz (i-unito), Svetla Koynova (Violence Prevention Network) & Aussteigerprogramm Sachsen
12:00 Uhr
Abschluss und gemeinsames Mittagessen
13:00 Uhr
Programmende