Monitoring, Evaluation and Learning

After a successful collaboration with the Government Office of the Republic of Slovenia for Development and European Cohesion Policy, for whom WYG Consulting conducted an impact evaluation of the Cooperation Programme Interreg V-A Slovenia-Croatia 2014-2020, WYG was awarded a new project in June 2023 - “Management of Capitalisation process for Interreg Programme VI-A Slovenia – Croatia 2021-2027”. The IP SI-HR 2021-2027 aims to achieve a preserved, resilient, and connected cross-border region where sustainable development is recognised and used as a main tool in reaching all inhabitants' economic viability, safety, biodiversity protection, and social well-being.

This project will be implemented throughout the following 12 months for the Client, Slovenian Ministry of Cohesion and Regional Development. During the implementation we will prepare data analysis according to individual programme-specific objectives for the programme period 2014-2020; generate a user-friendly online publication projects database to publish on the Programme Slovenia – Croatia website; implement 2 different bilingual (SI-HR) thematical workshops and provide recommendations in the Capitalisation Manual for the implementation of the IP SI-HR 2021-2027.

In May 2023, WYG Consulting was successfully awarded with four-month contract by Lux Development (LuxDev) for conducting the final evaluation of the project „Support to Vocational Education and Training Reform in Kosovo (Phase II)” that is a logical answer to detected problems in the VET system in Kosovo and a continuation of Phase I of the same Project, led by Ministry of Education, Science, Technology and Innovation in Kosovo (MESTI) and implemented by LuxDev, executing agency for the bilateral cooperation programmes funded by Luxembourg government. Project KSV/020 (Phase II) primarily focused on enhancing the structure and performance of the Technical and Vocational Education and Training (TVET) system and its delivery in Kosovo, in alignment with Sustainable Development Goal (SDG) 4, which promotes inclusive and quality education and lifelong learning for all.

This final evaluation covered the whole implementation period of the project from 1st July 2018 until 30 June 2023 (60 months) and it assessed the relevance, coherence, effectiveness, efficiency, sustainability and cross-cutting issues of the intervention. Our team has conducted detailed quantitative and qualitative research, including interviews with government stakeholders and development partners, focus groups with project beneficiaries, field visits to involved schools and a review of project documents, and provided LuxDev with recommendations directed toward guiding the work of their formulation team and implementation team of the next project.

Executive Summary of this evaluation is available at the following link:

https://luxdev.lu/files/documents/KSV020_EF_EN.pdf

The purpose of the thematic evaluation of the Operational Program for Food and or Basic Material Assistance (OP FEAD) was to cover both types of interventions supported through FEAD - specifically projects implemented through the calls "Providing school meals for children at risk of poverty" (4 calls) and "Poverty alleviation by providing assistance to the most deprived by distributing food and/or basic material assistance" (2 calls) and evaluate their effectiveness. The evaluation sought to assess how the support provided through the implementation of FEAD-funded project activities contributed to the objectives of the Operational Program.

The thematic evaluation of FEAD was conducted using an interdisciplinary and participatory methodology that included qualitative and quantitative research methods. The methodology included the following methods: literature analysis, analysis of key documents, statistics, quantitative research through questionnaires (partner organizations), conducting interviews with partner organizations and conducting territorial analysis. In addition, 4 case studies of projects funded under these FEAD calls have been further developed.

This evaluation was conducted for the Client, the Croatian Ministry of Labour, Pension System, Family and Social Policy.

The evaluation assessed the effectiveness, impact and efficiency of planned and used funds, as well as set and achieved goals and results related to increasing employment and employability under Priority Axis 1 of Operational Programme Efficient Human Resources 2014-2020 (OPEHR). The specific objectives of this evaluation were as follows: to compare the planned and achieved results and objectives of the implementation of the OPEHR in PA 1 and thus assess the extent to which the objectives have been achieved, i.e. indicators at the level of individual-specific objectives; to know and evaluate procedural practices and methodology of implementation of OPEHR within PA 1; assess and evaluate the established implementation structure and its effectiveness in the implementation of planned calls and operations under the OPEHR; contribute to the quality of the new OP planned for the next financial period (2021-2027)

For the purpose of conducting the evaluation, the Service Provider was obliged to evaluate Priority Axis 1 - High employability and labour mobility, the total value of which is EUR 568,051,181. Value of the Priority Axis High employability and labour mobility includes investment priorities and related specific objectives such as facilitating access to employment for jobseekers and inactive people, increasing sustainable self-employment and employment of the unemployed, preserving jobs, retaining redundant workers, modernization of labour market institutions and better harmonization with labour market needs, etc.

WYG Consulting is conducting Impact Evaluation of the Cooperation Programme Interreg V-A Slovenia-Croatia 2014-2020. The Contracting Authority is Government Office of the Republic of Slovenia for Development and European Cohesion Policy. Cross-border cooperation between Slovenia and Croatia has been supported since 2003 under several EU instruments, like PHARE/CARDS, trilateral Neighbourhood Programme and IPA.

During one-year evaluation, WYG’s team will assess the relevance, sustainability and impact of the programme results and outputs, while also preparing the recommendations for the future cross-border programme between Slovenia and Croatia 2021-2027. The Impact evaluation will be carried out using a theory-based approach which will result in the identification of causal links between inputs, activities, outcomes, and impacts. The following methods are most commonly used in theory-based approach: standardised surveys, literature analysis, interviews, focus groups and case studies that allow for qualitative impact evaluation.

Regions with specific territorial features have received increasing attention in recent years, most notably in article 174 of the Treaty on the Functioning of the European Union (TFEU).
Gaining a better understanding of the territories with geographic specificities and their relevant challenges and opportunities is therefore crucial for the European policy dialogue and debate for developing Cohesion Policy post-2020 and a renewed Territorial Agenda for Europe which is due to be adopted by 2021.
The following types of territories constitute the main focus for this project: sparsely populated regions; mountain regions; Islands, including island-states and coastal areas.

The policy analysis responded to following questions:

• What does insularity, peripherality, remoteness, accessibility, vulnerability, attractiveness, lack of critical mass mean for territories with geographic specificities?
• How does it impact the competitiveness, quality of life and sustainable growth of these territories?
• Where and how is public intervention required?
• How can place-based, smart and integrated approaches support the challenges encountered by territories with geographic specificities?
• How can territorial cooperation contribute to strengthening the capacity of local and regional authorities to identify their growth potentials and formulate development strategies

WYG Consulting was a partner in this research project, led by Spatial Foresight.

Project value: 641.978 EUR

The Effective Human Resources 2014-2020 Operational Programme (OPEHR) aims to help create jobs and strengthen social cohesion in Croatia by allowing local institutions to effectively take advantage of the European Social Fund. In order to evaluate how effectively the measures and activities described in OPEHR are being implemented in Croatia on the regional and local levels, Croatia’s Ministry of Labour and Pension System designed this project, which is being carried out by WYG in collaboration with MAP Consulting Ltd. Our team has conducted detailed quantitative and qualitative research, including in-depth interviews with stakeholders and a thorough review of programme documents, in order to provide the ministry with reports and recommendations for future measures and activities.

Priority Axis 2 of the Effective Human Resources 2014-2020 Operational Programme (OPEHR) is intended to support socially vulnerable groups by improving their access to employment, developing community-level social services to improve general employability, and increasing participation, awareness, and social inclusion. To determine how activities within this priority axis have contributed to planned changes, the Croatian Ministry of Labour and Pension System has designed a 15-month evaluation project, which is being managed by WYG Consulting. Our team’s in-depth qualitative and quantitative research gave the Ministry clearer insight into the effectiveness of measures, allowing them to adjust their measures and activities in the future to improve results on the ground.

The Interreg IPA programmes are designed to promote employment, labour mobility, and social and cultural inclusion across borders. As part of a broad evaluation process, the Croatian Ministry of Regional Development and EU Funds issued a contract to appraise how well these programmes are managed and implemented. In cooperation with partner t33 Srl., WYG’s team conducted surveys, case studies, interviews, and documentation analysis to evaluate the Interreg IPA programmes, examining the details of numerous aspects of the programmes ranging from human resources and tender procedures to decision-making processes and implementation monitoring. After compiling a final report, our findings were presented to the Joint Monitoring Committee of each of these three regional programmes.