European Structural and Investment Funds
Autumn Course | 28.10.2019 - 30.10.2019 | Como | Language: English

Indicators, Monitoring, Evaluation and Performance Audit in ESIF Programme and Project Management

During the interactive Autumn Course you will learn in practice which indicators exist, how to use them, what are the monitoring requirements and systems, which evaluation approaches are available and how to implement them. You will also learn how to procure evaluation services and how to check the results. Finally, you will get acquainted with the auditor´s prospective to monitoring and evaluation.

Download Programme Share

Overview

Monitoring and evaluation is an essential part of management and implementation of European Structural and Investment Funds. The European Union legislation in the programming period 2014-2020 puts a stronger emphasis on monitoring and evaluation than ever before. Join our interactive workshop on Indicators, Monitoring and Evaluation of ESIF Programmes and Projects and get knowledge about:

  • Which obligations do involved authorities have regarding monitoring and evaluation during management and implementation of Operational Programmes and ESIF projects inside OPs?
  • Which indicators exist, what are their role and implications for the project cycle?
  • Which monitoring systems and IT systems exist in order to collect, process and assess data?
  • Which data has to be assessed for the respective evaluation?
  • Which evaluation activities can be conducted internally and which have to be outsourced?
  • How to write terms of reference and procurement of evaluation services?
  • How to manage and steer the work of external evaluation experts?
  • What is the role of process and impact evaluation?
  • What are the most appropriate evaluation methodologies and for which type of operations do they apply?
  • How can beneficiaries reach targets and contribute to the collection of data?
  • What are the reporting responsibilities of the beneficiaries?
  • What should beneficiaries be aware of regarding the control and audit activities of Managing and Audit Authority?
  • How can an Audit Authority include the auditing of indicators and performance in an Audit Strategy?

Workshop Material – No need to miss anything!

If you are unable to make it to the Course you may want to order a copy of the printed material including the access data to all presentations shown during the events. The price is € 199,- (each, excl. of VAT).
If interested, please contact Enrica Corpace.

Topics

This three-day intensive workshop focuses on the following topics:

  • Monitoring and Evaluation (M&E) Framework in the current programming period
  • Consequences of Mid-term evaluation of 2018 and  outlook into ex post evaluation
  • Indicators: how to select, use and implement them
  • Practical exercise on how to define indicators for a specific project/programme and which thresholds have to be met
  • Monitoring: requirements, obligations, systems
  • Collection, processing and assessment of data
  • Best case describing monitoring process through the life cycle of a real life project
  • Assignment of evaluation to external services
  • Writing Terms of Reference and procurement of evaluation services
  • Implementation of evaluation plan
  • Process evaluation and impact evaluation (theory based vs. counterfactual evaluation)
  • Audit of performance data – new responsibility of audit authorities
  • Performance Audit – perspective from the European Court of Auditors

Who should participate?

  • Representatives from public authorities in charge of management, control, monitoring and evaluation of ESI Funds, especially from:
    • Managing Authorities
    • Audit Authorities
    • Intermediate Bodies
    • Regional and local authorities
    • Court of Auditors
  • External evaluators
  • Beneficiaries of EU funded projects, i.e.: Private and public companies, associations, research institutes
  • Bodies working in European Territorial Cooperation
  • Public and private banks and other financial intermediaries
  • International, national and local associations and networks
  • Consultants and lawyers specialised on ESI Funds

Day 1: Monday, 28 October | 08:30 - 17:00

Chair of the Seminar
Bernd Schuh Member of the Board of Directors, Austrian Institute for Regional Studies and Spatial Planning (ÖIR), Vienna
08:45

Registration & Welcome Coffee

09:00

Welcome note by Lexxion and Chair, Introduction Round


Session I: Monitoring and Evaluation (M&E) Framework in the Programming Period 2014-2020 and Outlook into 2021-2027

09:30

Monitoring and Evaluation (M&E) Framework

  • Legal framework of M&E system
  • Role and significance of M&E for Operational Programmes
  • Stakeholders involved and share of obligations
  • Relevant terminology: input, activities, outputs, results, impact
  • Consequences of Mid-term evaluation of 2018 and outlook into ex post evaluation
10:15

Coffee Break


Session II: Indicators

10:45

Indicators – a Tool to Strengthen the Result Orientation

  • The role and selection of indicators: Successful measurement of results and its limits
  • Which indicators exist and how to use them?
  • Selection and implementation of result indicators
  • Use of indicators for different levels of implementation: OPs to priority axes/single projects
  • Measurement and verification of indicators
Bernd Schuh Member of the Board of Directors, Austrian Institute for Regional Studies and Spatial Planning (ÖIR), Vienna
12:45

Lunch

13:45

PRACTICAL GROUP EXERCISE!

How to select and define indicators for a specific project/programme and which thresholds have to be met. Participants will work in groups. Each group will get a project or a programme axis and will define indicators for future evaluations.

Bernd Schuh Member of the Board of Directors, Austrian Institute for Regional Studies and Spatial Planning (ÖIR), Vienna

Session III: Monitoring

14:30

Monitoring in Practice

(incl. Coffee Break)

  • Monitoring requirements and obligations
  • Monitoring systems and IT systems
  • Collection, processing and assessment of data (which data)
  • Data collection tools
  • Monitoring through life cycle of the project
  • Measurement and verification of indicators
16:30

Best Practice

Practical example on monitoring process through the life cycle of a specific project. Speaker will introduce a real-life project/programme axis  and discuss with participants monitoring process through the whole life cycle of the project/programme axis: difficulties, obstacles, challenges.

17:00

End of Day 1

Day 2: Tuesday, 29 October | 08:00 - 16:00

Chair of the Seminar
Bernd Schuh Member of the Board of Directors, Austrian Institute for Regional Studies and Spatial Planning (ÖIR), Vienna

Session IV: Evaluation

09:00

Evaluation in Practice – Step-by-Step Perspective

  • Which activities can be conducted inhouse and which external
  • Contracting out and cooperation with independent external evaluators: What needs to be considered?
  • Drafting Terms of Reference
  • Use of evaluation results
  • ESIF real-life ToR examples
Stanislaw Bienias President of IDEA Institute Ltd. and former Head of the National Evaluation Unit of the Polish Ministry of Regional Development, Warsaw
10:00

How to Implement Evaluation Plan?

  • The role of Evaluation Plan
  • Which evaluation method apply for which type of operation?
  • How to cope with difficulties?
  • Examination of amendment of evaluation plan
Stanislaw Bienias President of IDEA Institute Ltd. and former Head of the National Evaluation Unit of the Polish Ministry of Regional Development, Warsaw
11:00

Coffee Break

11:30

Methodological Approaches in Evaluation of ESI Funds 

Theory based impact evaluation

  • What is “theory” in theory based impact evaluation
  • Foundations of causal inference in theory based impact evaluation
  • Good practice examples

Counterfactual impact evaluation (CIE) – What is it?

  • Random Control Trial as a “golden standard” for analysis of intervention effects
  • Data requirements – precondition for counterfactual impact evaluation
Bernd Schuh Member of the Board of Directors, Austrian Institute for Regional Studies and Spatial Planning (ÖIR), Vienna
Stanislaw Bienias President of IDEA Institute Ltd. and former Head of the National Evaluation Unit of the Polish Ministry of Regional Development, Warsaw
11:45

PRACTICAL EXERCISE!

The participants divided in groups will apply what they learnt on a practical case. The exercise is followed by the presentation of the groups results.

Bernd Schuh Member of the Board of Directors, Austrian Institute for Regional Studies and Spatial Planning (ÖIR), Vienna
Stanislaw Bienias President of IDEA Institute Ltd. and former Head of the National Evaluation Unit of the Polish Ministry of Regional Development, Warsaw
13:00

Lunch break & Networking

14:00

Quasi-experimental methods as a substitute of Random Control Trial

  • linear and non-linear regression
  • difference-in-difference design
  • propensity score matching
  • Practical examples of good practices
Bernd Schuh Member of the Board of Directors, Austrian Institute for Regional Studies and Spatial Planning (ÖIR), Vienna
Stanislaw Bienias President of IDEA Institute Ltd. and former Head of the National Evaluation Unit of the Polish Ministry of Regional Development, Warsaw
15:00

PRACTICAL EXERCISE!

The participants try to apply quasi-experimental approaches in cases in which randomization is not possible. Presentation of the group results and discussion.

Bernd Schuh Member of the Board of Directors, Austrian Institute for Regional Studies and Spatial Planning (ÖIR), Vienna
Stanislaw Bienias President of IDEA Institute Ltd. and former Head of the National Evaluation Unit of the Polish Ministry of Regional Development, Warsaw
15:45

Coffee break

16:00

Processe evaluation of ESIF implementation

  • How process evaluation helps you to increase programme efficiency
  • What aspects of implementation process are worth to be evaluated
  • Good practice examples
Bernd Schuh Member of the Board of Directors, Austrian Institute for Regional Studies and Spatial Planning (ÖIR), Vienna
Stanislaw Bienias President of IDEA Institute Ltd. and former Head of the National Evaluation Unit of the Polish Ministry of Regional Development, Warsaw
16:30

PRACTICAL EXERCISE!

Writing Terms of Reference and Procurement of Evaluation Services in ESIF

  • Use your new knowledge of methods and write your own Terms of Reference for ESIF evaluation
  • Tips and tricks in procurement of evaluation services
Stanislaw Bienias President of IDEA Institute Ltd. and former Head of the National Evaluation Unit of the Polish Ministry of Regional Development, Warsaw
17:30

End of Day 2

Day 3: Wednesday, 30 October

Session V: Auditor’s Perspective to Monitoring and Evaluation

09:00

Audit of Performance Data – New Responsibility of Audit Authorities

  • System audits on performance data reliability
  • Audits of operations with regard to indicators
  • Verification of management declaration
  • Audit opinion: formation and considering fulfilment of indicators
  • Results of the first audits of performance data
Olga Guza Deputy Director of EU Funds Audit Department, Ministry of Finance of the Republic of Latvia
10:30

Coffee Break

11:00

Performance Audit – Perspective from the European Court of Auditors

Performance Audit

  • Different types of audit: Financial, compliance and performance audits
  • Performance audit concepts
  • Performance audit approaches and methodologies; similarities and differences versus evaluation
  • Typical findings from Performance audits in ESIF
Kurt Bungartz Principal Auditor, European Court of Auditors, Luxembourg  
12:45

Best Practice:
Performance auditing in practice – a ‘real life’ performance audit

Results from an audit in the energy policy sector

Kurt Bungartz Principal Auditor, European Court of Auditors, Luxembourg  
13:30

Lunch break

14:30

End of the Training and distribution of Certificates

*Programme might be subject to changes

Speakers

Bernd Schuh
Member of the Board of Directors, Austrian Institute for Regional Studies and Spatial Planning (ÖIR), Vienna

More info
Stanislaw Bienias
President of IDEA Institute Ltd. and former Head of the National Evaluation Unit of the Polish Ministry of Regional Development, Warsaw

More info
Olga Guza
Deputy Director of EU Funds Audit Department, Ministry of Finance of the Republic of Latvia

More info
Kurt Bungartz
Principal Auditor, European Court of Auditors, Luxembourg  

More info

Venue

Lungo Lario Trieste 16
Como, Italy
Loading Map....

Online-Registration

Autumn Course | 28.10.2019 - 30.10.2019 | Como | Language English

Participation Fees
Reduced fee for public authorities: € 2.230,- (excl. VAT)
Regular fee: € 2.630,- (excl. VAT)

10% Summer Discount – Register by 30 August 2019!

The Italian VAT of 22% will be added.

Seating limit
The number of seats is limited. Registrations will be accepted first come, first served.

Are you a public authority?
Ticket Type Price Spaces
Indicators, Monitoring and Evaluation in ESIF Programme and Project Management
Regular fee / Reguläre Teilnahmegebühr
€2.630,00 N/A
Indicators, Monitoring and Evaluation in ESIF Programme and Project Management
Regular fee incl. Early Bird Discount / Reguläre Teilnahmegebühr inkl. Frühbucherrabatt
€2.367,00
Indicators, Monitoring and Evaluation in ESIF Programme and Project Management
Reduced fee for public authorities / Reduzierte Teilnahmegebühr für Hochschulen/Behörden
€2.230,00 N/A
Indicators, Monitoring and Evaluation in ESIF Programme and Project Management
Reduced fee for public authorities incl. Early Bird Discount / Reduzierte Teilnahmegebühr für Hochschulen/Behörden inkl. Frühbucherrabatt
€2.007,00

Group invoice
Single invoices



(Data Privacy Policy)


If you are interested, please use our Newletter to stay informed about our upcoming conferences, workshops, trainings and current published journals in our core areas of EU competition, data protection, substances and environmental law, as well as exciting new projects in emerging technologies and digitalisation.

Don’t miss any news and sign up for our free news alert.  Sign up now