1 Evaluering i Europa-kommissionen : Udvikling af et system til evaluering af mangesidige politikker og forskelligartede implementeringsmetoder Svend Jakobsen, DG Budgets evalueringskontor Dansk Evalueringsselskabs konference 15 september 2007, Kolding

2 Oversigt  Professionalisering i Europa-kommissionen?  Paralleller mellem EU og DK? N u tale om... hvad evalueres? hvem evaluerer, organisation? hvilke regler er der? hvordan evalueres der? anvendelse af evalueringsresultater Paralellesession …

3 EU arbejdsområder  Søjler: • klassisk EU-samarbejde (indre marked, fiskeripolitik, landbrugspolitik…) - overstatslig • fælles udenrigs- & sikkerhedspolitik - mellemstatslig • politi- & retssamarbejde - mellemstatslig  Policy Areas: • Landbrug, handel, konkurrence, fiskeri … • Regionalpolitik, forskning, kultur & uddannelse, udviklingshjælp …  Instrumenter: • forordninger / direktiver (transposition) • Implementeringsmetoder (centralised direct/indirect, shared, decentralised, joint) • styringsniveauer (Kommissionen, regeringer, regionalt….) H V A D E V A L U E R E S ?

4 Implementeringsmetoder for budgettet H V A D E V A L U E R E S ?

5 FORMÅL MED EVALUERING I KOMMISSIONEN • design af nye / fornyede tiltag • støtte til fordeling af resourcer • forbedre kvaliteten af tiltag • rapportering om hvor vellykkede tiltagene var (accountability, awareness)

6  Et uniformt systemet?  Historie: • sektoriel begyndelse • sound & efficient management (1996) - generalisering af evaluering • reform af Kommissionen (hvidbog, ABM, intern kontrol) • Better Regulation E T D E C E N T R A L T S Y S T E M M E D C E N T R A L K O O R D I N E R I N G

7  Kommissionens evalueringssystem: • decentrale evalueringsfunktioner i Generaldirektoraterne • central støtte & koordinering • netværk • normer & procedurer K O M M I S S I O N E N S E V A L U E R I N G S S Y S T E M

8 Rules & norms on evaluation: • Commitment • Flexibility Evaluation capacity: • ‘Functions' • Network • Coordination Reliable evaluations Scope: • Instrument focus • Strategic elements Coverage: • Expenditure • Legislation & soft law Evaluations carried out: Evaluation results available to internal & external stakeholders Cross-cutting analysis & syntheses Spending wiser European citizens confident Quality assurance Evaluation planning Monitoring & follow-up Better regulation Cost effective evaluation Legislative Financial Statements & explanatory memoranda Managerial & process use Instrument level use Activity Statements Annual Evaluation Review & Ad hoc Highlights Cross-cutting & strategic use in (planning-, budgetary- and legislative cycles) Performance on strategic objectives Evaluation capacity Evaluations carried out Dissemination & secondary analysis Use of resultsImpact in outside world

9  Organisation (centraliseret, intra-DG netværk, inter-DG, eksternt).  Opgaver: • evalueringsplanlægning • udføre / koordinere evalueringer • anvendelse af resultater, opfølgning • fremme af kvalitet, organisational learning E V A L U E R I N G S F U N T I O N E R I T J E N E S T E G R E N E N E

10  normer, vejledninger  træning, seminarer  fremme af god evalueringspraksis  praktisk hjælp (fortolkning, styregrupper, udbud…)  evalueringsplanlægning  aktivitetsoversigt (monitering, rapportering)  tværgående syntese af resultater  anvendelse af resultater i lovgivnings-, budget- & planlægningsprocesser C E N T R A L S T ø T T E & K O O R D I N E R I N G

11 DG BUDG Evaluation Unit The evaluation unit in DG BUDG Co-ordination of Commission's evaluation network Guidance and support Studies/reports related to evaluation Evaluation overview Follow evaluation activities Support to SPP & budgetary processes Evaluation planning Synthesis Annual Evaluation Review Evaluation highlights Manuals Websites Training Exchange of good practice Procurement support

12  Finansforordningen & Gennemførelsesbestemmelser  Kommunikation om Evaluering (incl. Evalueringsstandarder)  Impact Assessment  Interne Kontrol Standarder  Activity Based Management  Lovgivningsprocessen N O R M E R & P R O C E D U R E R

13 ANNUAL POLICY STRATEGY (APS) PRELIMINARY DRAFT BUDGET APS "PLUS" COMMISSION WORK PROGRAMME ANNUAL MANAGEMENT PLANS OF DGs IMPLEMEN- TATION ANNUAL ACTIVITY REPORTS Justify proposed action Plan future evaluations Give account Improve design of proposals Evaluation & Strategic Planning and Programming Cycle N O R M E R & P R O C E D U R E R

14 NY EVALUERINGSKOMMUNIKATION Key Messages: •Relevant coverage – consider all activities for evaluation •Focus on strategic objectives •Relevant timing - meet the decision-making needs •Integrating evaluation in policy cycle •Communication of evaluation results

15 NY EVALUERINGSKOMMUNIKATION Main tools: • Action Plan •Revised version of the Commission's Evaluation Standards – new structure, reduced number of standards

16  hovedreglerne godkendt af: Rådet, Parlament, Kollegiet af kommissærer  planmæssige evaluerings aktiviteter (hvad evalueres, organisation / fremgangsmåder, anvendelse)  evalueringsplanlægning og anvendelse af resultaterne er integreret i årlig planlægningscyklus  evalueringsresultater rapporteres til lovgivnings- og budgetmyndigheden I N S T I T U T I O N A L I S E R E T

17 LIDT T A L …. EVALUERINGER

18 LIDT T A L …. EVALUERINGER

19 European Commission DG Budget – Evaluation Unit Prospektiv % Retro- spektiv % Expenditure programmes1859 Regulatory measures5310 Strategic & thematic issues1615 Service provision & policies internal to the Commission 912 Agencies21 Pilot projects & preparatory acts23 (retrospective includes those with both retrospective and prospective scopes) TEMAER FOR EVALUERING (2006)

20 LIDT T A L …. – Evolution of cost of evaluation with external experts since 1996: average/median

21 A F S L U T N I N G Evaluation policy established √√ Evaluation culture √ Challenges for the future •Further improve quality •Increase coverage of legislation & other non-spending activities •Increase dissemination & use

22 Y D E R L I G E R E I N F O R M A T I O N