2016/17 Taught Postgraduate Module Catalogue

SLSP5233M Evaluation Research

30 creditsClass Size: 20

Module manager: Joanne Greenhalgh
Email: j.greenhalgh@leeds.ac.uk

Taught: Semester 2 (Jan to Jun) View Timetable

Year running 2016/17

This module is not approved as an Elective

Objectives

This module aims to provide an overview of the theory, methodology, practice and usage of programme and policy evaluation. In recent years there has been a renewed interest in using evidence to support policy and practice development. Policy documents have stressed the need for policies to be both evidence-based and evaluated, so that lessons can be learnt and effectiveness assessed.

The module will introduce the family of methods used to conduct evaluations, including: randomised controlled trials, quasi-experimental methods, formative evaluation, process evaluation, action research, empowerment evaluation, theory-based approaches, realist evaluation, audit and economic evaluation methods. It will also cover some of the approaches used in systematic review, including: meta-analysis, meta-ethnography, realist synthesis.

The course will also cover the issues of how, and the extent to which, evaluation (and policy research more generally) is utilised in the policy making process. The course will address some of the current debates about evaluation including: the trend towards mega and meta evaluations, the professionalisation of evaluation, the need for standards, and so on.

On completion of the course students should have the ability to:
- understand the historical development of evaluation research
- critically evaluate the spectrum of evaluation methods
- critically evaluate the spectrum of methods of research synthesis
- design an evaluation for a typical intervention
- execute key methods and techniques of evaluation research
- conduct a review of the evidence on a family of programmes
- describe and critically evaluate existing programme evaluations
- understand the ways in which evaluation is used in policy making and the barriers to utilisation and dissemination.

Skills outcomes
- Research and analytic skills (students are required to learn how to use evidence systematically and dispassionately in assessing the efficacy of social interventions).
- Data base skills (students are required to use key word searches, to know appropriate data bases and learn how to retrieve documents in order to conduct a systematic review of the evidence base).
- Collaborative skills (student work together in workshop problem solving exercises).
- Writing skills (students are required to produce written material for their assessment).
- Referencing skills (students are required to use academic references in their assessed work).
- Presentational skills (students are required to make two seminar presentations).

Syllabus

- Historical background: the rise, fall and rise of evaluation research.

- Methods of evaluation research and systematic review: randomised controlled trials, quasi-experimental methods, formative evaluation, process evaluation, action research, empowerment evaluation, theory-based approaches, realist evaluation, audit and economic evaluation methods, meta analysis, meta-ethnography, realist synthesis.

- Key concepts: before-and after-measures, black-box, chatty bias, criterion-population designs, conterfactuals, deadweight, displacement, effectiveness, ex-ante and ex-post evaluation, Hawthorne effect, intervention logic, monitoring, outputs and outcomes, pilots, programme theory, research synthesis, sense-making, showcasing, sponsors, stakeholders, summative evaluation, sustainability, target population- validity (internal and external).

- Evaluation and systematic review case studies: CCTV, New Deal for Communities, Head Start, Health Action Zones, Street Lighting, Transitional Aid Research Project, Youth Mentoring, Welfare to Work.

- Evaluation debates: qualitative versus quantitative, process versus outcome, method-driven versus theory-driven, policy-initiated versus user-led, top-down versus bottom-up.

- Utilisation: political impasse and opportunism, quick-and-dirty evaluation, partnerships, user-involvement, presentational effectiveness.

- Stakeholders: the perspectives of policy architects, decision-makers, commissioners, managers, practitioners, end-users and evaluators.

Teaching methods

Delivery type	Number	Length hours	Student hours
Workshop	11	2.00	22.00
Private study hours			278.00
Total Contact hours			22.00
Total hours (100hr per 10 credits)			300.00

Private study

- 4 hours reading course materials per workshop: 44 hours
- 4 hours preparation for workshop exercises per workshop: 44 hours
- 10 hours preparation per presentation: 20 hours
- Preparation and writing for assessed work: 170 hours.

Opportunities for Formative Feedback

- Two group seminar presentations
- Contribution to workshop exercises
- Attendance at seminars and lectures
- Individual advice and tuition is given to students during office hours or on appointment.

Methods of assessment

Coursework

Assessment type	Notes	% of formal assessment
Essay	1 x 6,000 word essay	100.00
Total percentage (Assessment Coursework)		100.00

Normally resits will be assessed by the same methodology as the first attempt, unless otherwise stated

Reading list

The reading list is available from the Library website

Last updated: 04/02/2015

Disclaimer

Browse Other Catalogues

• Undergraduate module catalogue
• Taught Postgraduate module catalogue
• Undergraduate programme catalogue
• Taught Postgraduate programme catalogue

Errors, omissions, failed links etc should be notified to the Catalogue Team.PROD