The nature, presentation and use of findings from realist evaluation 6. realist evaluation is a specific type of theory-based evaluation. Strategies and methods of realist evaluation 4. 391â416) Paper by Trisha Greenhalgh about applying realist evaluation to understand a range of factors supporting change across four large health care organisations and their delivery of three areas of health services. 3. Realist methodologies are increasingly being used to evaluate complex interventions in health and social care. Realistic evaluation: by Ray Pawson and Nick Tilley, Sage Publications, 1997, 235 pp Figure 2: the Realist evaluation cycle. This means understanding what works, in which circumstances, and for whom. The second step is to develop CMO hypotheses that the evaluator thinks should be tested. 87, No. Conclusions This realist evaluation substantiates the literature and reveals deeper understandings about quality assuring medical education. Realist evaluation itself is a particular evaluation theory. Can provide generalisable insights on how to scale a programme up or roll it out to different contexts, therefore provides findings with external validity. How Do You Modernize a Health Service: a Realist Evaluation of Whole-Scale Transformation in London The Milbank Quarterly, Vol. Realist evaluation is a largely qualitative approach to developing, testing and refining ideas or theories about the effectiveness of certain interventions or programs in the real world.12 Drawing on the philosophical position of realism, the realist evaluation approach focuses particular attention on â¦ Realist evaluation is an approach within theory-driven evaluation . Ethnographic methods comprising participant observation, interviews, and focus groups were employed over 15 weeks in the field. Kazi et al. â¦ Briefly consider a realist research design. This second evaluation involves conducting four case studies, each one involving one CC group, from initiation to completion of a behavior change â¦ I hope that your Society thrives and that you spend some time working out ways in which evaluation can best serve the needs of your communities. In stage 1, â¦ Realist Evaluation develops a particular kind of programme theory, structured as Context- Mechanism-Outcome Configuration (CMOCs). The nature of programmes and how they work 2. Interviews were held with staff from the SN teams and managers, both on an individual basis and in groups. 7. The second realist evaluation study explore: How, why, and for whom a community engagement intervention (titled Community Conversations [CCs]) influences behavior change communication for health within Marsabit, Kenya. Why choose realist evaluation? Consider, in some detail, five principles of realist methodology, which may be applied to research practice including evaluation. conduct of the qualitative interview within a realist evaluation research study, and it will focus exclusively on Pawsonâs approach to realist qualitative interviewing. For us, this means that what manifests in terms of CBPR process and outcomes can be understood in terms of layers of reality. Realist evaluation is a theory-driven approach, rooted in a realist philosophy of science, which emphasises an understanding of causation and how causal mechanisms are shaped and constrained by context. One can find, however, several self-professed realist studies that lack this essential process. Contents: Introduction 1. (2011) provide a typical example. Basic concepts in the explanation and understanding of programmes 3. The information gathered was analysed in accordance with realist evaluation methodology. TCAT is a five year programme funded by Macmillan Cancer Support. < i> Realistic evaluation: by Ray Pawson and Nick Tilley, Sage Publications, 1997, 235 pp A REALIST EVALUATION OF THE PROCESSES AND OUTCOMES OF INFANT MASSAGE PROGRAMS ANGELA UNDERDOWN University of Warwick RHONDA NORWOOD Louisiana State University JANE BARLOW University of Warwick ABSTRACT: The sensitivity of early interactions conveyed through eye contact, voice tone, facial expression, and gentle touch plays a crucial role in â¦ Realist evaluation uses a theory-driven approach to evaluate healthcare or social programmes. This realist evaluation (RE) is located within a 5 year na-tional programme of Transforming Care After Treat-ment in Scotland (TCAT) [24, 25]. Realist evaluation framework is particularly suited for unpacking how contextual factors and intervention mechanisms or processes influence the outcome [23, 25]. Propositions 1-3 . â¢ Realist evaluation is useful when we donât yet understand how, why and for whom programmes work/donât workâ¦ And when we want to know how to adapt a programme to new contexts and new people 4 . Realistic Evaluation, Pawson & Tilley, 2001), focussing on the identification of processes and contexts supportive of reflective practice, would contribute to the development of knowledge in the field. 1998) and Realistic Evaluation (Pawson and Tilley, 1997). The theory is then translated into CMO terminology. The second report (Chapter 3) provides an account of an illuminative small scale research study. This introduction will help evaluators and commissioners of evaluations to decide whether a realist approach is appropriate for evaluating the impact of â¦ current realist evaluation position is weak, and discuss the methodological consequences of taking a critical realist approach to them. The reader should note, additionally, that there are several approaches to realist evaluation (e.g., Henry, Julnes, and Mark, 1998) and to qualitative research (e.g., Hammersley, 1992, 2008; Maxwell, 2012, 2013). Routine communication is beneficial to verify data, share concerns and check risk; however, ongoing partnership working can foster assurance. Methods/design: This mixed method realist evaluation will develop theories about the relationship between the context, mechanisms and outcomes of the diabetes programme. Programme theory (ideas and assumptions of how a particular intervention works) development is the first step in a realist evaluation or a realist synthesis, with literature reviews providing important evidence to support this. Realist evaluation is avowedly theory-driven; it searches for and refines explanations of programme effectiveness. Realist evaluation follows a cycle as shown in figure 2: 9 . It is based on a philosophy (realism), and is primarily concerned with identifying causal mechanisms. Realist Research and Evaluation FIVE DAY INTENSIVE WORKSHOP 30 September - 4 October 2019 (La Trobe University, Melbourne) _____ This intensive workshop will introduce participants to the philosophical assumptions of a realist philosophy of science and their implications for understanding how policies and programs work. The evaluation traces the outcome patterns associated with a care coordination programme called âWraparoundâ. Presented at the Founding Conference of the Danish Evaluation Society, September 2000 Thank you very much for inviting me to speak at the Inaugural Conference of the Danish Evaluation Society. Realist evaluation acknowledges âontological depthâ, . This makes it particularly suitable for evaluations of certain topics and questions â for example, complex interventions and programmes that involve human decisions and actions. Realist impact evaluation is an approach to impact evaluation that emphasises the importance of context for programme outcomes. Thus, its focus is on not just whether or not a programme such as an NZ regional DHB grouping âworksâ but how, for whom and in what contexts it âworksâ. This realist evaluation protocol sets out the approach that will be used to identify and explain which aspects of the programme are working, for whom and in what circumstances to produce the outcomes intended. Methods: This study was designed as a realist evaluation. Participant recruitment occurred through purposive and theoretical sampling of children and parents participating in the Local Environment Model intervention at Beitostolen Healthsports Centre in Norway. 2, 2009 (pp. Where relevant to our discussions we highlight instances of later reï¬ nements. REALIST EVALUATION â¢Drawn from Pawson and Tilleyâs âRealistic Evaluationâ (1997) â¢Realism is a school of philosophy and sits between positivism and constructivism â¢A member of the family of theory-based evaluation approaches - start by clarifying the âprogram theoryâ 1999); the evaluation researchers Pawson and Tilley (1997; Pawson, 2006) and Henry, Julnes, and Mark (1998; Mark, Henry, & Julnes, 2000); and the quali- tative researchers Huberman and Miles (1985; Miles & Huberman 1994) and Hammersley (1992a, 1998, 2002, 2009). Keywords: Realist evaluation, context and mechanisms, curriculum evaluation, curriculum model, realist program theory, formal theory in realist evaluation, curriculum model abstract Realist evaluation is based on the premise that aspects of context trigger particular mechanisms in response to an intervention, which result in observable outcomes. Realism's place in the policy cycle: formative, summative and synthetic approaches 5. We have organized the article in four main sections. Realist evaluation 24 is a theory-driven evaluation approach 25 used to understand how, for whom and in what circumstances an intervention âworksâ to produce intended outcomes. Lastly, substantive theory feeds realist evaluation with clues on the mechanisms (e.g. While standardised approaches are implemented, interventions need to be contextually proportionate. In addition, to aid explan-ation we have used a hypothetical smoking cessation programme to illustrate the issues that we discuss. In 2018, the Realist Evaluation Learning Group was formed to discuss and reflect on Itadâs experiences and distil what has been learned along the way.2 This paper presents examples and lessons from four evaluations: BCURE (2013â18). In this cycle, the first step is to understand the formal theory upon which the programme is based.