Public policies and implementation evaluation
Keywords:
Implementation, Public Policies, Policy Analysis, Evaluation, ContextAbstract
The widespread conceptions of implementation as mere administrative and managerial translation of previously for-mulated and adopted policies, and of evaluation as measurement of the intervention effects or of its conformity, present serious limitations. They hinder our understanding of what takes place between planning and its observable effects, implying a reductionism of the political processes involved. This article aims at narrowing the existing gap in the literature in Portuguese language on public policies’ implementation and evaluation, offering an overview of the international literature in the fields of Public Policy Analysis and Program Evaluation. First, the article considers the main debates concerning implementation, taking into account the different generations of studies in this field. Sec-ond, it discusses concepts and perspectives regarding evaluation and its models for context analysis. In conclusion, the article points out that program evaluation cannot be restricted to a ‘managerial’ perspective. According to the authors, challenging the notions of technical rationality and linearity of the processes enhances our interpretative and explana-tory power to understand the political phenomena involved in policy implementation and evaluation.
Downloads
References
ARRETCHE, Marta. (2003), “Dossiê agenda de pesquisa em políticas públicas”. Revista Brasileira de Ciências Sociais, 18, (51): 7-9.
ATKINSON, Sarah; COHN, Amélia et al. (2005), “Implementation of Promotion and Prevention Activities in Decentralized Health Systems: Comparative Case Studies from Chile and Brazil”. Health Promotion International, 20, (2): 167-75.
BARRETT, Susan M. (2004), “Implementation Studies: Time for a Revival? Personal Reflections on 20 Years of Implementation Studies”. Public Administration, 82, (2): 249–262.
BISSET, Sherri; POTVIN, Louise. (2007), “Expanding our Conceptualization of Program Implementation: Lessons from the Genealogy of a School-Based Nutrition Program”. Health Education Research, 22, (5): 737-46.
BROUSSELLE, Astrid; CHAMPAGNE, François. (2007), “How Was the UNAIDS Drug Access Initiative Implemented in Chile?”. Evaluation and Program Planning, 27: 295-308.
BURKE, Peter. (2002), “Context in Context”. Common Knowledge, 8, (1): 152-77.
CHEN, H T. (1990), Theory-Driven evaluations. Newbury Park (EUA), Sage.
DENIS, Jean-Louis; CHAMPAGNE, François. (1997), “Análise da implantação”, in Z. M. A. Hartz (org.), Avaliação em saúde: Dos modelos conceituais à prática na análise de implantação de programas, Rio de Janeiro, Fiocruz.
ELMORE, Richard F. (1980), “Backward Mapping: Implementation Research and Policy Decisions”. Political Science Quaterly, 94, (4): 601-16.
FARIA, Carlos Aurélio Pimenta de. (2003), “Ideias, conhecimento e políticas públicas: Um inventário sucinto das principais vertentes analíticas recentes”. Revista Brasileira de Ciências Sociais, 18, (51): 21-30.
______. (2005), “A política da avaliação de políticas públicas”. Revista Brasileira de Ciências Sociais, 20, (59): 97-109.
FREY, Klaus. (2000), “Políticas Públicas: Um debate conceitual e reflexões referentes à prática da análise de políticas públicas no Brasil”. Planejamento e Políticas Públicas, 21: 211-59.
HARTZ, Zulmira Maria de Araújo; VIEIRA DA SILVA, Ligia Maria. (2005), Avaliação em saúde: Dos modelos teóricos à prática na avaliação de programas e sistemas de saúde. Salvador/Rio de Janeiro, Edufba/Editora Fiocruz.
HOGWOOD, Brian; GUNN, Lewis. (1984), Policy Analysis for the Real World. Oxford (Reino Unido), Oxford University Press.
HOWLETT, Michael; RAMESH, M. et al. (2009), Studying Public Policy: Policy Cycle & Policy Subsystems. Toronto, Oxford University Press.
KINGDON, John W. (1984), Agendas, Alternatives and Public Policies. Boston, Little Brown.
KIVINIEMI, Markku. (1986), “Public Policies and Their Targets: Typology of the Concept of Implementation”. International Social Science Journal, 38, (2): 251-65.
LESSA, Renato. (2011), “Da interpretação à ciência: Por uma história filosófica do conhecimento político no Brasil”. Lua Nova, 82: 17-60.
LIPSKY, Michael. (1980), Street-Level Bureaucracy: Dilemmas of the Individual in Public Services. Nova York, Russel Sage Foundation.
LOVE, Arnold. (2004), “Implementation Evaluation”, in J. S. Wholey; H. P. Hatry; K. E. Newcomer (orgs.), Handbook of Practical Program Evaluation, São Francisco, Jossey-Bass.
MATLAND, Richard E. (1995), “Synthesizing the Implementation Literature: The Ambiguity-Conflict Model of Policy Implementation”. Journal of Public Administration Research and Theory, 5, (2): 145-74.
MAZMANIAN, Daniel; SABATIER, Paul A. (1989), “A Framework for Implementation Analysis”, in D. Mazmanian; P. A. Sabatier (orgs.), Implementation and Public Policy, Lanham (EUA), University Press of America.
MCLAUGHLIN, Milbrey W. (1987). “Learning From Experience: Lessons From Policy Implementation”. Educational Evaluation and Policy Analys, 9, (2): 171-8.
MEDINA, Ana Maria. (1987), “Modelos e lentes: Uma discussão sobre a análise de implementação de políticas públicas”. Análise & Conjuntura, 2, (1): 40-55.
OLIVEIRA, José Antônio Puppim de. (2006), “Desafios do planejamento em políticas públicas: Diferentes visões e práticas”. Revista de Administração Pública, 40, (1): 273-88.
OLIVEIRA, Luisa Gonçalves Dutra de; NATAL, Sonia et al. (2010), “Modelo de avaliação do programa de controle da tuberculose”. Ciência e Saúde Coletiva, 15, supl. 1: 997-1008.
O’TOOLE, Laurence J. (2000), “Research on Policy Implementation: Assessment and Prospects”. Journal of Public
Administration Research and Theory, 10, (2): 263-88.
POLAND, Blake; FROHLICH, Katherine L. et al. (2008), “Context as a Fundamental Dimension of Health Promotion Program Evaluation “, in L. Potvin; D. McQueen (orgs.), Health Promotion Evaluation Practices in the Americas, Nova York, Springer.
POTVIN, Louise; BISSET, Sherri. (2008), “There Is More to Methodology than Method”, in L. Potvin;
D. McQueen (orgs.), Health Promotion Evaluation Practices in the Americas, Nova York, Springer.
POTVIN, Louise, CARGO; Margaret et al. (2003), “Implementing Participatory Intervention and Research in Communities: Lessons from the Kahnawake Schools Diabetes Prevention Project in Canada”. Social Science & Medicine, 56: 1295-305.
PRESSMAN, Jeffrey L.; WILDAVSKY, Aaron. (1984), Implementation: How Great Expectations in Washington Are
Dashed in Oakland. Berkeley, University of California Press.
RICHARD, Lucie; LEHOUX, Pascale et al. (2004), “Implementing the Ecological Approach in Tobacco Control Programs: Results of a Case Study”. Evaluation and Program Planning, 27: 409-21.
SABATIER, Paul A. (2005), “From Policy Implementation to Policy Change: a Personal Odyssey”, in Å. Gornitzka et al. (eds.), Reform and Change in Higher Education: Analysing Policy Implementation, Dordrecht (Países
Baixos), Springer.
SABATIER, Paul A.; JENKINS-SMITH, Hank C. (1999), “The Advocacy Coalition Framework: An Assessment”,
in P. A. Sabatier (org.), Theories of the Policy Process, Boulder (EUA), Westview.
SAETREN, Harald. (2005), “Facts and Myths About Research on Public Policy Implementation: Out-of-Fashion, Allegedly Dead, But Still Very Much Alive and Relevant”. Policy Studies Journal, 33, (4): 559-82.
SEIBEL, Erni José; GELINSKI, Carmen Rosario Ortiz G. (2007), “Concepção do estado e escolha da metodologia de avaliação em políticas públicas”. Trabalho apresentado no 12º Encontro Nacional de Economia Política. São Paulo, Sociedade Brasileira de Economia Política.
SHULOCK, Nancy. (1999), “The Paradox of Policy Analysis: If It Is Not Used, Why Do We produce so Much of It?”. Journal of Policy Analysis and Management, 18, (2): 226-45.
SILVA, Pedro Luiz Barros; MELLO, Marcus André Barreto de. (2000), “O processo de implementação de políticas públicas no Brasil: Características e determinantes da avaliação de programas e projetos”. Caderno NEPPUnicamp, 48: 1-16.
SOUZA, Celina. (2003a), “‘Estado do campo’ da pesquisa em políticas públicas no Brasil”. Revista Brasileira de Ciências Sociais, 18, (51): 15-20.
______. (2003b), “Políticas públicas: Questões temáticas e de pesquisa”. Caderno CRH, 39: 11-24.
______. (2006), “Políticas públicas: Uma revisão da literatura”. Sociologias, 8, (16): 20-45.
______. (2008), “O estado da arte da pesquisa em políticas públicas”, in G. Hochman; M. Arretche; E. Marques (orgs.), Políticas públicas no Brasil, Rio de Janeiro, Editora Fiocruz.
VIANA, Ana Luiza. (1996), “Abordagens metodológicas em políticas públicas”. Revista de Administração Pública, 30, (2): 5-43.
VIANA, Ana Luiza d’Ávila; BAPTISTA, Tatiana Wargas de Faria. (2008), “Análise de políticas de saúde”, in L. Giovanella, S. Escorel et al. (orgs.), Políticas e sistema de saúde no Brasil, Rio de Janeiro, Editora Fiocruz.
VIEIRA DA SILVA, Ligia Maria. (2005), “Conceitos, abordagens e estratégias para a avaliação em saúde”, in Z.
M. A. Hartz; L. M. Vieira da Silva (orgs.), Avaliação em saúde: Dos modelos teóricos à prática na avaliação de programas e sistemas de saúde, Salvador/Rio de Janeiro, Edufba/Editora Fiocruz.
WALT, Gill. (1996), Health Policy: An Introduction to Process and Power. Joanesburgo/Londres: Witwatersrand University Press/Zed Books.