Evaluación de impacto de políticas públicas agrícolas: una revisión sistemática de literatura
##plugins.themes.bootstrap3.article.details##
La práctica de la evaluación de impacto de políticas experimenta un aumento debido a que los organismos internacionales y la comunidad académica son cada vez más conscientes de la necesidad de mejorar las evidencias con las que se formulan y ajustan las políticas. Asimismo, es necesario que las políticas agrícolas promuevan la sostenibilidad agrícola que es socialmente justa, ecológica y económicamente viable. No obstante, la sostenibilidad incluye incertidumbres, complejidad y es multidimensional. Por lo tanto, esta investigación busca conocer el estado actual de la discusión sobre las dimensiones que inciden en la evaluación de impacto de las políticas públicas agrícolas. Se realiza una revisión sistemática de literatura mediante un enfoque mixto secuencial, primero, cuantitativo mediante un análisis bibliométrico, segundo, cualitativo con un análisis de contenido utilizando las técnicas de PRISMA y Snowball para definir la muestra de 80 documentos. Los resultados indican que las dimensiones que inciden en la evaluación de impacto de las políticas agrícolas son la social, ambiental, económica, cultural e institucional, además, se vincula el desempeño de la gobernanza en la forma como se producen los efectos. La propuesta permite la estimación profunda de los impactos de una política agrícola. Las implicaciones teóricas giran en torno a que la sostenibilidad se debe comprender más allá de las tres dimensiones clásicas y abarca las dimensiones cultural e institucional, asimismo, propone que la evaluación de una política integre los tres momentos de la evaluación. Se recomienda realizar la verificación empírica del modelo conceptual propuesto.
Impact Assessment, Public Policies, Sustainable Rural Development, Collaborative Governanceevaluación de impacto, políticas públicas, desarrollo rural sostenible, gobernanza colaborativa
Alvarez, S., Douthwaite, B., Thiele, G., Mackay, R., Córdoba, D., & Tehelen, K. (2010). Participatory Impact Pathways Analysis: a practical method for project planning and evaluation. Development in Practice, 20(8), 946–958. https://doi.org/10.1080/09614524.2010.513723
Androutsopoulou, A., Charalabidis, Y., & Loukis, E. N. (2015). Using Social Media Monitoring for Public Policy Making: An Evaluation. 9th Mediterranean Conference on Information Systems (MCIS).
Ansell, C., Sørensen, E., & Torfing, J. (2017). Improving policy implementation through collaborative policymaking. Policy and Politics, 45(3), 467–486. https://doi.org/10.1332/030557317X14972799760260
Arias, C. R., Serrano, J. E., & García, J. (2014). Evaluation of social public policy: Department of social development in Honduras. 1st International Conference on EDemocracy and EGovernment, ICEDEG 2014. https://doi.org/10.1109/ICEDEG.2014.6819969
Banco Mundial. (2004). Seguimiento y Evaluación: instrumentos, métodos y enfoques.
Ben, R., Nithin, S. P., Pranav, K., & Jayasuryaa, J. (2020). Assessment of environmental sustainability for promoting green materials and practices. Materials Today: Proceedings. https://doi.org/10.1016/J.MATPR.2020.09.357
Bergtold, J. S., Caldas, M. M., Ramsey, S. M., Sanderson, M. R., Granco, G., & Mather, M. E. (2022). The gap between experts, farmers and non-farmers on perceived environmental vulnerability and the influence of values and beliefs. Journal of Environmental Management, 316(April), 115186. https://doi.org/10.1016/j.jenvman.2022.115186
Blamey, A., & Mackenzie, M. (2007). Theories of Change and Realistic Evaluation Peas in a Pod or Apples and Oranges? Evaluation, 13(4), 439–455. https://doi.org/10.1177/1356389007082129
Bond, A., Morrison-Saunders, A., & Pope, J. (2012). Sustainability assessment: The state of the art. Impact Assessment and Project Appraisal, 30(1), 53–62. https://doi.org/10.1080/14615517.2012.661974
Brown, D. (1998). Evaluating institutional sustainability in development programmes: beyond dollars and cents. Journal of International Development, 10(1), 55–69. https://doi.org/https://doi.org/10.1002/(SICI)1099-1328(199801)10:1%3C55::AID-JID452%3E3.0.CO;2-W
Caffrey, L., & Munro, E. (2017). A systems approach to policy evaluation. Evaluation, 23(4), 463–478. https://doi.org/10.1177/1356389017730727
Castaño, J., Blanco, M., & Martínez, P. (2019). Reviewing counterfactual analyses to assess impacts of EU rural development programmes: What lessons can be learned from the 2007-2013 Ex-post evaluations? Sustainability (Switzerland), 11(4), 1–22. https://doi.org/10.3390/su11041105
Caurla, S., Delacote, P., Lecocq, F., & Barkaoui, A. (2013). Stimulating fuelwood consumption through public policies: An assessment of economic and resource impacts based on the French Forest Sector Model. Energy Policy, 63(2013), 338–347. https://doi.org/10.1016/j.enpol.2013.07.111
Cejudo, G. M., & Michel, C. L. (2016). Coherencia y políticas públicas: Metas, instrumentos y poblaciones objetivo. Gestión y Política Pública, 25(1), 03–31.
Cisilino, F., Bodini, A., & Zanoli, A. (2019). Rural development programs’ impact on environment: An ex-post evaluation of organic faming. Land Use Policy, 85(2019), 454–462. https://doi.org/10.1016/j.landusepol.2019.04.016
Colavitti, A., Usai, A., & Serra, S. (2018). Towards an Integrated Assessment of the Cultural Ecosystem Services in the Policy-Making for Urban Ecosystems: Lessons from the Spatial and Economic Planning for Landscape and Cultural Heritage in Tuscany and Apulia (IT). Planning Practice and Research, 33(4), 441–473. https://doi.org/10.1080/02697459.2018.1510275
Cosyns, H., Damme, P. Van, & Wulf, R. De. (2013). Who views what? Impact assessment through the eyes of farmers, development organization staff and researchers. International Journal of Sustainable Development and World Ecology, 20(4), 287–301. https://doi.org/10.1080/13504509.2013.806372
Cridland, W., Adeniyi, P., Bullock, R., & Mitchell, B. (1995). Sustainable rural development in Sokoto State, Nigeria: An assessment of institutional arrangements and management practices. Natural Resources Forum, 19(3), 203–214. https://doi.org/10.1111/j.1477-8947.1995.tb00610.x
Czyżewski, B., Matuszczak, A., Grzelak, A., Guth, M., & Majchrzak, A. (2021). Environmental sustainable value in agriculture revisited: How does Common Agricultural Policy contribute to eco-efficiency? Sustainability Science, 16(1), 137–152. https://doi.org/10.1007/s11625-020-00834-6
Devkota, R., Pant, L. P., Hambly Odame, H., Rai Paudyal, B., & Bronson, K. (2022). Rethinking gender mainstreaming in agricultural innovation policy in Nepal: a critical gender analysis. Agriculture and Human Values, 39(4), 1373–1390. https://doi.org/10.1007/s10460-022-10326-1
Duriau, V. J., Reger, R. K., & Pfarrer, M. D. (2007). A Content Analysis of the Content Analysis Literature in Organization Studies: Research Themes, Data Sources, and Methodological Refinements. Organizational Research Methods, 10(1), 5–34. https://doi.org/10.1177/1094428106289252
Duxbury, N., Kangas, A., & De Beukelaer, C. (2017). Cultural policies for sustainable development: four strategic paths. International Journal of Cultural Policy, 23(2), 214–230. https://doi.org/10.1080/10286632.2017.1280789
Emaides, A., Salerno, M. L., & Paredes, M. D. (2018). Políticas públicas para el desarrollo sustentable: indicadores de gestión ambiental. InterNaciones, 5(13), 131–158. https://doi.org/10.32870/in.v5i13.7069
Emerson, K., & Nabatchi, T. (2015a). Collaborative Governance Regimes (1era ed.). Georgetown University Press.
Emerson, K., & Nabatchi, T. (2015b). Evaluating the Productivity of Collaborative Governance Regimes : A Performance Matrix. Public Performance & Management Review, 38(4), 717–747. https://doi.org/10.1080/15309576.2015.1031016
Emerson, K., Nabatchi, T., & Balogh, S. (2012). An Integrative Framework for Collaborative Governance. Journal of Public Administration Research and Theory, 22(1), 1–29. https://doi.org/10.1093/jopart/mur011
Erbaugh, J., Bierbaum, R., Castilleja, G., Da Fonseca, G. A. B., Cole, S., & Hansen, B. (2019). Toward sustainable agriculture in the tropics. World Development, 121, 158–162. https://doi.org/10.1016/j.worlddev.2019.05.002
Fiszbein, A. (2006). Development impact evaluation: New trends and challenges. Evidence and Policy, 2(3), 385–393. https://doi.org/10.1332/174426406778023702
Gioia, D. A., Corley, K. G., & Hamilton, A. L. (2013). Seeking Qualitative Rigor in Inductive Research. Organizational Research Methods, 16(1), 15–31. https://doi.org/10.1177/1094428112452151
Guzmán-León, A. (2016). Comparar para construir política pública en tiempos de globalización. Revista Iberoamericana de Educacion Superior, 7(20), 135–156.
Haines-Young, R., & Potschin, M. (2013). Common International Classification of Ecosystem Services (CICES): Consultation on Version 4, August-December 2012. www.cices.eu
Helming, K., Diehl, K., Bach, H., Dilly, O., König, B., Kuhlman, T., Pérez, M., Sieber, S., Tabbush, P., Tscherning, K., Wascher, D., & Wiggering, H. (2011). Ex Ante Impact Assessment of Policies Affecting Land Use, Part A: Analytical Framework. Ecology and Society, 16(1).
Hou, D., Ding, Z., Li, G., Wu, L., Hu, P., Guo, G., Wang, X., Ma, Y., O’Connor, D., & Wang, X. (2018). A Sustainability Assessment Framework for Agricultural Land Remediation in China. Land Degradation and Development, 29(4), 1005–1018. https://doi.org/https://doi.org/10.1002/ldr.2748
Hristov, I., Appolloni, A., Chirico, A., & Cheng, W. (2021). The role of the environmental dimension in the performance management system: A systematic review and conceptual framework. Journal of Cleaner Production, 293, 126075. https://doi.org/10.1016/j.jclepro.2021.126075
Jaijit, S., Paoprasert, N., & Pichitlamken, J. (2020). Economic and social impact assessment of rice research funding in Thailand using the structural equation modeling technique. Kasetsart Journal of Social Sciences, 41(1), 187–193. https://doi.org/10.1016/j.kjss.2018.06.002
Janker, J., & Mann, S. (2020). Understanding the social dimension of sustainability in agriculture: a critical review of sustainability assessment tools. Environment, Development and Sustainability, 22, 1671–1691. https://doi.org/10.1007/s10668-018-0282-0
Janker, J., Mann, S., & Rist, S. (2019). Social sustainability in agriculture – A system-based framework. Journal of Rural Studies, 65, 32–42. https://doi.org/10.1016/j.jrurstud.2018.12.010
Jensen, P. H. (2020). Experiments and evaluation of public policies: Methods, implementation, and challenges. Australian Journal of Public Administration, 79(2), 259–268. https://doi.org/10.1111/1467-8500.12406
Johnson, H., & Wilson, G. (2000). Institutional sustainability: “community” and waste management in Zimbabwe. Futures, 32(3), 301–316. https://doi.org/https://doi.org/10.1016/S0016-3287(99)00099-3
Jones, N., Malesios, C., Aloupi, M., Proikaki, M., Tsalis, T., Chatziantoniou, M., Dimitrakopoulos, P., Skouloudis, A., Holtvoeth, J., Nikolaou, I., Stasinakis, A., Kalantzi, O., Gatidou, G., Zkeri, E., Koulousaris, M., & Evangelinos, K. I. (2019). Exploring the role of local community perceptions in sustainability measurements. International Journal of Sustainable Development and World Ecology, 26(6), 471–483. https://doi.org/10.1080/13504509.2019.1638330
Kajembe, G. C., Vedeld, P., Babili, I. H., Silayo, D. S., & Mosha, D. B. (2016). Institutional sustainability in the face of climate change: Empirical insights from irrigation institutions in the iringa rural district, Tanzania. In Climate Change and Multi-Dimensional Sustainability in African Agriculture: Climate Change and Sustainability in Agriculture (pp. 23–41). Springer International Publishing. https://doi.org/10.1007/978-3-319-41238-2_3
Kingdon, J. W. (2014). Agendas, Alternatives, and Public Policies (2da ed.). Pearson Education Limited. https://doi.org/10.2307/2150882
Knieć, W., & Goszczyński, W. (2022). Local Horizons of Governance. Social Conditions for Good Governance in Rural Development in Poland. European Countryside, 14(1), 27–50. https://doi.org/10.2478/euco-2022-0002
Kobashi, T., Say, K., Wang, J., Yarime, M., Wang, D., Yoshida, T., & Yamagata, Y. (2020). Techno-economic assessment of photovoltaics plus electric vehicles towards household-sector decarbonization in Kyoto and Shenzhen by the year 2030. Journal of Cleaner Production, 253, 1–17. https://doi.org/10.1016/j.jclepro.2019.119933
Koontz, T. M., Jager, N. W., & Newig, J. (2019). Assessing Collaborative Conservation: A Case Survey of Output, Outcome, and Impact Measures Used in the Empirical Literature. Society and Natural Resources, 33(4), 442–461. https://doi.org/10.1080/08941920.2019.1583397
Koontz, T. M., & Newig, J. (2014). From Planning to Implementation: Top-Down and Bottom-Up Approaches for Collaborative Watershed Management. Policy Studies Journal, 42(3), 416–442. https://doi.org/10.1111/psj.12067
Kristensen, P. (2004). The DPSIR Framework. National Environmental Research Institute, Denmark, 10.
Lhermie, G., Tauer, L. W., & Gröhn, Y. T. (2018). An assessment of the economic costs to the U.S. dairy market of antimicrobial use restrictions. Preventive Veterinary Medicine, 160, 63–67. https://doi.org/10.1016/j.prevetmed.2018.09.028
Loch, C., Rebollar, P., Zanardo, Y., & Walkoski, M. (2015). Landscape multifuncionality evaluation as a subsidy to public policies for sustainable rural development. Ciência Rural, 45(1), 171–177. https://doi.org/10.1590/0103-8478cr20131087
Mack, N., Woodsong, C., MacQueen, K., Guest, G., & Namey, E. (2005). Qualitative research methods: A data collector’s field guide. Family Health International. http://www.fhi.org
MacLeod, C. J., Brandt, A. J., Collins, K., & Dicks, L. V. (2022). Giving stakeholders a voice in governance: Biodiversity priorities for New Zealand’s agriculture. People and Nature, 4(2), 330–350. https://doi.org/10.1002/PAN3.10285
Maris, L., & Ortega, D. (2015). Políticas Públicas, Aprendizaje y Gestión. In CAF (Ed.), Un Estado más efectivo. Capacidades para el diseño, la implementación y el aprendizaje de políticas públicas (p. 244).
Medeiros, E., & Valente, B. (2023). Assessing impacts of public policies towards environmental sustainability in an EU region: North of Portugal. European Planning Studies, 1–20. https://doi.org/10.1080/09654313.2023.2169068
Meny, Y., & Thoenig, J.-C. (1992). Las Políticas Públicas (1era ed.). Editorial Ariel S.A.
Meredith, T. C. (1992). Environmental impact assessment, cultural diversity, and sustainable rural development. Environmental Impact Assessment Review, 12(1–2), 125–138. https://doi.org/10.1016/0195-9255(92)90008-L
Moher, D., Liberati, A., Tetzlaff, J., Altman, D., & Prisma Group. (2009). Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. Annals of Internal Medicine, 151(4), 264–269. https://doi.org/10.1371/journal.pmed.1000097
Moraine, M., Mélac, P., Ryschawy, J., Duru, M., & Therond, O. (2017). A participatory method for the design and integrated assessment of crop-livestock systems in farmers’ groups. Ecological Indicators, 72, 340–351. https://doi.org/10.1016/j.ecolind.2016.08.012
Murphy, K. (2012). The social pillar of sustainable development: A literature review and framework for policy analysis. Sustainability: Science, Practice, and Policy, 8(1), 15–29. https://doi.org/10.1080/15487733.2012.11908081
Musso, F., & Esposito, G. F. (2018). Industrial Policies and Institutional Sustainability. The Case of Inner Areas in Italy. In R. Orăștean, C. Ogrean, & S. Mărginean (Eds.), Innovative Business Development—A Global Perspective (pp. 219–239). Springer International Publishing. https://doi.org/10.1007/978-3-030-01878-8_19
Newsinger, J., & Green, W. (2016). The infrapolitics of cultural value: cultural policy, evaluation and the marginalisation of practitioner perspectives. Journal of Cultural Economy, 9(4), 382–395. https://doi.org/10.1080/17530350.2016.1141791
O’Rourke, D., & Macey, G. P. (2003). Community Environmental Policing: Assessing New Strategies of Public Participation in Environmental Regulation. Journal of Policy Analysis and Management, 22(3), 383–414. https://doi.org/10.1002/pam.10138
Ogunsumi, L., Adegbite, A., & Oyekan, P. O. (2007). Economic impact assessment for technology: The case of improved soybean varieties in southwest Nigeria. Journal of Agriculture and Rural Development in the Tropics and Subtropics, 108(1), 79–86.
Omri, A., & Ben, N. (2020). Good governance for sustainable development goals: Getting ahead of the pack or falling behind? Environmental Impact Assessment Review, 83, 106388. https://doi.org/https://doi.org/10.1016/j.eiar.2020.106388
Ordóñez-Matamoros, G. (2013). Manual de análisis y diseño de políticas públicas. Universidad Externado de Colombia.
Otter, V., & Deutsch, M. (2023). Did policy lose sight of the wood for the trees? An UTAUT-based partial least squares estimation of farmers acceptance of innovative sustainable land use systems. Land Use Policy, 126, 106467. https://doi.org/10.1016/j.landusepol.2022.106467
Parra-López, C., Calatrava-Requena, J., & De-Haro-Giménez, T. (2008). A systemic comparative assessment of the multifunctional performance of alternative olive systems in Spain within an AHP-extended framework. Ecological Economics, 64(4), 820–834. https://doi.org/doi.org/10.1016/j.ecolecon.2007.05.004
Pawson, R., & Tilley, N. (1997). Realistic Evaluation. Sage Publications. https://doi.org/10.1177/135638909800400213
Pfahl, S. (2005). Institutional sustainability. International Journal of Sustainable Development, 8(1–2), 80–96. https://doi.org/10.1504/ijsd.2005.007376
Pham, L. Van, & Smith, C. (2014). Drivers of agricultural sustainability in development countries: a review. Environment Systems and Decisions, 34, 326–341. https://doi.org/10.1007/s10669-014-9494-5
Pope, J., Bond, A., Hugé, J., & Morrison-Saunders, A. (2017). Reconceptualising sustainability assessment. Environmental Impact Assessment Review, 62, 205–215. https://doi.org/10.1016/j.eiar.2016.11.002
Pope, J., & Morrison-Saunders, A. (2004). Conceptualisation of Sustainability Assessment. Environmental Impact Assessment Review, 24(6), 595–616. https://doi.org/https://doi.org/10.1016/j.eiar.2004.03.001
Rojas-Betancur, M. (2018). Caracterización del sistema político colombiano. Estructura inestable, proceso restrictivo/estable y resultados políticos bajos. Opción, 18, 2127–2154.
Rossouw, N., & Wiseman, K. (2004). Learning from the implementation of environmental public policy instruments after the first ten years of democracy in South Africa. Impact Assessment and Project Appraisal, 22(2), 131–140. https://doi.org/10.3152/147154604781766012
Roth, A.-N. (2009). Políticas públicas: Formulación, implementación y evaluación (6ta ed.). Ediciones Aurora.
Sabourin, E. (2022). Public Policies for Sustainable Territorial Development in Brazil: Between Clientelism and Participation. Sustainability (Switzerland), 14(5), 3058. https://doi.org/10.3390/su14053058
Sanderson, I. (2002). Evaluation, policy learning and evidence-based policy making. Public Administration, 80(1), 1–22. https://doi.org/10.1111/1467-9299.00292
Sangha, K. K., Stoeckl, N., Crossman, N., & Costanza, R. (2019). A state-wide economic assessment of coastal and marine ecosystem services to inform sustainable development policies in the Northern Territory, Australia. Marine Policy, 107, 1–10. https://doi.org/10.1016/j.marpol.2019.103595
Schindler, J., Graef, F., & König, H. J. (2015). Methods to assess farming sustainability in developing countries. A review. Agronomy for Sustainable Development, 35(3), 1043–1057. https://doi.org/10.1007/s13593-015-0305-2
Schlosser, R. W., Wendt, O., Bhavnani, S., & Nail-Chiwetalu, B. (2006). Use of information-seeking strategies for developing systematic reviews and engaging in evidence-based practice: the application of traditional and comprehensive Pearl Growing. A review. International Journal of Language & Communication Disorders, 41(5), 567–582. https://doi.org/10.1080/13682820600742190
Schweier, J., Magagnotti, N., Labelle, E., & Athanassiadis, D. (2019). Sustainability Impact Assessment of Forest Operations: a Review. Current Forestry Reports, 5, 101–113. https://doi.org/10.1007/s40725-019-00091-6
Silva, T. L. da, & Piccin, M. B. (2022). a Construção De Consensos No Fórum De Comunidades De Política Pública Do Território Rural Vale Do Rio Pardo – Rs. Revista Brasileira de Gestão e Desenvolvimento Regional, 18(3), 317–329. https://doi.org/10.54399/rbgdr.v18i3.5025
Spangenberg, J. H. (2007). The Institutional Dimension of Sustainable Development. In T. Hák, B. Moldan, & A. Dahl (Eds.), Sustainability Indicators: A Scientific Assessment (p. 440). Island Press.
Vallès, J. (2007). Ciencia politica. Una introduccion (6ta ed.). Editorial Ariel S.A.
van den Hoogen, Q. L. (2014). New local cultural policy evaluation methods in the Netherlands: status and perspectives. International Journal of Cultural Policy, 20(5), 613–636. https://doi.org/10.1080/10286632.2013.871005
Velásquez, R. (2009). Hacia una nueva definición del concepto “política pública.” Desafíos, 20(20), 149–187.
Wang, Z. ;, Liu, Q. ;, Hou, B., Wang, Z., Liu, Q., & Hou, B. (2022). How Does Government Information Service Quality Influence Public Environmental Awareness? International Journal of Environmental Research and Public Health 2023, Vol. 20, Page 177, 20(1), 177. https://doi.org/10.3390/IJERPH20010177
Weiss, C. (1995). Nothing as Practical as Good Theory: Exploring Theory-Based Evaluation for Comprehensive Community Initiatives for Children and Families. In J. Connell (Ed.), New Approaches to Evaluating Community Initiatives: Concepts, Methods, and Contexts (pp. 65–92). Aspen Institute.
Wiktor-Mach, D. (2020). What role for culture in the age of sustainable development? UNESCO’s advocacy in the 2030 Agenda negotiations. International Journal of Cultural Policy, 26(3), 312–327. https://doi.org/10.1080/10286632.2018.1534841
Williams, G. (2020). Future potential of economic impact assessment. Impact Assessment and Project Appraisal, 38(4), 272–277. https://doi.org/10.1080/14615517.2019.1684097
Wollman, H. (2016). Utilization of Evaluation Results in Policy-Making Aad Administration: A Challenge to Political Science Research. Evaluation Studies, 16(3), 433–458. https://doi.org/10.31297/hkju.16.3.8
Yasar, M., Siwar, C., & Firdaus, R. (2015). Assessing paddy farming sustainability in the Northern Terengganu Integrated Agricultural Development Area (IADA KETARA): A structural equation modelling approach. Pacific Science Review B: Humanities and Social Sciences, 1, 71–75. https://doi.org/10.1016/j.psrb.2016.05.001
Zurbriggen, C. (2011). Gobernanza: una mirada desde América Latina. Perfieles Latinoamericanos, 19(38), 39–64. https://doi.org/10.2307/j.ctvckq9gz.4

Esta obra está bajo una licencia internacional Creative Commons Atribución 4.0.