Keywords
evaluation
fairness
learning
perception
summer schools
How to Cite
Abstract
This article analyzes students' peer review method and provides the results of online surveys designed to evaluate MOOC courses. It focuses on determinants of the peer review, such as concrete experience during the course or external aspects, applying multivariate analysis of binary logistic regression. 1037 participants were surveyed. Results highlight the existent doubts of participants about this evaluation system from the relationship between expectations and experiences in the course, the relationship with the principles of the learning model, specific aspects of the contents, the design of the courses, as well as students' characteristics.
Admiraal, W., Huisman, B. & Van de Ven, M. (2014). Self- and peer assessment in massive open online courses. International Journal of Higher Education, 3(3), 119–128. http://www.sciedu.ca/journal/index.php/ijhe/article/view/5149
Aguaded, J. I. (2013). La revolución MOOCs, ¿una nueva educación desde el paradigma tecnológico? Comunicar, 41, 7–8. https://doi.org/10.3916/C41-2013-a1
Aguaded, J. I. & Medina, R. (2015). Criterios de calidad para la valoración y gestión de MOOC. Revista Iberoamericana de Educación a Distancia, 18(2), 119–143. https://doi.org/10.5944/ried.18.2.13579
Ashton, S. & Davies, R. S. (2015). Using scaffolded rubrics to improve peer assessment in a MOOC writing course. Distance Education, 36(3), 312–334. https://doi.org/10.1080/01587919.2015.1081733
Bartolomé, A. & Steffens, K. (2015). ¿Son los MOOC una alternativa de aprendizaje? Comunicar, XXII(44), 91–99. https://doi.org/10.3916/C44-2015-10
Bates, T. (2014, October 19). The strengths and weaknesses of MOCCs: Part I. Learning and Distance Education Resources. http://www.tonybates.ca/2014/10/19/the-strengths-and-weaknesses-of-moocs-part-i/
Biggs, J. & Tang, C. (2011). Teaching for Quality Learning at University: What the Student Does. Higher Education (4th ed.). The Society for Research into Higher Education & Open University Press. https://cetl.ppu.edu/sites/default/files/publications/-John_Biggs_and_Catherine_Tang-_Teaching_for_Quali- BookFiorg-.pdf
Boud, D. & Falchikov, N. (2006). Aligning assessment with long-term learning. Assessment and Evaluation in Higher Education, 31(4), 399–413. https://doi.org/10.1080/02602930600679050
Brindley, C. & Scoffield, S. (2006). Peer assessment in undergraduate programmes. Teaching in Higher Education, 3(1), 79–90. https://doi.org/10.1080/1356215980030106
Callejo, J. & Agudo, Y. (2018). MOOC: valoración de un futuro. RIED. Revista Iberoamericana de Educación a Distancia, 21(2), 219–241. https://doi.org/10.5944/ried.21.2.20930
Carnell, B. (2015). Aiming for autonomy: Formative peer assessment in a final-year undergraduate course. Assessment & Evaluation in Higher Educa- tion, 41(8), 1269–1283. https://doi.org/10.1080/02602938.2015.1077196
Carvalho, A. (2013). Students' perceptions of fairness in peer assessment: Evidence from a problem-based learning course. Teaching in Higher Education, 18(5), 491–505, https://doi.org/10.1080/13562517.2012.753051
Chambers, K., Whannell, R. & Whannell, P. (2014). The use of peer assessment in a regional Australian university tertiary bridging course. Australian Journal of Adult Learning, 54(1), 69–88. https://files.eric.ed.gov/fulltext/EJ1031009.pdf
Chen, Y. C & Tsai, Ch. Ch. (2009). An educational research course facilitated by online peer assessment. Innovations in Education and Teaching Internation- al, 46(1), 105–117. https://doi.org/10.1080/14703290802646297
Cho, K., Schunn, C. D. & Wilson, R. W. (2006). Validity and reliability of scaffolded peer assessment of writing from instructor and student perspectives. Journal of Educational Psychology, 98(4), 891–901. https://doi.org/10.1037/0022-0663.98.4.891
De Boer, J., Ho, A. D., Stump, G. S. & Breslow, L. (2014). Changing “course”: Reconceptualizing educational variables for massive open online courses. Educational Researcher, 43(2), 74–84. http://dx.doi.org/10.3102/0013189X14523038
Dochy, F., Segers, M. & Sluijsmans, D. (2006). The use of self-, peer and co-assessment in higher education: A review. Studies in Higher Education, 24(3), 331–350. https://doi.org/10.1080/03075079912331379935
Furman, B. & Robinson, W. (2003). Improving engineering report writing with Calibrated Peer ReviewTM. In D. Budny (Ed.), Proceedings of the 33rd Annual Frontiers in Education Conference. IEEE Digital Library.
Gallego, B., Quesada, V., Gómez, M. A. & Cubero, J. (2017). La evaluación y retroalimentación electrónica entre iguales para la autorregulación y el aprendizaje estratégico en la universidad: la percepción del alumnado. REDU. Revista de Docencia Universitaria, 15(1), 127–146. https://doi.org/10.4995/redu.2017.5991
García-Aretio, L. (2015). ¿... Y antes de los MOOC? Revista Española de Educación Comparada, 26, 97-115. https://doi.org/10.5944/reec.26.2015.14483
Gatfield, T. (2006). Examining student satisfaction with group projects and peer assessment. Assessment and Evaluation in Higher Education, 24(4), 365–377. https://doi.org/10.1080/0260293990240401
González de la Fuente, A. & Carabantes, D. (2017). MOOC: medición de satisfacción, fidelización, éxito y certificación de la educación digital. RIED. Revista Iberoamericana de Educación a Distancia, 20(1), 105–123. https://doi.org/10.5944/ried.20.1.16820
Hou, H-T., Chang, K. & Sung, Y-T. (2007). An analysis of peer assessment online discussions within a course that uses project-based learning. Interactive Learning Environments, 15(3), 237–251. https://doi.org/10.1080/10494820701206974
Ibarra, M., Rodríguez, G. & Gómez, M. A. (2012). La evaluación entre iguales: beneficios y estrategias para su práctica en la universidad. Revista de Edu- cación, 359, 206-231. http://www.educacionyfp.gob.es/dam/jcr:7e92776f-027a-4f76-a4f4-2fe971b2e0c6/re35911.pdf
Kane, J. S. & Lawler, E. E. (1978). Methods of peer assessment. Psychological Bulletin, 85(3), 555–586. https://doi.org/10.1037/0033-2909.85.3.555
Kang'ethe, S. M. (2017). Peer assessment as a tool of raising students' morale and motivation: The perceptions of the University of Fort Hare Social Work students. International Journal of Educational Sciences, 6(3), 407–413. https://doi.org/10.1080/09751122.2014.11890152
Lewin, T. (2012). Education site expands slate of universities and courses. New York Times. http://www.nytimes.com/2012/09/19/education/coursera-adds-more-ivy-league-partner-universities.html?_r=0
Li, L., Liu, X. & Steckelberg, A. L. (2010). Assessor or assessee: How student learning improves by giving and receiving peer feedback. British Journal of Educational Technology, 41(3), 525–536. https://doi.org/10.1111/j.1467- 8535.2009.00968.x
Luo, H., Robinson, A. C. & Park, J.-Y. (2014). Peer grading in a MOOC: Reliability, Validity, and Perceived Effects. Online Leraning Consortium, 18(2) http:// dx.doi.org/10.24059/olj.v18i2.429
Mackness, J., Mak, S. & Williams, R. (2010). The ideals and reality of participating in a MOOC. In V. Dirckinck-Holmfeld, V. Hodgson, C. Jones, M. de Laat, D. McConnell & T. Ryberg (Eds.), Proceedings of the 7th International Conference on Networked Learning 2010 (pp. 266–274). Lancaster University.
McMahon, T. (2009). Combining peer-assessment with negotiated learning activities on a day-release undergraduate-level certificate course (ECTS level 3). Assessment & Evaluation in Higher Education, 35(2), 223–239. https://doi.org/10.1080/02602930902795919
Mengual-Andrés, S., Lloret, C. & Roig, R. (2015). Validación del cuestionario de evaluación de la calidad de cursos virtuales adaptados a MOOC. RIED. Revista Iberoamericana de Educación a Distancia, 18(2), 145–169. https://doi.org/10.5944/ried.18.2.13664
Moore, C. & Teather, S. (2013). Engaging students in peer review: Feedback as learning. Issues in Educational Research, 23(2), 196–211. http://www.iier.org.au/iier23/moore.pdf
Nulty, D. D. (2010). Peer and self-assessment in the first year of university. Assessment & Evaluation in Higher Education, 36(5), 493–507. https://doi.org/10.1080/02602930903540983
Osuna-Acedo, S. & Gil-Quintana, J. (2017). El proyecto europeo ECO. Rompiendo barreras en el acceso al conocimiento. Educación XX1, 20(2), 189–213. https://doi.org/10.5944/educxx1.19037
Osuna-Acedo, S., Marta-Lazo, C. & Frau-Meigs, D. (2018). De sMOOC a tMOOC, el aprendizaje hacia la transferencia profesional: el proyecto europeo ECO. Comunicar, 55, 105–114. https://doi.org/10.3916/C55-2018-10
Pappano, L. (2012). The Year of the MOOC. The New York Times. http://www.nytimes.com/2012/11/04/education/edlife/massive-open-online-courses- are-multiplying-at-a-rapid-pace.html
Pintrich, P. R. (2004). A conceptual framework for assessing motivation and self-regulated learning in college students. Educational Psychology Review, 16(4), 385–408. http://dx.doi.org/10.1007/s10648-004-0006-x
Planas, A., Feliu, L., Fraguell, R.M., Arbat, G., Pujol, J., Roura, N., Suñol, J.J. & Montoro, L. (2013). Student perceptions of peer assessment: an interdisciplinary study. Assessment & Evaluation in Higher Education, 39 (5), 592-610. https://doi.org/10.1080/02602938.2013.860077
Ramírez-Fernández, M. (2015). La valoración de MOOC: una perspectiva de calidad. RIED. Revista Iberoamericana de Educación a Distancia, 18(2), 171–195. https://doi.org/10.5944/ried.18.2.13777
Sánchez, E. & Escribano, J. J. (2014). Clasificación de medios de evaluación en los MOOC. EDUTEC, Revista Electrónica de Tecnología Educativa, (48), a279. http://dx.doi.org/10.21556/edutec.2014.48.137
Sánchez-Vera, M. M. & Prendes-Espinosa, M. P. (2015). Más allá de las pruebas objetivas y la evaluación por pares: alternativas de evaluación en los MOOC. RUSC. Universities and Knowledge Society Journal, 12(1), 119–131. http://dx.doi.org/10.7238/rusc.v12i1.2262
Saterbak A., Moturu A. & Volz, T. (2018). Using a teaching intervention and Calibrated Peer Review TM Diagnostics to improve visual communication skills. Annals of Biomedical Engineering, 46, 513–524. https://link.springer.com/article/10.1007/s10439-017-1946-x
Schneider, S. C. (2015). Work in progress: Use of Calibrated Peer Review to improve report quality in an electrical engineering laboratory [Conference presentation]. 2015 American Society for Engineering Education Zone III Conference, Springfield, MO. https://www.asee.org/documents/zones/zone3/2015/Work-in-Progress-Use-of-Calibrated-Peer-Review-to-Improve-Report-Quality-in-an-Electrical-Engineering-Laboratory.pdf
Searby, M. & Ewers, T. (1997). An evaluation of the use of peer assessment in higher education: A case study in the School of Music, Kingston University. Assessment & Evaluation in Higher Education, 22(4), 371–383. https://doi.org/10.1080/0260293970220402
Stefani, L. (1994) Peer, self and tutor assessment: Relative reliabilities. Studies in Higher Education, 19(1), 69–75. https://doi.org/10.1080/03075079412331382153
Strang, K. D. (2015). Effectiveness of peer assessment in a professionalism course using an online workshop. Journal of Information Technology Education: Innovations in Practice, 14, 1–16. https://doi.org/10.28945/2100
Suen, H. (2014). Peer assessment for massive open online courses (MOOCs). The International Review of Research in Open and Distributed Learning, 15(3), 312–327. http://dx.doi.org/10.19173/irrodl.v15i3.1680
Topping, K. J. (2009). Peer assessment. Theory into Practice, 48(1), 20–27. https://doi.org/10.1080/00405840802577569
Topping, K. J. (2017). Peer assessment: Learning by judging and discussing the work of other learners. Interdisciplinary Education and Psychology, 1(1). https://doi.org/10.31532/InterdiscipEducPsychol.1.1.007
Torres, D. & Gago, D. (2014). Los MOOC y su papel en la creación de comunidades de aprendizaje y participación. RIED. Revista Iberoamericana de Educación a Distancia, 17(1), 13–34. http://revistas.uned.es/index.php/ried/article/view/11570
Vázquez, E., López, E. & Sarasola, J. L. (2013). La expansión del conocimiento en abierto: los MOOC. Octaedro ICE.
Vera-Cazorla, M. J. (2014). La evaluación formativa por pares en línea como apoyo para la enseñanza de la expresión escrita persuasiva. RED. Revista de Educación a Distancia, (43), 2–17. http://revistas.um.es/red/article/view/236941
Vickerman, P. (2009). Student perspectives on formative peer assessment: An attempt to deepen learning? Assessment & Evaluation in Higher Education, 34(2), 221–230. https://doi.org/10.1080/02602930801955986
Vu, T. T. & Dall'Alba, G. (2007). Students' experience of peer assessment in a professional course. Assessment & Evaluation in Higher Education, 32(5), 541–556. https://doi.org/10.1080/02602930601116896
Watson, S. (2013). Tentatively exploring the learning potentialities of postgraduate distance learners' interactions with other people in their life contexts. Distance Education, 34(2), 175–188. https://doi.org/10.1080/01587919.20 13.795126
Zapata, M. (2013). MOOCs, una visión crítica. El valor no está en el ejemplar. http://eprints.rclis.org/18452/1/MOOC_critica_Elis.pdf
Zimmerman, B. J. (2002). Becoming a self-regulated learner. Theory into Practice, 41(2), 64–70. https://doi.org/10.1207/s15430421tip4102_2
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright (c) 2021 Yolanda Agudo-Arroyo, Javier Callejo-Gallego