Keywords
child assessment
Portuguese language
teacher scale
alternative assessment
scoring rubric
How to Cite
Abstract
This study validates and standardizes the EACOL, a tool for teachers to assess the Portuguese-language reading (silent and aloud) of 2nd-to-5th-grade students. 72 teachers were asked to answer the EACOL and the Strengths and Difficulties Questionnaires screening behavioral scale. 452 pupils performed a test battery composed by a general cognitive ability test and seven reading measures: Reading Performance Test, a Word and Pseudoword Reading Task (accuracy and accuracy rate measures), Reading Comprehension Test, and General Reading dimension reduction Composite. The instrument presented high internal consistency and moderate-to-strong correlations with all seven reading variables; cluster analysis suggested the existence of three proficiency groups (poor/average/good readers). This robust results attesting that the teachers, when provided with sound criteria, can come to reliable evaluations of their students’ reading ability. Discussion of discriminant validity is provided. With this final version of EACOL, we hope to offer to Portuguese-speaking researchers a validated instrument to indirectly assess the reading ability of schoolchildren, and to set out a model that can be adapted to other contexts.
Angelini, A. L., Alves, I. C. B., Custódio, E. M., & Duarte, W. F. (1999). Manual. Matrizes Progressivas Coloridas de Raven [Manual: Raven’s Coloured Progressive Matrices]. São Paulo: Casa do Psicólogo.
Bennett, R. E., Gottesman, R. L., Rock, D. A., & Cerullo, F. (1993). Influence of behavior perceptions and gender on teachers’ judgments of students’ academic skill. Journal of Educational Psychology , 85 (2), 347-356. http://dx.doi.org/10.1037/0022-0663.85.2.347
Capellini, S. A., Oliveira, A. M., & Cuetos, F. (2012). PROLEC: Provas de avaliação dos processos de leitura [Reading Processes Assessment Battery]. 2 ed. São Paulo: Casa do Psicólogo.
Capellini, S. A., Tonelotto, J. M. F., & Ciasca, S. M. (2004). Learning performance measures: formal evaluation and teachers' opinion. Revista Estudos de Psicologia, PUC-Campinas , 21 , 79-90. http://dx.doi.org/10.1590/S0103-166X2004000200006
Carreira-Perpiñán, M. Á. (1997). A review of dimension reduction techniques . Sheffield: Department of Computer Science, University of Sheffield. http://dx.doi.org/10.1.1.212.994
Carver, R. P. (1990). Intelligence and reading ability in grades 2-12. Intelligence , 14 (4), 449-455. http://dx.doi.org/10.1016/S0160-2896(05)80014-5
Central Intelligence Agency (CIA) (2014). The world factbook . Washington, DC: Author.
Cogo-Moreira, H., Ploubidis, G., Brandão de Ávila, C.R., Mari, J. de J., & Pinheiro, A.M.V. (2012). EACOL (Scale of Evaluation of Reading Competency by the Teacher): Evidence of concurrent and discriminant validity. Neuropsychiatric Diseases and Treatment , 8 , 443-454. http://dx.doi.org/10.2147/NDT.S36196
Cramer, D., & Howitt, D. (2004). The Sage Dictionary of Statistics: A practical resource for students in the social sciences . Thousand Oaks: Sage.
Cury, C. R., & Golfeto, J. H. (2003). Strengths and Difficulties Questionnaire (SDQ): a study of school children in Ribeirão Preto. Revista Brasileira de Psiquiatria ., 25 (3), 139-145. http://dx.doi.org/10.1590/S1516-44462003000300005
Emmerich, W., Enright, M. K., Rock, D. A., & Tucker, C. (1991). The development, investigation, and evaluation of new item types for the GRE analytical measure . Princeton: Educational Testing Service.
Goodman, R. (1997). The Strengths and Difficulties Questionnaire: A research note. Journal of Child Psychology and Psychiatry , 38 , 581-586. http://dx.doi.org/10.1111/j.1469-7610.1997.tb01545.x
Goodman, R. (2005). Questionário de Capacidades e Dificuldades ( SDQ-Por ) [Strengths and Difficulties Questionnaire (SDQ-Por)]. Retrieved from http://www.sdqinfo.com .
Instituto Paulo Montenegro (2011). INAF Brasil 2011, Indicador de Alfabetismo Funcional. Principais resultados [INAF Brazil 2011, Functional Literacy Indicator. Main results]. São Paulo: IBOPE Inteligência.
Lúcio, P. S., & Pinheiro, Â. M. V. (2013). Escala da Avaliação da Competência da Leitura pelo Professor (EACOL): evidências de validade de critério. Temas em Psicologia, 21 , 499-511.
Maughan, B., & Carroll, J. M. (2006). Literacy and mental disorders. Current Opinion in Psychiatry , 19 , 350-55. http://dx.doi.org/10.1097/01.yco.0000228752.79990.41
Pasquali, L., Wechsler, S., & Bensusan, E. (2002). Matrizes Progressivas do Raven Infantil: um estudo de validação para o Brasil [Raven's Colored Progressive Matrices for Children: a validation study for Brazil]. Avaliação psicológica , 1 (2), 95-110.
Pinheiro, A.M.V. (2013). Prova de Leitura e de Escrita de palavras [Reading and Writing words test] . Relatório Técnico Final aprovado pela Fundação de Amparo à Pesquisa do Estado de Minas Gerais—FAPEMIG (FAPEMIG). Número do processo: APQ-01914-09.
Pinheiro, Â. A. M. V., & Costa, A. E. B. da (2015). EACOL—Escala de Avaliação da Competência em Leitura Pelo Professor: Construção por meio de Critérios e de Concordância entre Juízes [Scale of Evaluation of Reading Competence by the Teacher (EACOL)— evidence of criterion validity]. Psicologia: Reflexão e Crítica , 28 (1), 1-10. http://dx.doi.org/10.1590/1678-7153.201528109
Saur, A. M., & Loureiro, S. R. (2012). Psychometric properties of the Strengths and Difficulties Questionnaire: A literature review. Estudos de psicologia ( Campinas ), 29 (4), 619-629. http://dx.doi.org/10.1590/S0103-166X2012000400016
Snowling, M. J., Duff, F., Petrou, A., Schiffeldrin, J., & Bailey, A. M. (2011). Identification of children at risk of dyslexia: The validity of teacher judgements using “Phonic Phases.” Journal of Research in Reading , 34 , 157-170. http://dx.doi.org/10.1111/j.1467-9817.2011.01492.x
Soares, T. M., Fernandes, N. S., Ferraz, M. S. B., & Riami, J. L. R. (2010). A expectativa do professor e o desempenho dos alunos [Teacher’s Expectation and Students’ Performance]. Psicologia: Teoria e Pesquisa , 26 (1), 157-170.
Todos pela Educação (2013). Instituto Paulo Montenegro/IBOPE, Fund. Cesgranrio, Inep. Retrieved from http://www.todospelaeducacao.org.br
Unesco (2007). Literacy Initiative For Empowerment 2006-2015. Vision and Strategy Paper , 3rd edition. Hamburg: Unesco Institute for Lifelong Learning.
Verbič, S. (2012). Information value of multiple response questions. Psihologija , 45 , 467-485. http://dx.doi.org/10.2298/PSI1204467V
Vilhena, D. A., Sucena, A., Castro, S. L., & Pinheiro, A. M. (2016). Reading Test-Sentence Comprehension: An Adapted Version of Lobrot's Lecture 3 Test for Brazilian Portuguese. Dyslexia, 22 (1), 47-63. doi: 10.1002/dys.1521
This journal is registered under a Creative Commons Attribution 4.0 International Public License. Thus, this work may be reproduced, distributed, and publicly shared in digital format, as long as the names of the authors and Pontificia Universidad Javeriana are acknowledged. Others are allowed to quote, adapt, transform, auto-archive, republish, and create based on this material, for any purpose (even commercial ones), provided the authorship is duly acknowledged, a link to the original work is provided, and it is specified if changes have been made. Pontificia Universidad Javeriana does not hold the rights of published works and the authors are solely responsible for the contents of their works; they keep the moral, intellectual, privacy, and publicity rights. Approving the intervention of the work (review, copy-editing, translation, layout) and the following outreach, are granted through an use license and not through an assignment of rights. This means the journal and Pontificia Universidad Javeriana cannot be held responsible for any ethical malpractice by the authors. As a consequence of the protection granted by the use license, the journal is not required to publish recantations or modify information already published, unless the errata stems from the editorial management process. Publishing contents in this journal does not generate royalties for contributors.