Exploring the Factors Iranian EFL Institute Teachers Consider in Grading Using Personal Construct Theory

Document Type: Research Paper

Authors

Department of English Language, Faculty of Foreign Languages, Arak University, Arak, Iran

10.22099/jtls.2020.36293.2780

Abstract

Although grades are the most ubiquitous currency of educational measurement around the globe, their meaning, particularly in understudied settings as in Iran, is still shrouded in mystery. The purpose of this study was to investigate EFL teachers’ class grades by focusing on the less verbalized aspects of grading to see what a grade means. Five Iranian English language teachers working part-time in a private EFL institute were interviewed using the repertory grid interviewing technique, Kelly’s (1955) unique data collection instrument used extensively in personal construct theory (PCT). The results of the content analysis revealed that of the 92 elicited constructs, over 70% were categorized as non-academic, pointing to a heavy reliance on such criteria for grading, and consequently leading to the invalidity of assigned grades. Further, the results of principal component analysis (PCA) of each teacher’s elicited constructs endorsed hodgepodge grading by demonstrating single main components that accounted for the most variation in teacher grading and that comprised both academic and non-academic factors. However, this phenomenon was interpreted slightly differently when seen from the PCT perspective. Implications of this study for teacher professional development and teacher education programs are discussed.

Keywords


Adrian, C. A. (2012). Implementing standards-based grading: Elementary teachers’ beliefs, practices and concerns. (Doctoral dissertation). Retrieved from ProQuest (1032540669)

Allen, J. D. (2005). Grades as Valid Measures of Academic Achievement of Classroom Learning. The Clearing House, 78(5), 218-223. doi:10.3200/TCHS.78.5.218-223

Annerstedt, C., & Larsson, S. (2010). ‘I have my own picture of what the demands are…’: Grading in Swedish PEH problems of validity, comparability and fairness. European Physical Education Review, 16(2), 97-115. doi:10.1177/1356336X10381299

Bernstein, B. (2003). Class, codes and control. (Vol. 3) Towards a theory of educational transmission. London: Routledge & Kegan Paul.

Bjorklund, L. E. (2008). The repertory grid technique, Making tacit knowledge explicit: Assessing creative work and problem-solving skills. In H. Middleton (Ed.), Researching Technology Education: Methods and Techniques (pp. 46-69). Rotterdam: Sense Publishers.

Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7-74.

Brookhart, S. M. (1991). Grading practices and validity. Educational Measurement: Issues and Practice, 10(1), 35-36.

Brookhart, S. M. (1993). Teachers’ grading practices: Meaning and values. Journal of Educational Measurement, 30, 123-142. doi:10.1111/j.1745-3984.1993.tb01070.x

Brookhart, S. M. (1994). Teachers' grading: Practice and theory. Applied Measurement in Education, 7(4), 279-301.

Brookhart, S. M. (2004). Grading. Upper Saddle River, New Jersey: Pearson Education.

Brookhart, S. M. (2009). Grading (2nd ed.). New York: Merrill.

Brookhart, S. M. (2013). The use of teacher judgment for summative assessment in the USA. Assessment In Education: Principles, Policy & Practice, 20(1), 69-90. doi:10.1080/0969594X.2012.703170

Brookhart, S. M., Guskey, T. R., Bowers, A. J., McMillan, J. H., Smith, J. K., Smith, L. F., . . . Welsh, M. E. (2016). A century of grading research: Meaning and value in the most common educational measure. Review of Educational Research, 86(4), 803-848. doi:10.3102/0034654316672069

Cheng, L., & Sun, Y. (2015). Teachers’ grading decision making: Multiple influencing factors and methods. Language Assessment Quarterly, 12(2), 213-233. doi:10.1080/15434303.2015.1010726

Cheng, L., & Wang, X. (2007). Grading, feedback, and reporting in ESL/EFL classrooms. Language Assessment Quarterly, 4(1), 85-107.

Cheng, L., Rogers, T., & Hu, H. (2004). ESL/EFL instructors’ classroom assessment practices: Purposes, methods, and procedures. Language Testing, 21, 360-389.

Cheng, L., Rogers, T., & Wang, X. (2008). Assessment purposes and procedures in ESL/EFL classrooms. Assessment & Evaluation in Higher Education, 33(1), 9-32.

Cizek, G. J., Fitzgeral, S. M., & Rachor, R. E. (1996). Teachers' assessment practices: Preparation, isolation, and the kitchen sink. Educational Assessment, 3(2), 159-179.

Cox, K. B. (2011). Putting classroom grading on the table, a reform in progress. American Secondary Education, 40(1), 67-87.

Cross, L. H., & Frary, R. B. (1999). Hodgepodge grading: Endorsed by students and teachers alike. Applied Measurement in Education, 12(1), 53-72.

Davison, C. (2004). The contradictory culture of teacher-based assessment: ESL teacher assessment practices in Australian and Hong Kong secondary schools. Language Testing, 21(3), 305-334.

Duncan, R. C., & Noonan, B. (2007). Factors affecting teachers’ grading and assessment practices. Alberta Journal of Educational Research, 53, 1-21.

Dyrness, R., & Dyrness, A. (2008). Making the grade in middle school. Kappa Delta Pi Record, 44(3), 114-118.

Faravani, A., & Atai, M. (2015). Multiple intelligences, dialogic-based portfolio assessment, and the enhancement of higher-order thinking. Journal of Teaching Language Skills, 33(4), 19-44. doi: 10.22099/jtls.2015.3015

Fransella, F., Bell, R., & Bannister, D. (2004). A manual for repertory grid technique (2nd ed.). Chichester: Wiley.

Frary, R. B.; Cross, L. H.; Weber, L. J.;. (1993). Testing and grading practices and opinions of secondary teachers of academic subjects: Implications for instruction in measurement. Educational Measurement: Issues & Practice, 12(3), 23-30. doi:10.1111/j.1745-3992.1993.tb00539.x

Gullickson, A. R. (1985). Student evaluation techniques and their relationship to grade and curriculum. Journal of Educational Research, 79(2), 96-100.

Guskey, T. R. (1996). Reporting on student learning: Lessons from the past – Prescriptions for the future. In T. R. Guskey (Ed.), Communicating student learning. 1996 Yearbook of the association for supervision and curriculum development (pp. 13-24). Alexandria, VA: Association for Supervision and Curriculum Development.

Guskey, T. R. (2011). Stability and change in high school grades. NSAAP Bulletin, 95, 85-98.

Guskey, T. R. (2015). On your mark. Bloomington, IN: Solution Tree Press.

Guskey, T. R., & Bailey, J. (2001). Developing grading and reporting systems for student learning. Thousand Oaks, CA: Corwin.

Guskey, T. R., & Link, L. J. (2018). Exploring the factors teachers consider in determining students’ grades. Assessment in Education: Principles, Policy & Practice, 26(3), 303-320. doi:10.1080/0969594X.2018.1555515

Hay, P. J., & Macdonald, D. (2008). (Mis)appropriations of criteria and standards-referenced assessment in a performance-based subject. Assessment in Education, 15, 153-168. doi:10.1080/09695940802164184

Hay, P., & Penney, D. (2013). Assessment in physical education: A sociocultural perspective. London: Routledge.

Jankowicz, D. (2003). The easy guide to repertory grids. Chichester: John Wiley & Sons.

Kelly, G. A. (1955/1991). The psychology of personal constructs (2nd ed.). London: Routledge.

Klapp Lekholm, A., & Cliffordson, C. (2009). Effects of student characteristics on grades in compulsory school. Educational Research and Evaluation, 15(1), 1-23. doi:10.1080/13803610802470425

Lawrenz, F., & Orton, R. E. (1989). A comparison of critical thinking related teaching practices of seventh and eighth-grade science and mathematics teachers. School Science and Mathematics, 89(5), 361-372.

Link, L. J. (2018). Teachers’ perceptions of grading practices: How pre-service training makes a difference. Journal of Research in Education, 28(1), 62-91.

Linn, R., & Miller, M. (2005). Measurement and assessment in teaching. Upper Saddle River, NJ: Pearson Prentice Hall.

McMillan, J. H. (2001). Secondary teachers' classroom assessment and grading practices. Educational Measurement: Issues and Practice, 20(1), 20-32.

McMillan, J. H. (2003). Understanding and improving teachers’ classroom assessment decision-making: Implications for theory and practice. Educational Measurement: Issues And Practice, 22(4), 34-43.

McMillan, J. H. (2008). Assessment essentials for standards-based education (2nd ed.). Thousand Oaks, CA: Sage.

McMillan, J. H., & Lawson, S. R. (2001). Secondary science teachers' classroom assessment and grading practices. Richmond, VA: Metropolitan Educational Research Consortium. Retrieved from ERIC database.

McMillan, J. H., & Nash, S. (2000). Teacher classroom assessment and grading practices decision making. National Council on Measurement in Education. New Orleans: LA.

McMillan, J. H., Myran, S., & Workman, D. (2002). Elementary teachers’ classroom assessment and grading practices. Journal of Educational Research, 95(4), 203-213.

Merwin, J. C. (1989). Evaluation. In M. C. Reynolds (Ed.), Knowledge base for the beginning teacher (pp. 185-192). Oxford, UK: Pergamon Press.

Newton, P. E. (2007). Clarifying the purposes of educational assessment. Assessment in Education: Principles, Policy & Practice, 14(2), 149-170.

O'Connor, K. (2007). A repair kit for grading: 15 Fixes for broken grades. Boston, MA: Pearson.

O'Connor, K. (2009). How to grade for learning: Linking grades to standards (3rd ed.). Glenview, IL: Pearson Professional Development.

Randall, J., & Engelhard, G. (2009). Examining teacher grades using Rasch measurement theory. Journal of Educational Measurement, 46(1), 1-18.

Randall, J., & Engelhard, G. (2010). Examining the grading practices of teachers. Teaching and Teacher Education, 26, 1372-1380. doi:10.1016/j.tate.2010.03.008

Russell , J. A., & Austin, J. R. (2010). Assessment practices of secondary music teachers. Journal of Research in Music Education, 58, 37-54.

Shah Ahmadi, M., & Ketabi, S. (2019). Features of language assessment literacy in Iranian English language teachers' perceptions and practices. Journal of Teaching Language Skills, 38(1), 191-223. doi: 10.22099/jtls.2020.34843.2739

Stiggins, R. J., Frisbie, D. A., & Griswold, P. A. (1989). Inside high school grading practices: Building a research agenda. Educational Measurement: Issues and Practices, 8(2), 5-14.

Sun, Y., & Cheng, L. (2013). Teachers’ grading practices: Meaning and values assigned. Assessment in Education: Principles, Policy & Practice, 21(3), 326-343. doi:10.1080/0969594X.2013.768207

Svennberg, L., Meckbach, J., & Redelius, K. (2014). Exploring PE teachers’ ‘gut feelings’: An attempt to verbalize and discuss teachers’ internalized grading criteria. European Physical Education Review, 20(2), 199-214. doi:10.1177/1356336X13517437

Svennberg, L., Meckbach, J., & Redelius, K. (2016). Swedish PE teachers struggle with assessment in a criterion-referenced grading system. Education and Society, 23(4), 381-393. doi:10.1080/13573322.2016.1200025

Teaf, H. M. (1964). Grades: Their dominion is challenged. The Journal of Higher Education, 35(2), 87-88.

Wormeli, R. (2006). Accountability: Teaching through assessment and feedback, not grading. American Secondary Education, 34(3), 14-27.

Yesbeck, D. M. (2011). Grading practices: Teachers’ considerations of academic and non-academic factors (Doctoral dissertation). Retrieved from ProQuest.

Young, S. (2011). A survey of student assessment practice in physical education: Recommendations for grading. Strategies: A Journal for Physical and Sport Educators, 24(6), 24-26. doi:10.1080/08924562.2011.10590959