Teacher Factors as a Mediator between Teaching and Testing at the Higher Education Level
Article Sidebar
Main Article Content
Abstract
The washback effects of high-stakes tests have become conspicuous and prevalent in Thai educational contexts. Yet, researchers in language assessment still have much to strive towards to understand the nuanced role of teacher factors as a mediator between the washback effects of high-stakes tests and teaching. This study aimed to investigate how teacher factors mediated between the Srinakharinwirot University Standardized English Test (SWU-SET), an exit examination for undergraduate students at a Thai public university in Thailand, and teaching. A mixed-methods design was implemented in this study. The researchers asked 25 full-time university teachers to complete a questionnaire, and five of them were purposively selected to be the informants for an interview and reflective journals. Descriptive statistics and content analysis were employed for data analysis. The main findings revealed that teacher factors (i.e., knowledge, beliefs, and experience) mediated between the SWU-SET and teaching. A smorgasbord of teacher knowledge of such tests and assessment literacy, beliefs in test writer integrity and professionalism, and experience in test development and taking tests could help induce the intended washback. Finally, this study also proposed a model of mediating factors and the washback effects of the SWU-SET on teaching to help stakeholders make informed decisions on teaching.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
Ahmad, S., & Rao, C. (2024). Examination washback effect: Syllabus, teaching methodology and the learners' communicative competence. Journal of Education and Practice, 3(15), 173–183.
Akpinar, K. D., & Cakildere, B. (2013). Washback effects of high-stakes language tests of Turkey (KPDS and ÜDS) on productive and receptive skills of academic personnel. Journal of Language and Linguistic Studies, 9(2), 81–94.
Alderson, J. C. (2004). Foreword. In L. Cheng, Y. Watanabe & A. Curtis (Eds.), Washback in language testing: Research contexts and methods (pp. ix-xii). Lawrence Erlbaum Associates.
Alderson, J. C., & Hamp-Lyons, L. (1996). TOEFL preparation courses: A study of washback. Language Testing, 13(3), 280–297. https://doi.org/10.1177/026553229601300304
Ali, M. M., & Hamid, M. O. (2020). Teaching English to the test: Why does negative washback exist within secondary education in Bangladesh? Language Assessment Quarterly, 17(2), 129–146. https://doi.org/10.1080/15434303.2020.1717495
Alqahtani, F. (2021). The impact of language testing washback in promoting teaching and learning processes: A theoretical review. English Language Teaching, 14(7), 21–26. https://doi.org/10.5539/elt.v14n7p21
Athiworakun, C., & Adunyarittigun, D. (2022). Investigating washback effects on teaching: A case study of an exit examination at the higher education level. LEARN Journal: Language Education and Acquisition Research Network, 15(2), 776–800. https://so04.tci-thaijo.org/index.php/LEARN/article/view/259951
Athiworakun, C., & Wudthayagorn, J. (2018). Mapping Srinakharinwirot University-Standardized English Test (SWU-SET) onto the Common European Framework of Reference (CEFR). Suranaree Journal of Social Science, 12(2), 69–84. https://so05.tci-thaijo.org/index.php/sjss/article/view/162824/117620
Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice. Oxford University Press.
Brandmiller, C., Schnitzler, K., & Dumont, H. (2023). Teacher perceptions of student motivation and engagement: Longitudinal associations with student outcomes. European Journal of Psychology of Education, 39, 1397–1420. https://doi.org/10.1007/s10212-023-00741-1
Brown, A. (2012). Ethics in language testing and assessment. In C. Coombe, P. Davidson, B. O’Sullivan & S. Stoynoff (Eds.), The Cambridge guide to second language assessment (pp. 113–121). Cambridge University Press.
Burrows, C. (2004). Washback in classroom-based assessment: A study of the washback effect in the Australian adult migrant English program. In L. Cheng, Y. Watanabe & A. Curtis (Eds.), Washback in language testing: Research context and methods (pp. 113–128). Lawrence Erlbaum Associates.
Canli, B., & Çakir, I. (2022). The washback effect of the undergraduate English Placement Examination on language teaching from the perspectives of the teachers. Novitas-Royal (Research on Youth and Language), 16(2), 1–15.
Cheewasukthaworn, K. (2022). Developing a standardized English proficiency test in alignment with the CEFR. PASAA, 63(1), 66–92. https://doi.org/10.58837/CHULA.PASAA.63.1.3
Cheng, L. (2004). The washback effect of a public examination change of teachers’ perceptions toward their classroom teaching. In L. Cheng, Y. Watanabe & A. Curtis (Eds.), Washback in language testing: Research contexts and methods (pp. 147–170). Lawrence Erlbaum Associates.
Chinda, B., Cotter, M., Ebrey, M., Hinkelman, D., Lambert, P., & Miller, A. (2022). Reactions of teachers and students towards the implementation of performance-based language assessment: A washback study in Hokkaido, Japan. LEARN Journal: Language Education and Acquisition Research Network, 15(1), 524–547. https://so04.tci-thaijo.org/index.php/LEARN/article/view/256736
Council of Europe. (2020). Common European Framework of Reference for languages: Learning, teaching, assessment – Companion volume. Council of Europe Publishing. https://rm.coe.int/common-european-frameworkof-reference-for-languages-learning-teaching/16809ea0d4
Davies, A., Brown, A., Elder, C., Hill, K., Lumley, T., & McNamara, T. (1999). Dictionary of language testing. Cambridge University Press.
Elshawa, N. R. M., Heng, C. S., Abdullah, A. N., & Rashid, S. M. (2016). Teachers’ assessment literacy and washback effect of assessment. International Journal of Applied Linguistics & English Literature, 5(4), 135–141.
Erlingsson, C., & Brysiewicz, P. (2017). A hands-on guide to doing content analysis. African Journal of Emergency Medicine, 7(3), 93–99. https://doi.org/10.1016/j.afjem.2017.08.001
Gafforov, I., & Abdulkhay, K. (2022). The role of assessment in language teaching. International Journal of Inclusive and Sustainable Education, 1(4), 31–34. https://doi.org/10.51699/ijise.v1i4.139
Green, A. (2006). Watching for washback: Observing the influence of the international English language testing system academic writing test. Language Assessment Quarterly, 3(4), 333–368. https://doi.org/10.1080/15434300701333152
Hughes, A. (2003). Testing for language teachers (2nd ed.). Cambridge University Press. https://doi.org/10.1017/CBO9780511732980
Hughes, A., & Hughes, J. (2020). Testing for language teachers (3rd ed.). Cambridge University Press. https://doi.org/10.1017/9781009024723
Imsa-ard, P. (2020). Voices from Thai EFL teachers: Perceptions and beliefs towards the English test in the national examination in Thailand. LEARN Journal: Language Education and Acquisition Research Network Journal, 13(2), 269–287. https://so04.tci-thaijo.org/index.php/LEARN/article/view/243713
Khan, A., Hassan, N., & Ali, A. (2023). Implementing formative assessment in Malaysia: Teachers’ viewpoints. Language Testing in Focus, 7, 28–41. https://doi.org/10.32038/ltf.2023.07.03
Kılıçkaya, F. (2016). Washback effects of a high-stakes exam on lower secondary school English teachers’ practices in the classroom. Lublin Studies in Modern Languages and Literature, 40(1), 116–134. https://doi.org/10.17951/lsmll.2016.40.1.116
Kiomrs, R., Abdolmehdi, R., & Rashidi, N. (2011). On the interaction of test washback and teacher assessment literacy: The case of Iranian EFL secondary school teachers. English Language Teaching, 4(1), 156–161. https://doi.org/10.5539/elt.v4n1p156
Kuang, Q. (2020). A review of the washback of English language test on classroom teaching. English Language Teaching, 13(9), 10–17. https://doi.org/10.5539/elt.v13n9p10
Kumaravadivelu, B. (2003). Beyond methods: Macrostrategies for language teaching. Yale University Press.
Li, J. Y. (2019). An evaluation of IELTS speaking test. Open Access Library Journal, 6, 1–17. https://doi.org/10.4236/oalib.1105935.
Messick, S. (1996). Validity and washback in language testing. Language Testing, 13, 241–256. https://doi.org/10.1177/026553229601300302
Ministry of Education. (2014). Guidelines for the implementation of the Ministry of Education policy on teaching and learning English reform. https://mdh.go.th/news_file/p24516701356.pdf
Muñoz, A. P., & Álvarez, M. E. (2010). Washback of an oral assessment system in the EFL classroom. Language Testing, 27(1), 33–49. https://doi.org/10.1177/0265532209347148
Nakanitanon, P. (2021). Linking an English proficiency test to the CEFR: Setting valid cut scores. The New English Teacher, 15(1), 53–64.
Pan, Y., & Newfields, T. (2012). Tertiary EFL proficiency graduation requirements in Taiwan: A study of washback on learning. Electronic Journal of Foreign Language Teaching, 9, 108–122.
Pizarro, M. A. (2010). Exploring the washback effects of a high-stakes English test on the teaching of English in Spanish upper secondary schools. Revista Alicantina de Estudios Ingleses, 23, 149–170. https://doi.org/10.14198/raei.2010.23.09
Rahman, K. A., Seraj, P. M. I., Hasan, M. K., Namaziandost, E., & Tilwani, S. A. (2021). Washback of assessment on English teaching-learning practice at secondary schools. Language Testing in Asia, 11, Article 12. https://doi.org/10.1186/s40468-021-00129-2
Rahman, K. A., Rukanuddin, M., Chowdhury, Mst. S. Y., Ahmed, S., & Seraj, P. M. (2023). Recognizing stakeholders and factors mediating washback in language testing. Education Research International, 2023(1), 1-8. https://doi.org/10.1155/2023/5548723
Rind, I. A., & Mari, M. A. (2019). Analysing the impact of external examination on teaching and learning of English at the secondary level education. Cogent Education, 6(1), 1–14. https://doi.org/10.1080/2331186X.2019.1574947
Shi, D. (2021). Item writing and item writers. In G. Fulcher & L. Hardling (Eds.), The Routledge handbook of language testing (pp. 341–356). Taylor & Francis.
Shih, C. (2009). How tests change teaching: A model for reference. English Teaching: Practice and Critique, 8(2), 188–206.
Tsagari, D., & Cheng, L. (2017). Washback, impact and consequences revisited. In E. Shohamy, I. G. Or & S. May (Eds.), Language testing and assessment (3rd ed., pp. 359–372). Springer. https://doi.org/10.1007/978-3-319-02261-1_24
Turner, C. E. (2009). Examining washback in second language education contexts: A high stakes provincial exam and the teacher factor in classroom practice in Quebec secondary schools. International Journal of Pedagogies and Learning, 5(1), 103–123. https://doi.org/10.5172/ijpl.5.1.103
Wall, D., & Alderson, J. C. (1993). Examining washback: The Sri Lankan impact study. Language Testing, 10(1), 41–69. https://doi.org/10.1177/026553229301000103
Wang, C., Yan, J., & Liu, B. (2014). An empirical study on washback effects of the Internet-based college English test band 4 in China. English Language Teaching, 7(6), 26–53. http://dx.doi.org/10.5539/elt.v7n6p26
Wang, J. (2010). A study of the role of the ‘teacher tactor’ in washback [Doctoral dissertation, McGill University]. McGill University. https://escholarship.mcgill.ca/concern/theses/xp68kg62v
Watanabe, Y. (1996). Does grammar translation come from the entrance examination? Preliminary findings from classroom-based research. Language Testing, 13(3), 318–333. https://doi.org/10.1177/026553229601300306
Watanabe, Y. (2004). Teacher factors mediating washback. In L. Cheng, Y. Watanabe & A. Curtis (Eds.), Washback in language testing: Research contexts and methods (pp. 129–146). Lawrence Erlbaum Associates.
Watson Todd, R., Pansa, D., Jaturapitakkul, N., Chanchula, N., Pojanapunya, P., Tepsuriwong, S., Towns, S. G., & Trakulkasemsuk, W. (2021). Assessment in Thai ELT: What do teachers do, why, and how can practices be improved? LEARN Journal: Language Education and Acquisition Research Network, 14(2), 627–649. https://so04.tci-thaijo.org/index.php/LEARN/article/view/253377
Webb, N. (2002, April 1–5). Assessment literacy in a standards-based education setting [Paper presentation]. The Annual Meeting of the American Educational Research Association, New Orleans, Louisiana, United States.
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.573.676&rep=rep1&type=pdf
Weideman, A. (2019). Assessment literacy and the good language teacher: Four principles and their applications. Journal for Language Teaching, 53(1), 103–121. http://dx.doi.org/10.4314/jlt.v53i1.5
Zatouli, Y. (2024). The negative washback effect of baccalaureate examination on English teaching methodology and learner motivation. The International Journal of Technology, Innovation, and Education, 2(1), 7–34. https://ijtie.com/v201/n21