Perceptions of CMRU-TEP: English Majors versus Non-English Majors’ Voices
Article Sidebar
Main Article Content
Abstract
Chiang Mai Rajabhat University Test of English Proficiency (CMRU-TEP) is a required English proficiency test for all CMRU students before graduation. Despite its meticulous design, there is an opportunity for students to improve their scores through focused efforts and targeted support. This study employs an explanatory sequential mixed-methods design, utilizing surveys and interviews, to explore student perceptions of CMRU-TEP and to propose improvement strategies to enhance test performance. Guided by Bachman and Palmer’s (1996) model, the study involves 1,037 fourth-year students, including 155 English majors and 882 non-English majors. Both groups consider CMRU-TEP “useful”, addressing six qualities of test usefulness. The perceptions of majors and non-majors are similar. To enhance CMRU-TEP, the following recommendations are proposed: 1) Develop a test administration handbook. 2) Integrate a writing and speaking portfolio as part of the proficiency assessment. 3) Ensure the test aligns with the focus on communicative skills. 4) Shorten test time and tasks. 5) Design tasks to stimulate real-world language use. 6) Explore the potential of computer-based testing as an alternative. The paper concludes by proposing tailored support for English and non-English majors based on identified needs.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
Al Lawati, Z. A. (2023). Investigating the characteristics of language test specifications and item writer guidelines, and their effect on item development: A mixed-method case study. Language Testing in Asia, 13, Article 21. https://doi.org/10.1186/s40468-023-00233-5
Bachman, L. F. (1991). What does language testing have to offer? TESOL Quarterly, 25(4), 671–704. http://doi.org/10.2307/3587082
Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice. Oxford University Press.
Berry, V., Sheehan, S., & Munro, S. (2019). What does language assessment literacy mean to teachers? ELT Journal, 73(2), 113–123. https://doi.org/10.1093/elt/ccy055
Brown, H. D., & Abeywickrama, P. (2018). Language assessment: Principles and classroom practices (3rd ed.). Pearson.
Charttrakul, K., & Damnet, A. (2021). Role of the CEFR and English teaching in Thailand: A case study of Rajabhat universities. Advances in Language and Literary Studies, 12(2), 82–89. http://dx.doi.org/10.7575/aiac.alls.v.12n.2.p.82
Cheewasukthaworn, K. (2022). Developing a standardized English proficiency test in alignment with the CEFR. PASAA Journal, 63, 66–92. https://doi.org/10.58837/CHULA.PASAA.63.1.3
Chiang Mai Rajabhat University. (2023, June 1). Announcement of Chiang Mai Rajabhat University on English language proficiency enhancement for the students. http://www.general.cmru.ac.th/infocenter/condec/ConCmdFiles/2566/582566.pdf
Chiang Mai Rajabhat University Language Center. (2023). CMRU-TEP score report for final-year undergraduate students (2019-2022) [Unpublished manuscript]. Chiang Mai Rajabhat University Language Center, Chaing Mai Rajabhat University.
Commission on Higher Education Standards. (2024, January 17). Announcement of the Office of Higher Education Commission on the English language proficiency enhancement national policy A.D. 2024. https://www.ops.go.th/th/ches-downloads/edu-standard/item/9625-2567
Glisan, E. W., & Donato, R. (2017). Enacting the work of language instruction: High-level teaching practices. American Council on the Teaching of Foreign Languages.
Giraldo, F. (2019). Designing language assessments in context: Theoretical, technical, and institutional considerations. HOW: A Colombian Journal for Teachers of English, 26(2), 123–143. https://doi.org/10.19183/how.26.2.512
Hasrol, S. B., Zakaria, A., & Aryadoust, V. (2022). A systematic review of authenticity in second language assessment. Research Methods in Applied Linguistics, 1(2022), Article 100023. https://doi.org/10.1016/j.rmal.2022.100023
Hu, H. (2022). Computer-delivered English listening and speaking test in Zhongkao: Test-taker perception, motivation and performance. In F. Uslu (Ed.), Proceedings of SOCIOINT 2022 - 9th International Conference on Education & Education of Social Sciences (pp. 59–75). International Organization Center of Academic Research. https://doi.org/10.46529/socioint.202209
Hughes, A., & Hughes, J. (2020). Testing for language teachers (3rd ed.). Cambridge University Press.
Imsa-ard, P. (2020). Voices from Thai EFL teachers: Perceptions and beliefs towards the English test in the national examination in Thailand. LEARN Journal: Language Education and Acquisition Research Network, 13(2), 269–287. https://so04.tci-thaijo.org/index.php/LEARN/article/view/243713
Jackson, S. (2022). Student and teacher perceptions of an English language test for university admission: Understanding its face validity. Journal of Language and Culture, 41(2), 171–220. https://so03.tci-thaijo.org/index.php/JLC/article/view/265593
Jantadej, K. (2021). English as an international language teaching and perceptions: A case study of Thai tertiary English language teachers. International Journal of Progressive Education, 17(6), 93–114. https://doi.org/10.29329/ijpe.2021.382.7
Kasschau, R. A. (2003). Understanding psychology. McGraw-Hill.
Kuang, Q. (2020). A review of the washback of English language tests on classroom teaching. English Language Teaching, 13(9), 10–17. https://doi.org/10.5539/elt.v13n9p10
Lam, R. (2023). E-portfolios: What we know, what we don’t, and what we need to know. RELC Journal: A Journal of Language Teaching and Research, 54(1), 208–215. http://doi.org/10.1177/0033688220974102
Mattoussi, Y. (2018). Testing usefulness of reading comprehension exams among first year students of English at the tertiary level in Tunisia. In S. Hidri (Ed.), Revisiting the assessment of second language abilities: From theory to practice (pp. 265–288). Springer. https://doi.org/10.1007/978-3-319-62884-4_13
Moulden, M. (2018, July 23). Test interactiveness: A vital quality. https://tesolsolutions.wordpress.com/2018/07/23/test-interactiveness-a-vital-quality/
Nakanitanon, P. (2021). Linking an English proficiency test to the CEFR: Setting valid cut scores. New English Teacher, 15(1), 53–64. http://www.assumptionjournal.au.edu/index.php/newEnglishTeacher/article/view/4878
Namfah, N. (2022). Perception towards the CEFR-based English proficiency test: A case of the students-teacher in the teacher for local development project at one university in Thailand. Journal of Education Burapha University, 33(3), 16–38. https://so02.tci-thaijo.org/index.php/edubuu/article/view/256515
Nitko, A. J., & Brookhart, S. M. (2011). Educational assessment of students (6th ed.). Pearson.
Office of the National Economic and Social Development Council. (2022, October). The thirteenth national economic and social development (2023-2027). https://www.nesdc.go.th/ewt_news.php?nid=13651&filename=develop_issue
Phoolaikao, W., & Sukying, A. (2021). Insights into CEFR and its implementation through the lens of preservice English teachers in Thailand. English Language Teaching, 14(6), 25–35. https://doi.org/10.5539/elt.v14n6p25
Rahman, K. A., Seraj, P., Hasan, M. K., Namaziandost, E., & Tilwani, S. A. (2021). Washback of assessment on English teaching-learning practice at secondary schools. Language Testing in Asia, 11(12), 1–23. https://doi.org/10.1186/s40468-021-00129-2
Rohman, K. A., Budiana, H., & Hartini, N. (2019). The students’ perceptions on a test of English proficiency as graduation requirement. LLT Journal: A Journal on Language and Language Teaching, 22(2), 171–181. https://doi.org/10.24071/llt.2019.220204
Sangsuwan, W., & Rukthong, A. (2023). Test-takers’ performances on and perceptions of two different modes of online speaking tests. LEARN Journal: Language Education and Acquisition Research Network, 16(2), 168–183. https://so04.tci-thaijo.org/index.php/LEARN/article/view/266940
Sato, T., & Ikeda, N. (2015). Test-taker perception of what test items measure: A potential impact of face validity on students learning. Language Testing in Asia, 5(1), Article 10. https://doi.org/10.1186/s40468-015-0019-z
Schacter, D. L., Gilbert, D. T., & Wegner, D. M. (2009). Psychology. Worth Publishers.
Simonsen, R. (2019). An analysis of the problematic discourse surrounding authentic texts. Hispania, 102(2), 245–258. http://doi.org/10.1353/hpn.2019.0045
Taweekaew, K. (2022, May 8). Washback effects on implementing English proficiency tests as a graduation requirement at Thailand National Sports University (TNSU) [Paper presentation]. The 9th NEU National and 7th International Conference, Northeastern University, Khon Kaen, Thailand. https://idcneu.com/neunic22/file_article/ic/neunic2022-ic-07.pdf?utm_source=chatgpt.com
van de Watering, G., Gijbels, D., Dochy, F., & van der Rijt, J. (2008). Students’ assessment preferences, perceptions of assessment and their relationships to study results. Higher Education, 56(6), 645–658. http://www.jstor.org/stable/40269095
Waluyo, B. (2019). Thai first-year university students’ English proficiency on CEFR levels: A case study of Walailak university, Thailand. New English Teacher, 13(2), 51–71. http://www.assumptionjournal.au.edu/index.php/newEnglishTeacher/article/view/3651
Waluyo, B., Zahab, B., & Ruangsung, L. (2024). Language assessment at a Thai university: A CEFR-based test of English proficiency development. rEFLections, 31(1), 25–47. https://doi.org/10.61508/refl.v31i1.270418
Wittayasin, S. (2017). Education challenges to Thailand 4.0. International Journal of Integrated Education and Development, 2(2), 29–35. https://so02.tci-thaijo.org/index.php/ijied/article/view/131930
Wu, J., & Lee, M. (2017). The relationship between test performance and students’ perceptions of learning motivation, test value, and test anxiety in the context of the English benchmark requirement for graduation in Taiwan’s universities. Language Testing in Asia, 7(1), 1–21. https://doi.org/10.1186/s40468-017-0041-4
Ying, B. (2020). The relationship of take takers’ learning motivation, attitudes towards the actual test use and test performance of the College English Test in China. Language Testing in Asia, 10(10), 1–18. https://doi.org/10.1186/s40468-020-00108-z
Zheng, Y., & Iseni, A. (2017). Authenticity in language testing. Anglisticum Journal, 6(8), 9–14. https://media.neliti.com/media/publications/570733-authenticity-in-language-testing-61a6682a.pdf
Zhou, Y., & Yoshitomi, A. (2019). Test-taker perception of and test performance on computer-delivered speaking tests: The mediational role of test-taking motivation. Language Testing in Asia, 9, 1–19. https://doi.org/10.1186/s40468-019-0086-7
