“I think I speak without hesitation”: Learning-Oriented Assessment to Enhance English Oral Communication of Thai Pre-Service Teachers
Article Sidebar
Main Article Content
Abstract
Learning-oriented assessments have been implemented in the English language classroom to maximize students’ ability to acquire a language through their involvement in assessment processes. Nevertheless, empirical studies investigating the oral communication ability of students using learning-oriented assessments remain limited. This study aims to investigate the effects of a learning-oriented assessment on the English oral communication ability of Thai pre-service teachers and to explore their attitudes towards the model. Thus, the study employed a mixed-methods research design. The participants of the study were 60 first-year students divided into two groups: the control group (N = 30) and the experimental group (N = 30) were selected through convenience sampling. The data were collected for 10 weeks using an oral communication test, a questionnaire, and interview questions. The results of the test were analyzed using a paired sample t-test and an independent sample t-test. The results of the questionnaire were analyzed using descriptive statistics. In addition, the qualitative data were analyzed using content analysis. The quantitative results showed positively significant effects on the development of students’ oral communication ability in the aspects of range, accuracy, fluency, interaction, coherence, and pronunciation, with a medium effect size. Additionally, the students positively reported the benefits of learning-oriented assessments as being helpful in improving their oral communication ability. Therefore, this study shows that learning oriented assessments could serve as one of many alternative approaches to developing English oral communication ability.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
Almalki, M. (2019). Learning-oriented assessment, critical thinking and English language speaking skills: An exploratory study of Saudi EFL learners. International Journal of English Language Education, 7(1), 37–50. https://doi.org/10.5296/ijele.v7i1.14528
Bailey, K. M. (2005). Practical English language teaching: Speaking. McGraw-Hill.
Bangkom, K., & Sukavatee, P. (2021). Effects of oracy building instruction via blended-learning environment on Thai students' metacognitive awareness and oracy skills. LEARN Journal: Language Education and Acquisition Research Network, 14(1), 240–293. https://so04.tci-thaijo.org/index.php/LEARN/article/view/248691
Brown, H. D. (1994). Teaching by principles: An interactive approach to language pedagogy. Prentice Hall Regents.
Burns, A., & Joyce, H. (1997). Focus on speaking. National Center for English Language Teaching and Research.
Carless, D. (2015). Exploring learning-oriented assessment processes. Higher Education, 69(6), 963–976. https://doi.org/10.1007/s10734-014-9816-z
Carless, D., Joughin, G., & Liu, N.-F. (2006). How assessment supports learning: Learning-oriented assessment in action. Hong Kong University Press.
Chien, S.-Y., Hwang, G.-J., & Jong, M. S.-Y. (2020). Effects of peer assessment within the context of spherical video-based virtual reality on EFL students’ English-speaking performance and learning perceptions. Computers & Education, 146, 1–20. https://doi.org/10.1016/j.compedu.2019.103751
Christison, M. (2018). Student involvement in assessment. In J. I. Liontas (Ed.), The TESOL encyclopedia of English language teaching (pp. 1–7). John Wiley & Son, Inc. https://doi.org/10.1002/9781118784235.eelt0357
Chuanchaisit, S., & Prapphal, K. (2009). A study of English communication strategies of Thai university students. MANUSYA: Journal of Humanities, 17, 100–126. https://doi.org/10.1163/26659077-01203008
Cohen, J. (2013). Statistical power analysis for the behavioral sciences (2nd ed.). Routledge. https://doi.org/10.4324/9780203771587
Council of Europe. (2018). Common European framework of reference for languages: Learning, teaching, assessment -companion volume with new descriptors. https://rm.coe.int/cefr-companion-volume-with-newdescriptors-2018/1680787989
Creswell, J. W., & Creswell, J. D. (2022). Research design: Qualitative, quantitative, and mixed methods approaches (6th ed.). Sage Publications.
Education First. (2023). EF English proficiency index. https://www.ef.com/assetscdn/WIBIwq6RdJvcD9bc8RMd/cefcom-epi-site/fact-sheets/2023/ef-epi-fact-sheet-thailand-english.pdf
Educational Testing Service. (2021). TOEFL iBT® test and score data summary 2021. https://www.ets.org/pdfs/toefl/toefl-ibt-test-score-data-summary-2021.pdf
Estaji, M., & Safari, F. (2023). Learning-oriented assessment and its effects on the perceptions and argumentative writing performance of impulsive vs. reflective learners. Language Testing in Asia, 13(1), 1–18. https://doi.org/10.1186/s40468-023-00248-y
Goh, C. C., & Burns, A. (2012). Teaching speaking: A holistic approach. Cambridge University Press.
Hamp-Lyons, L. (2017). Language assessment literacy for learning-oriented language assessment. Papers in Language Testing and Assessment, 6(1), 88–111. https://doi.org/10.58379/lixl1198
International English Language Testing System. (2022). Test taker performance 2022. https://www.ielts.org/forresearchers/test-statistics/test-taker-performance
Jones, N., & Saville, N. (2016). Learning oriented assessment (Vol. 45). Cambridge University Press.
Joshi, A., Kale, S., Chandel, S., & Pal, D. K. (2015). Likert scale: Explored and explained. British Journal of Applied Science & Technology, 7(4), 396–403. https://doi.org/10.9734/BJAST/2015/14975
Keppell, M., & Carless, D. (2006). Learning‐oriented assessment: A technology‐based case study. Assessment in Education: Principles, Policy & Practice, 13(2), 179–191. https://doi.org/10.1080/09695940600703944
Kim, A.-Y. A., & Kim, H. J. (2017). The effectiveness of instructor feedback for learning-oriented language assessment: Using an integrated reading-to-write task for English for academic purposes. Assessing Writing, 32, 57–71. https://doi.org/10.1016/j.asw.2016.12.001
Kim, H. J., & Kim, A. A. (2021). Examining the effectiveness of learning-oriented language assessment in second language reading-to-write tasks: Focusing on instructor feedback and self-assessment. Journal of Asia TEFL, 18(4), 1250–1265. https://doi.org/10.18823/asiatefl.2021.18.4.11.1250
Konold, K. E., Miller, S. P., & Konold, K. B. (2004). Using teacher feedback to enhance student learning. Teaching Exceptional Children, 36(6), 64–69. https://doi.org/10.1177/00400599040360060
Li, H., Xiong, Y., Hunter, C. V., Guo, X., & Tywoniw, R. (2020). Does peer assessment promote student learning? A meta-analysis. Assessment & Evaluation in Higher Education, 45(2), 193–211. https://doi.org/10.1080/02602938.2019.1620679
Little, D. (2005). The common European framework and the European language portfolio: Involving learners and their judgements in the assessment process. Language Testing, 22(3), 321–336. https://doi.org/10.1191/0265532205lt311oa
Mak, P., & Lee, I. (2014). Implementing assessment for learning in L2 writing: An activity theory perspective. System, 47, 73–87. https://doi.org/10.1016/j.system.2014.09.018
May, L., Nakatsuhara, F., Lam, D., & Galaczi, E. (2020). Developing tools for learning oriented assessment of interactional competence: Bridging theory and practice. Language Testing, 37(2), 165–188. https://doi.org/10.1177/0265532219879044
Mumpuni, K. E., Priyayi, D. F., & Widoretno, S. (2022). How do students perform a peer assessment? International Journal of Instruction, 15(3), 751–766. https://doi.org/10.29333/iji.2022.15341a
Murillo-Zamorano, L. R., & Montanero, M. (2018). Oral presentations in higher education: A comparison of the impact of peer and teacher feedback. Assessment & Evaluation in Higher Education, 43(1), 138–150. https://doi.org/10.1080/02602938.2017.1303032
Navaie, L. A. (2018). The effect of learning-oriented assessment on learning pronunciation among Iranian EFL learners. International Journal of Education and Literacy Studies, 6(2), 63–68. https://doi.org/10.7575/aiac.ijels.v.6n.2p.63
Phettongkam, H. (2017). Grammatical errors in spoken English of undergraduate Thai leaners in a communicative business English course. LEARN Journal: Language Education and Acquisition Research Network, 10(1), 95–118. https://so04.tci-thaijo.org/index.php/LEARN/article/view/135963
Phongsirikul, M. (2018). Traditional and alternative assessments in ELT: Students' and teachers' perceptions. rEFLections, 25(1), 61–84. https://so05.tci-thaijo.org/index.php/reflections/article/view/136267
Pinphet, P., & Wasanasomsithi, P. (2022). The effects of project-based blended learning with communication strategy instruction on English oral communication ability of undergraduate engineering students. rEFLections, 29(1), 207–231. https://so05.tci-thaijo.org/index.php/reflections/article/view/258952
Purpura, J. E., & Turner, C. E. (2014). A learning-oriented assessment approach to understanding the complexities of classroom-based language assessment [Paper presentation]. Roundtable on Learning-Oriented
Assessment in Language Classrooms and Large-Scale Contexts, Teachers College, Columbia University,
New York. https://www.tc.columbia.edu/tccrisls/the-tccrisls-program/Purpura_Turner_TRCRISLS_2014.pdf
Rahman, M. M. (2010). Teaching oral communication skills: A task-based approach. ESP World, 9(1), 1–11.
Rajprasit, K., & Hemchua, S. (2015). The English language & communication in the international workplace: An examination of Thai computer engineering professionals. 3L: Language, Linguistics, Literature, 21(3), 109–124. http://journalarticle.ukm.my/9072/1/9222-27896-1-PB.pdf
Ratminingsih, N. M., Artini, L. P., & Padmadewi, N. N. (2017). Incorporating self and peer assessment in reflective teaching practices. International Journal of Instruction, 10(4), 165–184. https://doi.org/10.12973/iji.2017.10410a
Ratminingsih, N. M., Marhaeni, A., & Vigayanti, L. (2018). Self-assessment: The effect on students' independence and writing competence. International Journal of Instruction, 11(3), 277–290. https://doi.org/10.12973/iji.2018.11320a
Sakulprasertsri, K. (2014). Effects of an English instruction using the flipped learning approach on English oral communication ability and motivation in English learning of upper secondary school students [Master’s thesis, Chulalongkorn University]. Chulalongkorn University Intellectual Repository. http://cuir.car.chula.ac.th/handle/123456789/46412
Santos, J. C., & Ramírez-Ávila, M. R. (2022). Improving speaking fluency through 4/3/2 technique and self-assessment. TESL-EJ, 26(2), 1–14. https://doi.org/10.55593/ej.26102a1
Sermsook, K., Liamnimitr, J., & Pochakorn, R. (2017). The impact of teacher corrective feedback on EFL student writers' grammatical improvement. English Language Teaching, 10(10), 43–49. https://doi.org/10.5539/elt.v10n10p43
Turner, C. E., & Purpura, J. E. (2016). Learning-oriented assessment in second and foreign language classrooms. In D. Tsagari & J. Banerjee (Eds.), Handbook of second language assessment (pp. 255–274). De Gruyter Mouton. https://doi.org/10.1515/9781614513827-018
Viengsang, R., & Wasanasomsithi, P. (2022). Effects of a learning-oriented reading assessment model on Thai undergraduate students' reading ability. LEARN Journal: Language Education and Acquisition Research Network, 15(1), 709–747. https://so04.tci-thaijo.org/index.php/LEARN/article/view/256744
Waluyo, B., Zahabi, A., & Ruangsung, L. (2024). Language assessment at a Thai university: A CEFR-based test of English proficiency development. rEFLections, 31(1), 25–47. https://so05.tci-thaijo.org/index.php/reflections/article/view/270418/181304
Watson Todd, R. (2019). How is English assessed at Thai schools? THAITESOL Journal, 32(1), 1–15. https://so05.tci-thaijo.org/index.php/thaitesoljournal/article/view/193942
Watson Todd, R., Pansa, D., Jaturapitakkul, N., Chanchula, N., Pojanapunya, P., Tepsuriwong, S., Towns, S. G., & Trakulkasemsuk, W. (2021). Assessment in Thai ELT: What do teachers do, why, and how can practices be improved? LEARN Journal: Language Education and Acquisition Research Network, 14(2), 627–649. https://so04.tci-thaijo.org/index.php/LEARN/article/view/253377
Widiastuti, I. A. M. S., Mukminatien, N., Prayogo, J. A., & Irawati, E. (2020). Dissonances between teachers' beliefs and practices of formative assessment in EFL classes. International Journal of Instruction, 13(1), 71–84. https://doi.org/10.29333/iji.2020.1315a
Wu, J. G., & Miller, L. (2020). Improving English learners’ speaking through mobile-assisted peer feedback. RELC Journal, 51(1), 168–178. https://doi.org/10.1177/0033688219895335
Xu, Q., Chen, S., Wang, J., & Suhadolc, S. (2021). Characteristics and effectiveness of teacher feedback on online business English oral presentations. The Asia-Pacific Education Researcher, 30(6), 631–641. https://doi.org/10.1007/s40299-021-00595-5
Zeng, W., Huang, F., Yu, L., & Chen, S. (2018). Towards a learning-oriented assessment to improve students’ learning—a critical review of literature. Educational Assessment, Evaluation and Accountability, 30, 211–250. https://doi.org/10.1007/s11092-018-9281-9