Digitally-mediated Language Assessment Practice (D-LAP): Qualitative Case Studies of Four Thai EFL University Lecturers
Article Sidebar
Main Article Content
Abstract
The escalating incorporation of digital pedagogical technology in higher education, particularly in the post-pandemic period, posits a potential evolution in the paradigm of language instruction and assessment. The focal point of this research is to uncover the digitally-mediated language assessment practices (D-LAP) employed by Thai EFL lecturers in the university context. To fulfill this purpose, four EFL lecturers from Thai universities were purposefully selected to partake in classroom observations and subsequent stimulated recall sessions. The primary objective of these classroom observations was to shed light on the participants’ assessment practices. Furthermore, the subsequent stimulated recall sessions were orchestrated to delve deeper into the participants’ chosen assessment methods. The findings revealed that the majority of lecturers exhibited an intermediate degree of digital assessment literacy. This was primarily manifested in their propensity to implement assessment tasks within a digital platform and to collaboratively formulate performance indicators with their students. Additionally, it was discerned that their assessment tasks were predominantly crafted based on those presented in their sourcebooks in order to uphold the instructors’ consistency in all course sections. The primary intention of these assessment tasks was to assess students’ learning and diagnose their knowledge, employing a diverse assortment of assessment methods. This research endeavors to offer meaningful contributions towards the augmentation of professional development programs centered around digitally-mediated language assessment.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
Al-Bahlani, S. M. (2019). Assessment literacy: A study of EFL teachers’ assessment knowledge, perspectives, and classroom behaviors [Doctoral dissertation, The University of Arizona]. UA Campus Repository. https://repository.arizona.edu/handle/10150/633240
Alhat, S. (2020). Virtual classroom: A future of education Post-COVID-19. Shanlax International Journal of Education, 8(4), 101-104. https://doi.org/10.34293/education.v8i4.3238
Alkharusi, H. (2021). English language teachers’ uses of classroom assessment. Anatolian Journal of Education, 6(1), 103-108. https://doi.org/10.29333/aje.2021.618a
Alkharusi, H., Aldhafri, S., Alnabhani, H., & Alkalbani, M. (2012). Educational assessment attitudes, competence, knowledge, and practices: An exploratory study of Muscat teachers in the Sultanate of Oman. Journal of Education and Learning, 1(2), 217-232. http://doi.org/10.5539/jel.v1n2p217
Arksey, H., & Knight, P. T. (1999). Interviewing for social scientists: An introductory resource with examples. Sage.
Arrafii, M. A., & Sumarni, B. (2018). Teachers’ understanding of formative assessment. Lingua Cultura, 12(1), 45-52. https://doi.org/10.21512/lc.v12i1.2113
Astiandani, F. R., & Anam, S. (2021). EFL teachers’ perceptions towards the implementation of online formative assessment amidst the COVID-19 pandemic. ELT Worldwide: Journal of English Language Teaching, 8(2), 269-277. https://doi.org/10.26858/eltww.v8i2.21326
Babaii, E., & Asadnia, F. (2019). A long walk to language assessment literacy: EFL teachers’ reflection on language assessment research and practice. Reflective Practice, 20(6), 745-760. https://doi.org/10.1080/14623943.2019.1688779
Berry, V., Sheehan, S., & Munro, S. (2019). What does language assessment literacy mean to teachers? ELT Journal, 73(2), 113-123. https://doi.org/10.1093/elt/ccy055
Bennett, R. E. (2011). Formative assessment: A critical review. Assessment in Education: Principles, Policy & Practice, 18(1), 5-25. https://doi.org/10.1080/0969594X.2010.513678
Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7–74. https://doi.org/10.1080/0969595980050102
Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(1), 5-31. https://doi.org/10.1007/s11092-008-9068-5
Brookhart, S. M. (2011). Educational assessment knowledge and skills for teachers. Educational Measurement: Issues and Practice, 30(1), 3-12. https://doi.org/10.1111/j.1745-3992.2010.00195.x
Brown, A. (2013). Multicompetence and second language assessment. Language Assessment Quarterly, 10(2), 219-235. https://doi.org/10.1080/15434303.2013.769551
Brown, H. D., & Abeywickrama, P. (2018). Language assessment: Principles and classroom practices (3rd ed.). Pearson.
Bryman, A. (2008). Social research methods (3rd ed.). Oxford University Press.
Carlsson Hauff, J., & Nilsson, J. (2022). Students’ experience of making and receiving peer assessment: The effect of self-assessed knowledge and trust. Assessment & Evaluation in Higher Education, 47(6), 959-971. https://doi.org/10.1080/02602938.2021.1970713
Chan, V. (2011). Teaching oral communication in undergraduate science: Are we doing Enough and doing it right? Journal of Learning Design, 4(3), 71-79.
Cheng, L., Rogers, T., & Hu, H. (2004). ESL/EFL instructors’ classroom assessment practices: Purposes, methods, and procedures. Language Testing, 21(3), 360-389. https://doi.org/10.1191/0265532204lt288oa
Chung, S. J., & Choi, L. J. (2021). The development of sustainable assessment during the COVID-19 pandemic: The case of the English language program in South Korea. Sustainability, 13(8), 4499. https://doi.org/10.3390/su13084499
Creswell, J. W. (2013). Research design: Qualitative, quantitative, and mixed-methods approaches. Sage.
DeLuca, C., & Johnson, S. (2017). Developing assessment capable teachers in this age of accountability. Assessment in Education: Principles, Policy & Practice, 24(2), 121-126. https://doi.org/10.1080/0969594X.2017.1297010
Díaz, C., Jara, A., Rosales, Y., & Sanhueza, M. (2021). Characterizing english assessment instruments: An overview of their design. Revista Chakiñan de Ciencias Sociales y Humanidades, (15), 80-96. https://doi.org/10.37135/chk.002.15.05
Dunbar, N. E., Brooks, C. F., & Kubicka-Miller, T. (2006). Oral communication skills in higher education: Using a performance-based evaluation rubric to assess communication skills. Innovative Higher Education, 31, 115-128. https://doi.org/10.1007/s10755-006-9012-x
Dupagne, M., Stacks, D. W., & Giroux, V. M. (2007). Effects of video streaming technology on public speaking students’ communication apprehension and competence. Journal of Educational Technology Systems, 35(4), 479-490. https://doi.org/10.2190/5947-4W72-303L-Q578
Duraku, Z. H., & Hoxha, L. (2020). The impact of COVID-19 on education and on the well-being of teachers, parents, and students: Challenges related to remote (online) learning and opportunities for advancing the quality of education. In Z. H. Duraka (Ed.), Impact of the COVID-19 pandemic on education and wellbeing: Implications for practice and lessons for the future (pp. 17-45). University of Prishtina Hasan Prishtina.
Eyal, L. (2012). Digital assessment literacy—The core role of the teacher in a digital environment. Journal of Educational Technology & Society, 15(2), 37-49.
Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113-132.
https://doi.org/10.1080/15434303.2011.642041
Frodden, M. C., Restrepo, M. I., & Maturana, L. (2009). Analysis of assessment instruments used in foreign language teaching. Íkala, Revista de Lenguaje y Cultura, 9(1), 171-201. https://revistas.udea.edu.co/index.php/ikala/article/view/3146
Gass, S. M., & Mackey, A. (2016). Stimulated recall methodology in applied linguistics and L2 research. Routledge.
Havard, B., Podsiad, M., & Valaitis, K. (2023). Peer assessment collaboration evaluation: An innovative assessment tool for online learning environments. TechTrends, 1-11. https://doi.org/10.1007/s11528-022-00832-8
Hosseini, A. S., & Azarnoosh, M. (2014). Iranian EFL instructor’s oral assessment practices: Purposes, methods, procedures. Procedia-Social and Behavioral Sciences, 98, 653-658. https://doi.org/10.1016/j.sbspro.2014.03.464
Imsa-ard, P. (2020). Voices from Thai EFL teachers: Perceptions and beliefs towards the English test in the national examination in Thailand. LEARN Journal: Language Education and Acquisition Research Network, 13(2), 269-287.
Imsa-ard, P. (2023). Language assessment literacy: Exploring Thai EFL teachers’ assessment knowledge, beliefs, and digitally-mediated assessment practices in classrooms [Doctoral dissertation]. Thammasat University.
Inbar-Lourie, O. (2008). Constructing a language assessment knowledge base: A focus on language assessment courses. Language Testing, 25(3), 385-402. https://doi.org/10.1177/0265532208090158
Jan-nesar, M. Q., Khodabakhshzadeh, H., & Motallebzadeh, K. (2020). Assessment literacy of Iranian EFL teachers: A review of recent studies. Journal of Asia TEFL, 17(2), 689-698. https://doi.org/10.18823/asiatefl.2020.17.2.27.689
Kantabutra, S., & Tang, J. (2010). Efficiency analysis of public universities in Thailand. Tertiary Education and Management, 16(1), 15-33. https://doi.org/10.1080/13583881003629798
Kaur, A., Young, D., & Kirkpatrick, R. (2016). English language education policy in Asia. Springer. https://doi.org/10.1007/978-3-319-22464-0_16
Krippendorff, K. (2011). Agreement and information in the reliability of coding. Communication Methods and Measures, 5(2), 93-112. https://doi.org/10.1080/19312458.2011.568376
Lam, R. (2015). Language assessment training in Hong Kong: Implications for language assessment literacy. Language Testing, 32(2), 169-197. https://doi.org/10.1177/0265532214554321
Liamputtong, P. (2009). Qualitative data analysis: conceptual and practical considerations. Health Promotion Journal of Australia, 20(2), 133-139. https://doi.org/10.1071/HE09133
Madhubhashini, G. T. (2022). Digital divide: Challenges faced by the university students in the context of Open and Distance Learning (ODL) during the covid-19 pandemic. The Journal of Development Communication, 33(1), 16-23. http://jdc.journals.unisel.edu.my/index.php/jdc/article/view/222
Murillo-Zamorano, L. R., & Montanero, M. (2018). Oral presentations in higher education: A comparison of the impact of peer and teacher feedback. Assessment & Evaluation in Higher Education, 43(1), 138-150. https://doi.org/10.1080/02602938.2017.1303032
Nam, Y. (2021). Exploring language teachers’ assessment practices and language learners’ perceptions towards assessment in the online environment [Doctoral dissertation, Georgia State University] ScholarWorks @Georgia State University. https://doi.org/10.57709/26839572
Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2015). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 42, 533-544. https://doi.org/10.1007/s10488-013-0528-y
Patton, M. Q. (2002). Two decades of developments in qualitative inquiry: A personal, experiential perspective. Qualitative Social Work, 1(3), 261-283. https://doi.org/10.1177/1473325002001003636
Popham, W. J. (2009). Assessment literacy for teachers: Faddish or fundamental? Theory into Practice, 48(1), 4-11. https://doi.org/10.1080/00405840802577536
Popham, W. J. (2011). Assessment literacy overlooked: A teacher educator’s confession. The Teacher Educator, 46(4), 265-273. https://doi.org/10.1080/08878730.2011.605048
Robson, C. (2002). Real world research: A resource for social scientists and practitioner-researchers (2nd ed.). Blackwell Publishing.
Rodriguez, M. C. (2004). The role of classroom assessment in student performance on TIMSS. Applied Measurement in Education, 17(1), 1-24. https://doi.org/10.1207/s15324818ame1701_1
Smith, L. F., Hill, M. F., Cowie, B., & Gilmore, A. (2014). Designing assessment for quality learning. Springer.
Stiggins, R. J. (1995). Assessment literacy for the 21st century. Phi Delta Kappan, 77(3), 238-246.
Stiggins, R. J., Arter, J. A., Chappuis, J., & Chappuis, S. (2006). Classroom assessment for student learning: Doing it right, using it well. Assessment Training Institute.
Sultana, N. (2019). Language assessment literacy: An uncharted area for the English language teachers in Bangladesh. Language Testing in Asia, 9(1), 1-14. https://doi.org/10.1186/s40468-019-0077-8
Taylor, L., & Harding, L. (n.d.). A testing time for testing: Assessment literacy as a force for social good in the time of coronavirus. https://acss.org.uk/a-testing-time-for-testing-assessment-literacy-as-a-force-for- socialgood-in-the-time-of-coronavirus/
Taylor, L. (2009). Developing assessment literacy. Annual Review of Applied Linguistics, 29, 21-36. https://doi.org/10.1017/S0267190509090035
van der Lans, R. M., van de Grift, W. J., van Veen, K., & Fokkens-Bruinsma, M. (2016). Once is not enough: Establishing reliability criteria for feedback and evaluation decisions based on classroom observations. Studies in Educational Evaluation, 50, 88-95. https://doi.org/10.1016/j.stueduc.2016.08.001
Vogt, K., & Tsagari, D. (2014). Assessment literacy of foreign language teachers: Findings of a European study. Language Assessment Quarterly, 11(4), 374-402. https://doi.org/10.1080/15434303.2014.960046
Watmani, R., Asadollahfam, H., & Behin, B. (2020). Demystifying language assessment literacy among high school teachers of English as a foreign language in Iran: Implications for teacher education reforms. International Journal of Language Testing, 10(2), 129-144.
Wiliam, D. (2011). What is assessment for learning? Studies in Educational Evaluation, 37(1), 3-14. https://doi.org/10.1016/j.stueduc.2011.03.001
Xie, Q., & Tan, S. (2019). Preparing primary English teachers in Hong Kong: Focusing on language assessment literacy. Journal of Asia TEFL, 16(2), 653-673. https://doi.org/10.18823/asiatefl.2019.16.2.14.653
Xu, Y., & Brown, G. T. (2017). University English teacher assessment literacy: A survey-test report from China. Papers in Language Testing and Assessment, 6(1), 133-158.
Yamtim, V., & Wongwanich, S. (2014). A study of classroom assessment literacy of primary school teachers. Procedia-Social and Behavioral Sciences, 116, 2998-3004. https://doi.org/10.1016/j.sbspro.2014.01.696
Yin, R. K. (1994). Discovering the future of the case study. Method in evaluation research. Evaluation Practice, 15(3), 283-290. https://doi.org/10.1177/109821409401500309