Development of a Computerized Dynamic Reading Assessment Program to Measure English Reading Comprehension of Thai EFL Undergraduate Students
Article Sidebar
Main Article Content
Abstract
The present study aimed to determine the effects of a computerized dynamic reading assessment (CDRA) program on English reading comprehension of university students with a lower level of English proficiency. Fulcher’s (2003) framework was adapted in program development divided into three phases: program development, program implementation, and program evaluation. An intact group of 30 Thai EFL undergraduate students with a lower level of English proficiency participated in this mixed-methods study which employed a test-train-test approach. Quantitative data collected from non-dynamic assessment (DA) pre- and post-tests as well as five DA tests were analyzed by means of inferential statistics, while qualitative data elicited from the questionnaire and interview protocol were analyzed using descriptive statistics and content analysis. The findings revealed that the CDRA program had a positive effect on the students’ reading comprehension, as demonstrated by the post-test results and a large effect size. Qualitative analysis revealed that the students had a positive perspective on the advantages offered by the CDRA program, expressed a preference for the software, and offered opinions and suggestions for further improvement. The findings of this study yield implications and recommendations for EFL instructors of English reading courses regarding the design of the CDRA programs interface and its utilization.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
Bakhoda, I., & Shabani, K. (2019a). Bringing L2 learners’ learning preferences in the mediating process through computerized dynamic assessment. Computer Assisted Language Learning, 32(3), 210–236. https://doi.org/10.1080/09588221.2018.1483950
Bakhoda, I., & Shabani, K. (2019b). Enhancing L2 learners’ ZPD modification through computerized-group dynamic assessment of reading comprehension. Innovation in Language Learning and Teaching, 13(1), 31–44. https://doi.org/10.1080/17501229.2017.1286350
Birjandi, P., & Naeni, J. (2012). Graduated prompts in dynamic assessment: The impacts on the Iranian EFL students’ reading comprehension performance. Iranian Journal of TEFL, 2(3), 3–26. https://www.academia.edu/30700093/Graduated_Prompts_in_Dynamic_Assessment_The_Impacts_on_the_Iranian_EFL_Students_
Reading_Comprehension_Performance
Cho, E., Compton, D. L., & Josol, C. K. (2020). Dynamic assessment as a screening tool for early identification of reading disabilities: A latent change score approach. Reading and Writing: An Interdisciplinary Journal, 33(3), 719–739. https://doi.org/10.1007/s11145-019-09984-1
Cole, M., John-Steiner, V., Scribner, S., & Souberman, E. (Eds.) (1978). Mind in society: The development of higher psychological processes. Harvard University Press.
Derakhshan, A., & Kordjazi, M. (2015). Implication of dynamic assessment in second/foreign language contexts. English Linguistics Research, 4(1), 41–48. https://doi.org/10.5430/elr.v4n1p41
Dörfler, T., Golke, S., & Artelt, C. (2009). Dynamic assessment and its potential for the assessment of reading competence. Studies in Educational Evaluation, 35, 77–82. http://dx.doi.org/10.1016/j.stueduc.2009.10.005
Ebadi, S., & Saeedian, A. (2015). The effects of computerized dynamic assessment on promoting at-risk advanced Iranian EFL students’ reading skills. Issues in Language Teaching, 4(2), 1–26. https://doi.org/10.22054/ilt.2015.7224
Ebadi, S., & Saeedian, A. (2016a). Exploring transcendence in EFL learners’ reading comprehension through computerized dynamic assessment. Iranian Journal of Language Teaching Research, 4(1), 27–45. https://doi.org/10.30466/ijltr.2016.20376
Ebadi, S., & Saeedian, A. (2016b). Planning future instructional programs through computerized L2 dynamic assessment. Teaching English with Technology, 16(4), 12–32. https://files.eric.ed.gov/fulltext/EJ1135663.pdf
Elder, C., & Davies, A. (2006). Assessing English as a lingua franca. Annual Review of Applied Linguistics, 26, 282–301. https://eclass.uoa.gr/modules/document/file.php/ENL264/assessing%20english%20as%20a%20lingua%20franca.pdf
Estaji, M., & Saeedian, A. (2020). Developing EFL learners' reading comprehension through computerized dynamic assessment. Reading Psychology, 41(4), 347–368. https://doi.org/10.1080/02702711.2020.1768981
Feuerstein, R., Rand, Y., & Hoffman, M. B. (1979). The dynamic assessment of retarded performers: The learning potential assessment device (LPAD), theory, instruments, and techniques. University Park Press.
Fulcher, G. (2003). Interface design in computer-based language testing. Language Testing, 20(4), 384–408. https://journals.sagepub.com/doi/pdf/10.1191/0265532203lt265oa
Gal'perin, P. I. (1992). Linguistic consciousness and some questions of the relationship between language and thought. Journal of Russian & East European Psychology, 30(4), 81–92. https://doi.org/10.2753/RPO1061-0405300481
Haywood, H. C., & Lidz, C. S. (2007). Dynamic assessment in practice: Clinical and educational application. Cambridge University Press.
Hidri, S. (2014). Developing and evaluating a dynamic assessment of listening comprehension in an EFL context. Language Testing in Asia, 4(1), 1–19. https://languagetestingasia.springeropen.com/articles/10.1186/2229-0443-4-4
Hidri, S., & Pileh Roud, L. F. (2020). Developing and using hints in computerized dynamic assessment of a TOEFL iBT reading exam. Heliyon, 6(9), Article e04985. https://doi.org/10.1016/j.heliyon.2020.e04985
Ismayana, P., Sulistyo, G. H., & Wijayati, P. H. (2020). Computerized dynamic assessment (C-DA) on reading comprehension for L2 learners of vocational high schools. Jurnal Pendidikan, 5(11), 1540–1549. http://journal.um.ac.id/index.php/jptpp/
Kamrood, A. M., Davoudi, M., Amirian, S. M. R., & Ghaniabadi, S. (2018). Transcendence of learning in an online computerized dynamic test of English listening. CALL-EJ, 19(1), 23–42. https://callej.org/index.php/journal/article/view/241
Kamrood, A. M., Davoudi, M., Ghaniabadi, S., & Amirian, S. M. R. (2019). Diagnosing L2 learners’ development through online computerized dynamic assessment. Computer Assisted Language Learning, 34(7), 868–897. https://doi.org/10.1080/09588221.2019.1645181
Kaoropthai, C. (2017). Intelligent diagnostic systems for reading strategy tutoring using scaffolding to enhance first-year students’ academic reading skills [Doctoral dissertation, Chulalongkorn University]. National Research Council of Thailand. http://doi.org/10.14457/CU.the.2017.279
Kazemi, A., Bagheri, M. S., & Rassaei, E. (2020). Dynamic assessment in English classrooms: Fostering learners’ reading comprehension and motivation. Cogent Psychology, 7(1), Article 1788912. https://doi.org/10.1080/23311908.2020.1788912
Ketamon, T., Pomduang, P., Na Phayap, N., & Hanchayanon, A. (2018). The implementation of CEFR in the Thai education system. Hatyai Academic Journal, 16(1), 77–88. https://so01.tci-thaijo.org/index.php/HatyaiAcademicJournal/article/view/130142
Klungthong, D., & Wasanasomsithi, P. (2024). Effects of dynamic assessment to improve academic vocabulary knowledge of Thai EFL low-proficiency university students. LEARN Journal: Language Education and Acquisition Research Network, 17(1), 599–631. https://so04.tci-thaijo.org/index.php/LEARN/index
Kozulin, A., & Garb, E. (2002). Dynamic assessment of EFL text comprehension of at-risk students. School Psychology International, 23(1), 112–127. https://doi.org/10.1177/0143034302023001733
Lantolf, J. P., & Poehner, M. E. (2004). Dynamic assessment of L2 development: Bringing the past into the future. Journal of Applied Linguistics and Professional Practice, 1(1), 49–72. https://doi.org/10.1558/japl.v1.i1.49
Lantolf, J. P., & Thorne, S. L. (2006). Sociocultural theory and the genesis of second language development. Oxford University Press.
Larissa, G. V., Irina, V. M., & Svetlana, A. G. (2018). Features of iSpring suite learning platform for teaching foreign languages. Revista Espacios, 39(20). http://www.revistaespacios.com/a18v39n20/a18v39n20p05.pdf
Lunrasri, Y. (2020). Measurement of reading literacy, growth, and learning potential of Grade 9 students: Application of computerized dynamic assessment concept [Doctoral dissertation, Chulalongkorn University]. ChulaDigiVerse. https://digiverse.chula.ac.th/Info/item/dc:20517
Lunrasri, Y., Tangdhanakanond, K., & Pasiphol, S. (2022). Effects of prompting type and learning achievement on reading literacy of ninth graders. Kasetsart Journal of Social Sciences, 43, 369–378. https://so04.tci-thaijo.org/index.php/kjss/article/view/258495/175115
McKay, S. L. (2018). English as an international language: What it is and what it means for pedagogy. RELC Journal, 49(1), 9–23. https://doi.org/10.1177/0033688217738817
McNamara, T. (2000). Language testing. Oxford University Press.
Modarresi, G., & Alavi, S. M. (2014). Designing and validating a test battery of computerized dynamic assessment of grammar. Teaching English Language, 8(2), Article 53816. https://www.teljournal.org/article_53816.html
Naeini, J., & Duvall, E. (2012). Dynamic assessment and the impact on English language learners' reading comprehension performance. Language Testing in Asia, 2(2), 22–41. http://dx.doi.org/10.1186/2229-0443-2-2-22
Nazari, B., & Mansouri, S. (2014). Dynamic assessment versus static assessment: A study of reading comprehension ability in Iranian EFL learners. Journal of Language and Linguistic Studies, 10(2), 134–156. https://www.jlls.org/index.php/jlls/article/view/256
Pishghadam, R., & Barabadi, E. (2012). Constructing and validating computerized dynamic assessment of L2 reading comprehension. Iranian Journal of Applied Linguistics, 15(1), 73–95. https://ijal.khu.ac.ir/article-1-79-.pdf
Pishghadam, R., Barabadi, E., & Kamrood, A. M. (2011). The differing effect of computerized dynamic assessment of L2 reading comprehension on high and low achievers. Journal of Language Teaching and Research, 2(6), 1353–1358. https://doi.org/10.4304/jltr.2.6.1353-1358
Poehner, M. E. (2005). Dynamic assessment of oral proficiency among advanced L2 learners of French [Doctoral dissertation, The Pennsylvania State University]. Electronic Theses and Dissertations for Graduate School. https://etda.libraries.psu.edu/catalog/6627
Poehner, M. E. (2007). Beyond the test: L2 dynamic assessment and the transcendence of mediated learning. The Modern Language Journal, 91(3), 323–340. https://doi.org/10.1111/j.1540-4781.2007.00583.x
Poehner, M. E. (2008). Dynamic assessment: A Vygotskian approach to understanding and promoting L2 development. Springer.
Poehner, M. E., & Infante, P. (2016). Chapter 17: Dynamic assessment in the language classroom. In D. Tsagari & J. Banerjee (Eds.), Handbook of second language assessment (pp. 275-290). De Gruyter. https://doi.org/10.1515/9781614513827-019
Poehner, M. E., & Lantolf, J. P. (2013). Bringing the ZPD into the equation: Capturing L2 development during computerized dynamic assessment (C-DA). Language Teaching Research, 17(3), 323–342. https://doi.org/10.1177/1362168813482935
Poehner, M. E., Zhang, J., & Lu, X. (2015). Computerized dynamic assessment (C-DA): Diagnosing L2 development according to learner responsiveness to mediation. Language Testing, 32(3), 337–357. https://doi.org/10.1177/0265532214560390
Poonpon, K. (2021). Test takers' perceptions of design and implementation of an online language testing system at a Thai university during the COVID-19 pandemic. PASAA, 62, 1–28. https://www.culi.chula.ac.th/th/pasaa/view/4
Rose, H., & Syrbe, M. (2018). Assessment practices in teaching English as an international language. In The TESOL Encyclopedia of English Language Teaching. John Wiley & Sons. https://doi.org/10.1002/9781118784235.eelt0655
Shabani, K. (2012a). Computerized dynamic assessment: An interventionist procedure to assess L2 reading. 6th National and 3rd International Conference of E-Learning and E-Teaching, 2012, 15–24. 10.1109/ICELET.2012.6333360
Shabani, K. (2012b). Dynamic assessment of L2 learners’ reading comprehension processes: A Vygotskian perspective. Procedia-Social and Behavioral Sciences, 32, 321–328. https://doi.org/10.1016/j.sbspro.2012.01.047
Shafiee, S., Talakoob, F., & Fatahi, M. (2018). Effects of dynamic assessment on the acquisition of the rhythm of English: The case of EFL learners’ attitudes. International Journal of English Linguistics, 8(5), 181–191. https://doi.org/10.5539/ijel.v8n5p181
Shrestha, P. N. (2017). Investigating the learning transfer of genre features and conceptual knowledge from an academic literacy course to business studies: Exploring the potential of dynamic assessment. Journal of English for Academic Purposes, 25, 1–17. https://doi.org/10.1016/j.jeap.2016.10.002
Siwathaworn, P., & Wudthayagorn, J. (2018). The impact of dynamic assessment on tertiary EFL students’ speaking skills. The Asian Journal of Applied Linguistics, 5(1), 142–155. https://caes.hku.hk/ajal/index.php/ajal/article/view/514
Taheri, R., & Vahid Dastjerdi, H. (2016). Impact of dynamic assessment on Iranian EFL learners' picture-cued writing. International Journal of Foreign Language Teaching Research, 4(13), 129–144. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2815986
Teo, A. (2012). Promoting EFL students’ inferential reading skills through computerized dynamic assessment. Language Learning & Technology, 16(3), 10–20. https://doi.org/10125/44292
Teo, A. (2014). Beyond traditional testing: Exploring the use of computerized dynamic assessment to improve EFL learners' reading. Arab World English Journal, 5(1), 42–58. https://www.awej.org/images/AllIssues/Volume5/Volume5Number1March2014/4.pdf
Tzuriel, D. (2000). Dynamic assessment of young children: Educational and intervention perspectives. Educational Psychology Review, 12(4), 385–435. https://doi.org/10.1023/A:1009032414088
Tzuriel, D. (2003). Foundations of dynnamic assessment of young children. In A. S. H. Seng, L. K. H. Pou, & T. O. Seng (Eds.), Mediated learning experience with children: Application across contexts (pp. 173–188). McGrawhill.
Tzuriel, D., & Shamir, A. (2002). The effects of mediation in computer assisted dynamic assessment. Journal of Computer Assisted Learning, 18(1), 21–32. https://doi.org/10.1046/j.0266-4909.2001.00204.x
University of Cambridge ESOL Examinations. (2009). PET handbook for teachers. Cambridge University Press. https://cambridge-exams.ch/sites/default/files/b1-preliminary-handbook-2020.pdf
Veerbeek, J., Vogelaar, B., Verhaegh, J., & Resing, W. C. (2019). Process assessment in dynamic testing using electronic tangibles. Journal of Computer Assisted Learning, 35(1), 127–142. https://doi.org/10.1111/jcal.12318
Vygotsky, L. S. (1962). Thought and language. MIT Press.
Waluyo, B. (2019). Thai first-year university students’ English proficiency on CEFR levels: A case study of Walailak University, Thailand. The New English Teacher, 13(2), 51–71. https://www.researchgate.net/publication/335079291_Thai_First-Year_University_Students'_English_Proficiency_on_CEFR_Levels#fullTextFileContent
Wang, J. R., & Chen, S. F. (2016). Development and validation of an online dynamic assessment for raising students’ comprehension of science text. International Journal of Science and Mathematics Education, 14(3), 373–389. https://doi.org/10.1007/s10763-014-9575-4
Wardhono, A., Kalista, A., Kurniawati, D., & Susilo, P. B. (2019). Quiz training program through iSpring Suite 8.0 to junior high school teachers Tuban. Aksiologiya: Jurnal Pengabdian Kepada Masyarakat, 3(1), 70–83. https://doi.org/10.30651/aks.v3i1.2326
Watson Todd, R. (2014). Support adaptive testing: The effects of scaffolds in computer-based tests. CALL-EJ: Computer Assisted Language Learning Electronic Journal, 15(1), 22–42. https://callej.org/index.php/journal/article/view/211
Weinerth, K., Koenig, V., Brunner, M., & Martin, R. (2014). Concept maps: A useful and usable tool for computer-based knowledge assessment? A literature review with a focus on usability. Computers & Education, 78, 201–209. https://doi.org/10.1016/j.compedu.2014.06.002
Yang, Y., & Qian, D. D. (2017). Assessing English reading comprehension by Chinese EFL learners in computerized dynamic assessment. Language Testing in Asia, 7(11), 1–15. https://doi.org/10.1186/s40468-017-0042-3
Yang, Y., & Qian, D. D. (2020). Promoting L2 English learners’ reading proficiency through computerized dynamic assessment. Computer Assisted Language Learning, 33(5-6), 628–652. https://doi.org/10.1080/09588221.2019.1585882
Zadkhast, M., Rezvani, E., & Lotfi, A. R. (2023). Effects of concurrent and cumulative group dynamic assessments on EFL learners’ development of reading comprehension micro-skills. Language Testing in Asia, 13, Article 29. https://doi.org/10.1186/s40468-023-00240-6
Zangoei, A., Zareian, G., Adel, S. M. R., & Adel, S. M. R., & Amirian, S. M. R. (2019). The impact of computerized dynamic assessment on Iranian EFL learners’ interlanguage pragmatic development. Journal of Modern Research in English Language Study, 6(4), 139–165. https://doi.org/10.30479/jmrels.2019.11536.1433
Zhang, R.-C., Lai, H.-M., Cheng, P.-W., & Chen, C.-P. (2017). Longitudinal effect of a computer-based graduated prompting assessment on students’ academic performance. Computers & Education, 110, 181–194. https://doi.org/10.1016/j.compedu.2017.03.016