Computerized Adaptive Testing for Measuring Affective Domain
Keywords:
Computerized Adaptive Testing, Item Respose Theory, Affective domainAbstract
Computerized Adaptive Testing (CAT) is a form of testing that adapts to the examinee’s proficiency level (Latent Trait). Computerized Adaptive Testing consists of 5 components including : 1) Item Bank; 2) Starting the First Item; 3) Selecting the Next Item; 4) Scoring; and 5) Termination Criterion. This article aimed to present the basic knowledge of computerized adaptive testing and the situations of building computerized adaptive testing for affective domain. In addition, the challenges and aspects in developing computerized adaptive testing were discussed.
References
Becker, J., Fliege, H. Kocalevent, R. D., Bjorner, J. B, Rose, M., Walter, O. B., & Klapp, B. F. (2008). Functioning and Validity of a Computerized Adaptive Test to Measure Anxiety (A-Cat). Depression and Anxiety, 25, 182-194.
Bock, R. D., & Mislevy, R. J. (1982). Adaptive EAP Estimation of Ability in a Microcomputer Environment. Applied Psychological Measurement, 6(4), 431-444.
Choi, S. W. (2009). Firestar: Computerized adaptive testing (CAT) simulation program for polytomous IRT Models (Computer software). Applied Psychological Measurement, 33, 644-645.
De Ayala, R. J. (2009). The Theory and Practice of Item Response Theory. New York: The Guildfor Press.
Embetson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum.
Fliege, H., Becker, J., Walter, O. B., Bjorner, J. B., Klapp, B. F., & Rose, M. (2005). Development of a computer-adaptive test for depression (D-CAT). Quality of Life Research, 14, 2277-2291.
Gibbons, R. D., Weiss, D. J., Kupfer, D. J, Frank, E., Fagiolini, A., Grochocinski, V. J., Bhaumik, D. K., Stover, A., Bock, R. D., & Immekus, J. C. (2008). Using Computerized Adaptive Testing to Reduce the Burden of Mental Health Assessment. Psychiatric Services, 59(4), 361-368.
Han, K. T. (2007). WinGen: Windows software that generates IRT parameters and item responses. Applied Psychological Measurement, 31(5), 457-459.
Homjan, S., Thayreakum, S., & Kumpon, B. (2016). The efficiency of a Computerized Adaptive Testing (CAT) by applying multidimensional item response models. Social Sciences Research and Academic Journal, 11(31), 73-88. (in Thai)
Khumyoo, T., Chadcham, S., & Chinnasarn, K. (2012). Diagnostic of English reading skills by applying the attribute hierarchy model and computerized adaptive testing. Research Methodology & Cognitive Science, 10(2), 54-69. (in Thai)
Kirisci, L., Tarter, R., Reynolds, M., Ridenour, T., Stone, C., & Vanyukov, M. (2012). Computer adaptive testing of liability to addiction: Identifying individuals at risk. Drug and Alcoho Dependence, 123S, S79-S86.
Kocalevent, R. D., Rosec, M., Becker, J., Walterd, O. B., Fliegea, H., Bjorner, J. B., Kleiberb, D., & Klappa, B. F. (2009). An evaluation of patient-reported outcomes found computerized adaptive testing was efficient in assessing stress perception. Journal of Clinical
Epidemiology, 62, 278-287.
Olino, T. M., Yu, L., Klein, D. N., Rohde, P., Seeley, J. R., Pilkonis, P. A., & Lewinsohn, P. M. (2012). Measuring depression using item response theory: an examination of three measures of depressive symptomatology. International Journal of Methods in Psychiatric Research, 21(1), 76-85.
Patient–Reported Outcome Measurement Information System (PROMIS). (2013, November). PROMIS Overview. Retrieved November 25, 2013, from the PROMIS Dynamic Tools to Measure Health Outcomes for the Patient Perspective Web site: http://www.nihpromis.org/about/overview
Pilkonis, P. A., Choi, S. W., Reise, S. P., Stover, A. M., Riley, W. T., & Cella, D. (2011). Item Banks for Measuring Emotional Distress from the Patient-Reported Outcomes Measurement Information System (PROMIS): Depression, Anxiety, and Anger. Assessment, 18(3), 263-283.
Promsit, P., Suwannoi, P., & Maneelek, R. (2012). A study of ability estimation, item selection methods and test termination of multidimensional computerized adaptive testing. Journal of Education Khon Kaen University, 35(1), 38-47. (in Thai)
Rose, M., Bjorner, J. B., Becker, J., Fries, J. F., & Ware, J. E. (2006). Evaluation of a preliminary physical function item bank supported the expected advantages of the Patient-Reported Outcomes Measurement Information System (PROMIS). Journal of Clinical Epidemiology, 61, 17-33.
Sakolkijrungroj, S., Chadcham, S., & Sudhasani, S. (2015a). The development of computerized adaptive testing program for Thai happiness scale. Research Methodology & Cognitive Science, 13(1), 1-17. (in Thai)
---------. (2015b). The Item Bank Construction for Thai Happiness Scale (Computerized Adaptive Testing Version). In Burapha University International Conference 2015 Committee (Eds.), Burapha University International Conference 2015: Moving Forward to a Prosperous and Sustainable Community, July 10-12, 2015 Bangsaen Heritage Hotel Chon Buri (pp.33-45). Thailand: Burapha University. Retrieved from http://www.buuconference.buu.ac.th/buureg/getfile.php?file=file/BUU2015/proceedings.pdf
--------. (2016). The efficiency of computerized adaptive testing program for Thai happiness scale. Educational Measurement Mahasarakham University, 22(2), 321-331. (in Thai)
Siribencha, S., Pranee, C., & Seekhieo, D. (2013). A development of computerized adaptive testing of information and communication technology matter by estimation of ability by bayesian for students matthayom 3 students. Social Sciences Research and Academic
Journal, 8(22), 87-102. (in Thai)
Sittiparu, J., Tinnaworn, P., & Sukhanonsawat, S. (2016). Development of the computerized adaptive testing program for O-NET at the grade nine level. Educational Measurement Mahasarakham University, 22(1), 47-62. (in Thai)
Smits, N., Cuijpers, P., & Straten, A. V. (2011). Applying computerized adaptive testing to the CES-D scale: A simulation study. Psychiatry Research, 188, 147-155.
Smits, N., Zitman, F. G., Cuijpers, P., Hollander-Gijsman, M. E., & Carlier, I. V. (2012). A proof of principle for using adaptive testing in routine Outcome Monitoring: the efficiency of the Mood and Anxiety Symptoms Questionnaire -Anhedonic Depression CAT. BMC Medical Research Methodology, 12(4).
Sukhanonsawat, S., Chadcham, S., & Chinnasarn, K. (2012). Development of the next item selection procedure using decision theory in computerized adaptive testing. Research Methodology & Cognitive Science, 10(2), 71-85. (in Thai)
Thompson, N. A., & Weiss, D. J. (2011). A Framework for the Development of Computerized Adaptive Tests. Practical Assessment, Research & Evaluation, 16(1). Available online: http://pareonline.net/getvn.asp?v=16&n=1.
Vogels, A. G., Jacobusse, G. W., & Reijneveld, S. A. (2011). An accurate and efficient identification of children with psychosocial problems by means of computerized adaptive testing. BMC Medical Research Methodology, 11, 1-9.
Wainer, H., Dorans, N. J., Daniel, E., Flaugher, R., Green, B. F., Mislevy, R. J., Steinberg, L., & Thissen, D. (2000). Computerized Adaptive Testing: A Primer (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
Walter, O. B., Becker, J., Bjorner, J. B., Fliege, H., Klapp, B. F., & Rose M. (2007). Development and evaluation of a computer adaptive test for anxiety (Anxiety-CAT). Quality of Life Research, 16, 143-155.
Weiss, D. J., & Guyer, R. (2012). Manual for CATSim: Comprehensive simulation of computerized adaptive testing. St. Paul MN: Assessment Systems Corporation.
Yoes, M. (1997). PARDSIM (Computer software). Saint Paul, MN: Assessment Systems Corporation.
Zheng, Y., Chang, C. H., & Chang, H. H. (2013). Content-balancing strategy in bifactor computerized adaptive patient-reported outcome measurement. Quality of life research, 22(3), 491-499.
Bock, R. D., & Mislevy, R. J. (1982). Adaptive EAP Estimation of Ability in a Microcomputer Environment. Applied Psychological Measurement, 6(4), 431-444.
Choi, S. W. (2009). Firestar: Computerized adaptive testing (CAT) simulation program for polytomous IRT Models (Computer software). Applied Psychological Measurement, 33, 644-645.
De Ayala, R. J. (2009). The Theory and Practice of Item Response Theory. New York: The Guildfor Press.
Embetson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum.
Fliege, H., Becker, J., Walter, O. B., Bjorner, J. B., Klapp, B. F., & Rose, M. (2005). Development of a computer-adaptive test for depression (D-CAT). Quality of Life Research, 14, 2277-2291.
Gibbons, R. D., Weiss, D. J., Kupfer, D. J, Frank, E., Fagiolini, A., Grochocinski, V. J., Bhaumik, D. K., Stover, A., Bock, R. D., & Immekus, J. C. (2008). Using Computerized Adaptive Testing to Reduce the Burden of Mental Health Assessment. Psychiatric Services, 59(4), 361-368.
Han, K. T. (2007). WinGen: Windows software that generates IRT parameters and item responses. Applied Psychological Measurement, 31(5), 457-459.
Homjan, S., Thayreakum, S., & Kumpon, B. (2016). The efficiency of a Computerized Adaptive Testing (CAT) by applying multidimensional item response models. Social Sciences Research and Academic Journal, 11(31), 73-88. (in Thai)
Khumyoo, T., Chadcham, S., & Chinnasarn, K. (2012). Diagnostic of English reading skills by applying the attribute hierarchy model and computerized adaptive testing. Research Methodology & Cognitive Science, 10(2), 54-69. (in Thai)
Kirisci, L., Tarter, R., Reynolds, M., Ridenour, T., Stone, C., & Vanyukov, M. (2012). Computer adaptive testing of liability to addiction: Identifying individuals at risk. Drug and Alcoho Dependence, 123S, S79-S86.
Kocalevent, R. D., Rosec, M., Becker, J., Walterd, O. B., Fliegea, H., Bjorner, J. B., Kleiberb, D., & Klappa, B. F. (2009). An evaluation of patient-reported outcomes found computerized adaptive testing was efficient in assessing stress perception. Journal of Clinical
Epidemiology, 62, 278-287.
Olino, T. M., Yu, L., Klein, D. N., Rohde, P., Seeley, J. R., Pilkonis, P. A., & Lewinsohn, P. M. (2012). Measuring depression using item response theory: an examination of three measures of depressive symptomatology. International Journal of Methods in Psychiatric Research, 21(1), 76-85.
Patient–Reported Outcome Measurement Information System (PROMIS). (2013, November). PROMIS Overview. Retrieved November 25, 2013, from the PROMIS Dynamic Tools to Measure Health Outcomes for the Patient Perspective Web site: http://www.nihpromis.org/about/overview
Pilkonis, P. A., Choi, S. W., Reise, S. P., Stover, A. M., Riley, W. T., & Cella, D. (2011). Item Banks for Measuring Emotional Distress from the Patient-Reported Outcomes Measurement Information System (PROMIS): Depression, Anxiety, and Anger. Assessment, 18(3), 263-283.
Promsit, P., Suwannoi, P., & Maneelek, R. (2012). A study of ability estimation, item selection methods and test termination of multidimensional computerized adaptive testing. Journal of Education Khon Kaen University, 35(1), 38-47. (in Thai)
Rose, M., Bjorner, J. B., Becker, J., Fries, J. F., & Ware, J. E. (2006). Evaluation of a preliminary physical function item bank supported the expected advantages of the Patient-Reported Outcomes Measurement Information System (PROMIS). Journal of Clinical Epidemiology, 61, 17-33.
Sakolkijrungroj, S., Chadcham, S., & Sudhasani, S. (2015a). The development of computerized adaptive testing program for Thai happiness scale. Research Methodology & Cognitive Science, 13(1), 1-17. (in Thai)
---------. (2015b). The Item Bank Construction for Thai Happiness Scale (Computerized Adaptive Testing Version). In Burapha University International Conference 2015 Committee (Eds.), Burapha University International Conference 2015: Moving Forward to a Prosperous and Sustainable Community, July 10-12, 2015 Bangsaen Heritage Hotel Chon Buri (pp.33-45). Thailand: Burapha University. Retrieved from http://www.buuconference.buu.ac.th/buureg/getfile.php?file=file/BUU2015/proceedings.pdf
--------. (2016). The efficiency of computerized adaptive testing program for Thai happiness scale. Educational Measurement Mahasarakham University, 22(2), 321-331. (in Thai)
Siribencha, S., Pranee, C., & Seekhieo, D. (2013). A development of computerized adaptive testing of information and communication technology matter by estimation of ability by bayesian for students matthayom 3 students. Social Sciences Research and Academic
Journal, 8(22), 87-102. (in Thai)
Sittiparu, J., Tinnaworn, P., & Sukhanonsawat, S. (2016). Development of the computerized adaptive testing program for O-NET at the grade nine level. Educational Measurement Mahasarakham University, 22(1), 47-62. (in Thai)
Smits, N., Cuijpers, P., & Straten, A. V. (2011). Applying computerized adaptive testing to the CES-D scale: A simulation study. Psychiatry Research, 188, 147-155.
Smits, N., Zitman, F. G., Cuijpers, P., Hollander-Gijsman, M. E., & Carlier, I. V. (2012). A proof of principle for using adaptive testing in routine Outcome Monitoring: the efficiency of the Mood and Anxiety Symptoms Questionnaire -Anhedonic Depression CAT. BMC Medical Research Methodology, 12(4).
Sukhanonsawat, S., Chadcham, S., & Chinnasarn, K. (2012). Development of the next item selection procedure using decision theory in computerized adaptive testing. Research Methodology & Cognitive Science, 10(2), 71-85. (in Thai)
Thompson, N. A., & Weiss, D. J. (2011). A Framework for the Development of Computerized Adaptive Tests. Practical Assessment, Research & Evaluation, 16(1). Available online: http://pareonline.net/getvn.asp?v=16&n=1.
Vogels, A. G., Jacobusse, G. W., & Reijneveld, S. A. (2011). An accurate and efficient identification of children with psychosocial problems by means of computerized adaptive testing. BMC Medical Research Methodology, 11, 1-9.
Wainer, H., Dorans, N. J., Daniel, E., Flaugher, R., Green, B. F., Mislevy, R. J., Steinberg, L., & Thissen, D. (2000). Computerized Adaptive Testing: A Primer (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
Walter, O. B., Becker, J., Bjorner, J. B., Fliege, H., Klapp, B. F., & Rose M. (2007). Development and evaluation of a computer adaptive test for anxiety (Anxiety-CAT). Quality of Life Research, 16, 143-155.
Weiss, D. J., & Guyer, R. (2012). Manual for CATSim: Comprehensive simulation of computerized adaptive testing. St. Paul MN: Assessment Systems Corporation.
Yoes, M. (1997). PARDSIM (Computer software). Saint Paul, MN: Assessment Systems Corporation.
Zheng, Y., Chang, C. H., & Chang, H. H. (2013). Content-balancing strategy in bifactor computerized adaptive patient-reported outcome measurement. Quality of life research, 22(3), 491-499.
Downloads
Published
2017-12-29
How to Cite
สกลกิจรุ่งโรจน์ ส. (2017). Computerized Adaptive Testing for Measuring Affective Domain. Sukhothai Thammathirat Open University Journal, 30(2), 5–20. retrieved from https://so05.tci-thaijo.org/index.php/stouj/article/view/206656
Issue
Section
General Articles
License
บทความที่ได้รับการตีพิมพ์เป็นลิขสิทธิ์ของวารสารมหาวิทยาลัยสุโขทัยธรรมาธิราช
ข้อความที่ปรากฏในบทความแต่ละเรื่องในวารสารวิชาการเล่มนี้เป็นความคิดเห็นส่วนตัวของผู้เขียนแต่ละท่านไม่เกี่ยวข้องกับมหาวิทยาลัยสุโขทัยธรรมาธิราช และคณาจารย์ท่านอื่นๆในมหาวิทยาลัยฯ แต่อย่างใด ความรับผิดชอบองค์ประกอบทั้งหมดของบทความแต่ละเรื่องเป็นของผู้เขียนแต่ละท่าน หากมีความผิดพลาดใดๆ ผู้เขียนแต่ละท่านจะรับผิดชอบบทความของตนเองแต่ผู้เดียว
ห้ามนำข้อความทั้งหมด หรือบางส่วนไปพิมพ์ซ้ำ เว้นแต่จะได้รับอนุญาตจากกองบรรณาธิการวารสาร
