Developing a Short-term Study Abroad Survey
Article Sidebar
Main Article Content
Abstract
Study abroad programs offer students an exciting and effective way to experience language and culture. It also helps students grow individually. However, administrators need to confirm the program’s goals and objectives. This study examined the construct validity and reliability of a survey, which is the basis of development, conducted in a short-term study abroad program. Three main categories of the study abroad experience were examined: language, culture, and self-development. The results of a principal component analysis and Rasch model analysis indicated that the survey items are functioning appropriately and can be used for the basis in measuring the perceptions of students in a short-term study abroad program. Thus, the survey can help administrators assess their study abroad programs.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
Apple, M. T., & Neff, P. (2012). Using Rasch measurement to validate the big five factor marker questionnaire for a Japanese university population. Journal of Applied Measurement, 13(3), 276-296.
Aryadoust, V. [Statistics & Theory](2020, December 8). How to validate a Likert-scale questionnaire using Rasch analysis | A quick and effective guide [Video]. Youtube. https://www.youtube.com/watch?v=K-Xh2kr9duY&t=482s
Asaoka, T., & Yano, J. (2009). The contribution of “study abroad” programs to Japanese internationalization. Journal of Studies in International Education, 13(2), 174–188.
Bennett, M. J. (1986). A developmental approach to training for intercultural sensitivity. International Journal of Intercultural Relations, 10(2), 179–196.
Berger, M. (2019). Social experiences and linguistic outcomes through foreign language learners’ short stays abroad: A Japanese case [Doctoral dissertation, University of Exeter]. https://ore.exeter.ac.uk/repository/handle/10871/38165
Botes, E., Gottschling, J., Stadler, M., & Greiff, S. (2020). A systematic narrative review of International Posture: What is known and what still needs to be uncovered. System, 90, 102232, 1-12.
Cadd, M. (2012). Encourage students to engage with native speakers during study abroad. Foreign Language Annals, 45(1), 229-245.
Csizer, K., & Kormos, J. (2009). Learning experiences, selves and motivated learning behaviour: A comparative analysis of structural models of Hungarian secondary and university learners of English. In Z. Dornyei & E. Ushioda (Eds.), Motivation, language identity and the L2 self (pp. 98-119).
Cutrone, P., & Datzman, B. R. (2015). Japanese EFL university students and the study abroad experience: Examining L2 development and program satisfaction after three weeks in North America. TESOL International Journal, 10(2), 24-47.
Deardorff, D. (2015). Demystifying outcomes assessment for international educators: A practical approach. Stylus Publishing.
Douglas, S. R. (2015). Student perspectives on a short-term study abroad experience. In P. Clements, A. Krause & H. Brown (Eds.), JALT2014 conference proceedings, 208-216. Retrieved from https://jalt-publications.org/sites/default/files/pdf-article/jalt2014proc_021.pdf
Douglas, S. R. (2020). Counterfactual understandings: What Japanese undergraduate students wish they had known before a short-term study abroad experience. TESL-EJ, 23(4), 1–19. Retrieved from http://www.tesl-ej.org/wordpress/issues/volume23/ej92/ej92a2/
Engle, L., & Engle, J. (2004). Assessing language acquisition and intercultural sensitivity development in relation to study abroad program design. Frontiers: The Interdisciplinary Journal of Study Abroad, 10, 219–236.
Field, A. (2018). Discovering statistics using IBM SPSS statistics (5th ed.). Sage Publications.
Fisher, W. P. (2007). Rating Scale Instrument Quality Criteria. Rasch Measurement Transactions, 21(1), 1095.
Fujii, K., & Shackleford, N. (2018). What students learn from a short-term study abroad: Science and Technology majors. Kanazawa Institute of Technology (KIT) Progress, 26, 101-110.
Fujioka, K., & Agawa, T. (2007). Motivating learners through special activities in a study abroad program. In K. Bradford-Watts (Ed.), JALT2006 conference proceedings.
Furmanovsky, M. (2005). Japanese Students’ Reflections on a short-term language program. JALT Publications: The Language Teacher, 29(12), 3-9.
Hayashi, C., & Suzuki, R. (2017). A Study on the lasting effects of a short-term study abroad program on students’ English proficiency and affective variables. KATE Journal, 31, 15-28.
Horness, P. (2014). A social narrative inquiry of three Japanese university participants in a short-term study abroad program. Ryugaku: Explorations in Study Abroad, 7(1), 24–37.
Horness, P. (2018). Student survey responses from a short-term study abroad program. Ryugaku: Explorations in Study Abroad, 11(2), 2-27.
Horness, P., & Jaturapitakkul, N. (2021). Case study of a Japanese university study abroad program of English in Thailand. The Asian EFL Journal, 25(2), 63-94.
Ikeda, R. (2020). Learning outcomes and self-perceived changes among Japanese university students studying English in the Philippines. TESL-EJ, 23(4), 1-12.
Karlin, O. (2012). Changes in personality and oral competence after studying English abroad. The Asian EFL Journal (Conference Issue), 63, 22-30.
Kimura, K. (2006). Eigoken taizai ga gakusei no eigoryoku ni oyobosu eikyo – Tanki gogaku kenshu ni yori eigoryoku wa koujyo suruka [The influence of studying abroad on language proficiency: Do short-stay programs in English speaking countries affect students’ English proficiency?]. Bulletin of Policy and Management, Shobi-Gakuen University, 12, 1–20.
Kimura, K. (2011). Daigakusei no kaigai tanki kenshuu he no ichi kousatu: Listening to writing ni shouten wo atete [How effective the short-term studying program in an English-speaking country is for Japanese university students: Focusing on the listening and writing proficiencies]. Bulletin Policy and Management, Shobi-Gakuen University, 21, 17–30.
Kinginger, C. (2009). Language learning and study abroad: A critical reading of research. Palgrave Macmillan.
Koyanagi, S. (2018). Impact of intercultural communication during short-term study-abroad of Japanese students: Analysis from a perspective of cognitive modification. Journal of Intercultural Communication Research, 47(2), 105–120.
Kuno, H. (2011). Sanshuukan no tanki kaigai gogaku kenshuu ga daigakusei no eigonouryoku ni oyobosu eikyou ni tsuite [Effects of a short-term (3-week) study abroad program on the English proficiency of four-year college students]. Journal of Hokkaido Bunkyo University, 12, 127–145.
La Brack, B. (2012). What’s up with culture - Module 2.5: Say no to shoeboxing. Retrieved from http://www2.pacific.edu/sis/culture/
Linacre, J. M. (2003). Data variance: Explained, modeled and empirical. Rasch Measurement Transactions, 17(3), 942-943.
Linacre, J. M. (2008). Variance in data explained by Rasch measures. Rasch Measurement Transactions, 22(1), 1164.
Linacre, J. M. (2018, September 3). Detecting multidimensionality in Rasch data using Winsteps table 23 [video]. Youtube. https://www.youtube.com/watch?v=sna19QemE50
Linacre, J. M. (2022). Winsteps® Rasch measurement computer program User’s Guide. Version 5.2.3. Portland, Oregon: Winsteps.com
Linacre, J. M. (2022). Winsteps® (Version 5.2). Winsteps.com. Available from https://www.winsteps.com/
MEXT (The Ministry of Education, Culture, Sports, Science and Technology). (2017). Top global university. Retrieved from https://tgu.mext.go.jp/en/about/jisshi.html
Moritani, H., Manning, C., & Henneberry, S. (2016) Preliminary findings of L2 motivational changes in a short-term study abroad program. Shimane Journal of Policy Studies, 31, 41- 56.
Matsumoto, M. (2012). Effectiveness of short-term overseas English study abroad programs. Kyushu Lutheran College Visio: Research Reports, 42, 1-10.
Nakayama, A. (2013). Motivational changes through study abroad experience in the U.K. The JACET Chubu Journal, 12, 63-76.
Nowlan, A., & Wang, R. (2018). Study abroad self-selection amongst first-year Japanese university students. Journal of International and Comparative Education, 7(2), 65-81.
Otsu, R., & Satake, M. (2016). Tanki kaigai gogaku kenshu ha dorehodono koukaga arunoka –tokiwa daigaku no baai – [How effective is a short-term study abroad program?: A case of Tokiwa University], Webu Magajin, Ryugakukouryu, 65, 16-24.
Parada, R. Y., Ikeda, R., Ando, T., Hishida, M., Takeda, H., Aklog, D., Otachi, K., & Yasunobu, K. (2018). Efforts to promote global education in Japan: The case of Tottori University and overseas practical education programs. Journal of Education and Learning, 7(5), 62-74.
Pedhazur, E. J., & Schmelkin, L. P. (1991). Measurement, design, and analysis: An integrated approach. Lawrence Erlbaum Associates.
Pigott, J. (2011). Towards a richer understanding of the study abroad experience. Ryugaku: Study Abroad SIG Newsletter, 4(1), 2–10.
Shealy, C. N. (2016). Beliefs, Events, and Values Inventory (BEVI). In C. N. Shealy (Ed.), Making sense of beliefs and values: Theory, research, and practice (pp. 113–173). Springer Publishing Company.
Tabachnick, B. G., & Fidell, L. S. (2012). Using multivariate statistics (6th ed.). Allyn and Bacon.
Teichler, U., & Steube, W. (1991). The logics of study abroad programmes and their impacts. Higher Education, 21(3), 325-349.
Varela, O. E. (2017). Learning outcomes of study-abroad programs: A meta-analysis. Academy of Management Learning & Education, 16(4), 531–561.
Yamashita, T. (2022). Analyzing Likert scale surveys with Rasch models. Research Methods in Applied Linguistics, 1, 1-14.
Yamauchi, H. (2015). Measures for effective short-term study abroad: Case study of the department of intercultural relations and cross-cultural communication at the university of Nagasaki. Japan Student Service Organization (JASSO), 4(49), 1-11.
Yashima, T. (2002). Willingness to communicate in a second language: The Japanese EFL context. The Modern Language Journal, 86(1), 54-66.
Yashima, T., Zenuk-Nishide, L., & Shimizu, K. (2004). The influence of attitudes and affect on willingness to communicate and second language communication. Language Learning, 54, 119-152.
Yashima, T. (2009). International Posture and the ideal L2 self in the Japanese EFL context. In Z. Dornyei & E. Ushioda (Eds.), Motivation, language identity and the L2 self (pp. 144-163).
Yashima, T., & Zenuk-Nishide, L. (2008). The impact of learning contexts on proficiency, attitudes, and L2 communication: Creating an imagined international community. System, 36(4), 566–585.
Yokota, M. (2016). Survey of global personnel development and long-term impact of study abroad. Research Project No. 25245078. School of Global Japanese Studies, Meiji University, 1-19.