Developing Interview Guide in Qualitative Research: Problems and Solutions from a Needs Analysis Doctoral Study
Article Sidebar
Main Article Content
Abstract
This study underscores the critical role of pilot studies in qualitative needs analysis research, particularly in informing the design of effective interview guides for complex and diverse research settings. Using the three-stage interview guide development framework proposed by Naz et al. (2022), the pilot study engaged a heterogeneous group of stakeholders in business English education—including students, teachers, alumni, and employers—through both face-to-face and online interviews. The study aimed to identify potential methodological and logistical challenges that could hinder the main investigation. The findings highlighted key issues such as interviewer bias, insufficient depth of information, and the logistical difficulties of coordinating with participants across different geographical locations. In response, several strategies were adopted to enhance the quality and reliability of the main study. These include minimizing bias, clarifying interview objectives, adopting flexible and inclusive communication approaches, and leveraging technological tools to facilitate participation. By addressing these challenges, the study contributes valuable insights into the iterative process of developing robust interview protocols and emphasizes the importance of pilot studies in refining qualitative data collection methods in multilingual and multi-stakeholder research environments.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
Ahlin, E. (2019). Semi-structured interviews with expert practitioners: Their validity and significant contribution to translational research. Sage Publications. https://doi.org/10.4135/9781526466037 DOI: https://doi.org/10.4135/9781526466037
Ali, B. J., & Anwar, G. (2021). An empirical study of employees’ motivation and its influence job satisfaction. International Journal of Engineering Business and Management, 5(2), 21–30. https://doi.org/10.22161/ijebm.5.2.3 DOI: https://doi.org/10.22161/ijebm.5.2.3
Au, A. (2019). Thinking about cross-cultural differences in qualitative interviewing: Practices for more responsive and trusting encounters. The Qualitative Report, 24(1), 58-77. https://doi.org/10.46743/2160-3715/2019.3403 DOI: https://doi.org/10.46743/2160-3715/2019.3403
Aung, K. T., Razak, R. A., & Nazry, N. N. M. (2021). Establishing validity and reliability of semi-structured interview questionnaire in developing risk communication module: A pilot study. Edunesia: Jurnal Ilmiah Pendidikan, 2(3), 600–606. https://doi.org/10.51276/edu.v2i3.177 DOI: https://doi.org/10.51276/edu.v2i3.177
Bearman, M. (2019). Focus on methodology: Eliciting rich data: A practical approach to writing semi-structured interview schedules. Focus on Health Professional Education a Multi-Professional Journal, 20(3), 1-11. https://doi.org/10.11157/fohpe.v20i3.387 DOI: https://doi.org/10.11157/fohpe.v20i3.387
Belina, A. (2022). Semi-structured interviewing as a tool for understanding informal civil society. Voluntary Sector Review, 14(2), 331–347. https://doi.org/10.1332/204080522x16454629995872 DOI: https://doi.org/10.1332/204080522X16454629995872
Braun, V., & Clarke, V. (2019). To saturate or not to saturate? Questioning data saturation as a useful concept for thematic analysis and sample-size rationales. Qualitative Research in Sport, Exercise and Health, 13(2), 201-216. https://doi.org/10.1080/2159676x.2019.1704846 DOI: https://doi.org/10.1080/2159676X.2019.1704846
Braun, V., Clarke, V., Boulton, E., Davey, L., & McEvoy, C. (2020). The online survey as a qualitative research tool. International Journal of Social Research Methodology, 24(6), 641–654. https://doi.org/10.1080/13645579.2020.1805550 DOI: https://doi.org/10.1080/13645579.2020.1805550
Brown, J. D. (2016). Introducing needs analysis and English for specific purposes. Routledge. DOI: https://doi.org/10.4324/9781315671390
Buys, T., Casteleijn, D., Heyns, T., & Untiedt, H. (2022). A reflexive lens on preparing and conducting semi-structured interviews with academic colleagues. Qualitative Health Research, 32(13), 2030–2039. https://doi.org/10.1177/10497323221130832 DOI: https://doi.org/10.1177/10497323221130832
Creswell, J. W., & Poth, C. N. (2016). Qualitative inquiry and research design: Choosing among five approaches. Sage Publications.
Cuiccio, C., & Husby-Slater, M. (2018). Needs assessment guidebook: Supporting the development of district and school needs assessments. State Support Network.
de Villiers, C., Farooq, M. B., & Molinari, M. (2022). Qualitative research interviews using online video technology: Challenges and opportunities. Meditari Accountancy Research, 30(6), 1764–1782. https://doi.org/10.1108/medar-03-2021-1252 DOI: https://doi.org/10.1108/MEDAR-03-2021-1252
Dodgson, J. E. (2019). Reflexivity in qualitative research. Journal of Human Lactation, 35(2), 220–222. https://doi.org/10.1177/0890334419830990 DOI: https://doi.org/10.1177/0890334419830990
Gani, A., Imtiaz, N., Rathakrishnan, M., & Krishnasamy, H. N. (2020). A pilot test for establishing validity and reliability of qualitative interview in the blended learning English proficiency course. Journal of Critical Reviews, 7(5), 140–143. DOI: https://doi.org/10.31838/jcr.07.05.23
Guetterman, T. C. (2020). Qualitative, quantitative, and mixed methods research sampling strategies. Oxford University Press. DOI: https://doi.org/10.1093/obo/9780199756810-0241
Hays, D. G., & McKibben, W. B. (2021). Promoting rigorous research: Generalizability and qualitative research. Journal of Counseling & Development, 99(2), 178–188. https://doi.org/10.1002/jcad.12365 DOI: https://doi.org/10.1002/jcad.12365
Hutchinson, T., & Waters, A. (1987). English for specific purposes. Cambridge University Press. DOI: https://doi.org/10.1017/CBO9780511733031
Hutchinson, T., & Waters, A. (1992). English for specific purposes: A learning centered approach. Cambridge University Press.
Ibrahim, A., & Nashir, I. M. (2022). Trends and patterns of needs assessments in technical and vocational education: A thematic review. International Journal of Evaluation and Research in Education (IJERE), 11(1), 88–98. https://doi.org/10.11591/ijere.v11i1.21940 DOI: https://doi.org/10.11591/ijere.v11i1.21940
Indrayadi, T. (2023). Doctoral students’ challenges in preparing and publishing research in reputable international journals. Issues in Educational Research, 33(3), 1012–1029. https://search.informit.org/doi/10.3316/informit.T2024050800008690323662028
Kabaran, G. G. (2022). Graduate students’ perceptions of the academic writing process and its problems: A qualitative study in Turkey. Issues in Educational Research, 32(3), 943–959. https://search.informit.org/doi/10.3316/informit.654421548966818
Kaharuddin, Hikmawati, & Arafah, B. (2019). Needs analysis on English for vocational purpose for students of hospitality department. Knowledge E Social Sciences, 3(19), 344–387. https://doi.org/10.18502/kss.v3i19.4869 DOI: https://doi.org/10.18502/kss.v3i19.4869
Kaya, S. (2021). From needs analysis to development of a vocational English language curriculum: A practical guide for practitioners. Journal of Pedagogical Research, 5(1), 154–171. https://doi.org/10.33902/jpr.2021167471 DOI: https://doi.org/10.33902/JPR.2021167471
Khan, T. H., & MacEachen, E. (2022). An alternative method of interviewing: Critical reflections on videoconference interviews for qualitative data collection. International Journal of Qualitative Methods, 21, Article 1090063. https://doi.org/10.1177/16094069221090063 DOI: https://doi.org/10.1177/16094069221090063
Korstjens, I., & Moser, A. (2017). Series: Practical guidance to qualitative research. Part 4: Trustworthiness and publishing. European Journal of General Practice, 24(1), 120–124. https://doi.org/10.1080/13814788.2017.1375092 DOI: https://doi.org/10.1080/13814788.2017.1375092
Lasekan, O. A., Moraga-Pumarino, A. F., & Pachava, V. (2023). Using needs analysis to foster sustainability of business English courses: A case study of a university in the south of Chile. Sustainability, 15(22), Article 16074. https://doi.org/10.3390/su152216074 DOI: https://doi.org/10.3390/su152216074
Levitt, H. M., Motulsky, S. L., Wertz, F. J., Morrow, S. L., & Ponterotto, J. G. (2017). Recommendations for designing and reviewing qualitative research in psychology: Promoting methodological integrity. Qualitative Psychology, 4(1), 2–22. https://doi.org/10.1037/qup0000082 DOI: https://doi.org/10.1037/qup0000082
Long, M. H. (2005). Methodological issues in learner needs analysis. In M. H. Long (Ed.), Second language needs analysis (pp. 19–76). Cambridge University Press. https://doi.org/10.1017/cbo9780511667299.002 DOI: https://doi.org/10.1017/CBO9780511667299.002
Lungu, M. (2022). The coding manual for qualitative researchers. American Journal of Qualitative Research, 6(1), 232–237. https://doi.org/10.29333/ajqr/12085 DOI: https://doi.org/10.29333/ajqr/12085
Magaldi, D., & Berler, M. (2020). Semi-structured interviews. In V. Zeigler-Hill & T. K. Shackelford (Eds.), Encyclopedia of personality and individual differences (pp. 4825-4830). Springer. https://doi.org/10.1007/978-3-319-24612-3_857 DOI: https://doi.org/10.1007/978-3-319-24612-3_857
Maxwell, J. A. (2021). Why qualitative methods are necessary for generalization. Qualitative Psychology, 8(1), 111–118. https://doi.org/10.1037/qup0000173 DOI: https://doi.org/10.1037/qup0000173
Mortazavi, M. (2016). Needs analysis from different perspective: Period, focus and scope of analysis. International Journal of Research in Linguistics, Language Teaching and Testing, 1(6), 245-253.
Naz, N., Gulab, F., & Aslam, M. (2022). Development of qualitative semi-structured interview guide for case study research. Competitive Social Science Research Journal, 3(2), 42–52. https://cssrjournal.com/index.php/cssrjournal/article/view/170
Panyasai, P. (2023). Enhancing reading-comprehension abilities and attitudes of EFL students through utilizing content-creation tools in classroom presentations. International Journal of Learning Teaching and Educational Research, 22(7), 497–516. https://doi.org/10.26803/ijlter.22.7.26 DOI: https://doi.org/10.26803/ijlter.22.7.26
Panyasai, P., & Ambele, E. A. (2022). The study of cultural interactions in business English classroom using microethnography approach. NIDA Journal of Language and Communication, 27(42), 68–78.
Pomeranz, E. F., & Stedman, R. C. (2020). Measuring good governance: Piloting an instrument for evaluating good governance principles. Journal of Environmental Policy & Planning, 22(3), 428–440. https://doi.org/10.1080/1523908x.2020.1753181 DOI: https://doi.org/10.1080/1523908X.2020.1753181
Pranoto, B. E., & Suprayogi, S. (2020). A need analysis of ESP for physical education students in Indonesia. Premise Journal of English Education, 9(1), 94-110. https://doi.org/10.24127/pj.v9i1.2274 DOI: https://doi.org/10.24127/pj.v9i1.2274
Prince, D. (1984). Workplace English: Approach and analysis. The ESP Journal, 3(2), 109–116. https://doi.org/10.1016/0272-2380(84)90021-0 DOI: https://doi.org/10.1016/0272-2380(84)90021-0
Roberts, R. E. (2020). Qualitative interview questions: Guidance for novice researchers. The Qualitative Report, 25(9), 3185–3203. https://doi.org/10.46743/2160-3715/2020.4640 DOI: https://doi.org/10.46743/2160-3715/2020.4640
Ruslin, R., Mashuri, S., Rasak, M. S. A., Alhabsyi, F., & Syam, H. (2022). Semi-structured interview: A methodological reflection on the development of a qualitative research instrument in educational studies. IOSR Journal of Research & Method in Education (IOSR-JRME), 12(1), 22–29. https://doi.org/10.9790/7388-1201052229
Semlali, I., Tamches, E., Singy, P., & Weber, O. (2020). Introducing cross-cultural education in palliative care: Focus groups with experts on practical strategies. BMC Palliative Care, 19, Article 171. https://doi.org/10.1186/s12904-020-00678-y DOI: https://doi.org/10.1186/s12904-020-00678-y
Serafini, E. J., Lake, J. B., & Long, M. H. (2015). Needs analysis for specialized learner populations: Essential methodological improvements. English for Specific Purposes, 40, 11–26. https://doi.org/10.1016/j.esp.2015.05.002 DOI: https://doi.org/10.1016/j.esp.2015.05.002
Sönmez, H. (2019). An examination of needs analysis research in the language education process. International Journal of Education and Literacy Studies, 7(1), 8-17. https://doi.org/10.7575/aiac.ijels.v.7n.1p.8 DOI: https://doi.org/10.7575/aiac.ijels.v.7n.1p.8
Tracy, S. J. (2024). Qualitative research methods: Collecting evidence, crafting analysis, communicating impact. John Wiley & Sons.
Türkmen, G. (2023). Reflexivity and positionality in qualitative research: On being an outsider in the field. In E. Şen, E. Sandal-Önal, M. S. Uysal, & Y. G. Acar (Eds.), The political psychology of Kurds in Turkey (pp. 145–166). Springer. https://doi.org/10.1007/978-3-031-33291-3_8 DOI: https://doi.org/10.1007/978-3-031-33291-3_8
Varoy, E., Lee, K., Luxton-Reilly, A., & Giacaman, N. (2023). Draw a computing student. Proceedings of the 54th ACM Technical Symposium on Computer Science Education, 1, 903–909. https://doi.org/10.1145/3545945.3569795 DOI: https://doi.org/10.1145/3545945.3569795
Wu, X. I., Watson, B. M., & Baker, S. C. (2023). The role of language use and communication in Mainland Chinese students’ cross-cultural adaptation to Hong Kong: A qualitative investigative study. Language and Intercultural Communication, 24(1), 20–34. https://doi.org/10.1080/14708477.2023.2250748 DOI: https://doi.org/10.1080/14708477.2023.2250748
Yeong, M. L., Ismail, R., Ismail, N. H., & Hamzah, M. I. (2018). Interview protocol refinement: Fine-tuning qualitative research interview questions for multi-racial populations in Malaysia. The Qualitative Report, 23(11), 2700–2713. https://doi.org/10.46743/2160-3715/2018.3412 DOI: https://doi.org/10.46743/2160-3715/2018.3412
Yoon, B., & Murtaugh, D. (2024). Cultural and linguistic ideology in English textbooks in Korean contexts: Implications for educators. International Journal of Multicultural Education, 26(3), 58–76. https://doi.org/10.18251/ijme.v26i3.4657 DOI: https://doi.org/10.18251/ijme.v26i3.4657
