Innovative Behavioral Instrument for Social Impact Assessment: Creating and Evaluating a Measuring Instrument for Stakeholder Engagement in Development Projects Scale
Article Sidebar
Main Article Content
Abstract
High-quality behavioral instruments for social impact assessment are still lacking in Thailand. This research aims to create and evaluate the quality of instrument items, explore and confirm the components of the Measuring Instrument, and test the validity of the Stakeholder Engagement in Development Projects scale (SHEP). The sample for this study consisted of 520 stakeholders involved in development projects. The research process comprised four steps. In the process of examining item quality and conducting exploratory factor analysis, the results found that the SHEP measurement model includes 3 components with 15 items, explaining 70.09% of the variance. In the confirmatory factor analysis, the data showed the model was a good fit (χ² = 95.154, df = 75, p = 0.0581, RMSEA = 0.047, CFI = 0.983, TLI = 0.976, SRMR = 0.055). The SHEP scale demonstrated a reliability of 0.92. When testing convergent validity, the SHEP scale was positively correlated with the Social Support in Workplace scale (r = 0.516, p < .01). Additionally, incremental validity testing revealed that the scale could significantly predict increased Work Engagement Behavior (∆F = 14.34, p < .05), with a predictive power increase of 6.6%. The SHEP scale, which demonstrates both validity and reliability, can be confidently employed in social impact assessments and research.
Article Details
References
Abma, I. L., Rovers, M. & van der Wees, P. J. (2016). Appraising Convergent Validity of Patient-Reported Outcome Measures in Systematic Reviews: Constructing Hypotheses and Interpreting Outcomes. BMC research notes, 9, 1-5. https://doi.org/10.1186/s13104-016-2034-2
Alvarez, S., & Sachs S. (2021). Where do stakeholders come from?. Academy of Management Review, 48, 187–202. https://doi.org/10.5465/amr.2019.0077
Anusakulroj., C, Bhanthumnavin, D. & Meekun., K. (2022). Development and Validation of Bystander’s Emotionally Supportive Behavior scale in Junior High School Students. Journal of Social Development and Management Strategy, 24(2), 48-72. https://so04.tci-thaijo.org/index.php/jsd/article/view/257452
Bhanthumnavin, D. (2017). Research for Development and Validation of Research Moral Disengagement. The Periodical of Behavioral Science, 23(2), 118–138. https://so06.tci-thaijo.org/index.php/BSRI/article/view/92377
Bhanthumnavin, D. & Makanong, A. (2002). Antecedents and Consequences Concerning Students' Development Behaviors of Secondary School Mathematics Teachers. (Research report). Bangkok: National Research Council of Thailand. (In Thai).
Brown, J. S. & Duguid, P. (2002). Local Knowledge: Innovation in the Networked Age. Management Learning, 33(4), 427-437. https://doi.org/10.1177/1350507602334002
Bryson, J. M. (2004). What to do When Stakeholders Matter: Stakeholder Identification and Analysis Techniques. Public Management Review, 6(1), 21-53. https://doi.org/10.1080/14719030410001675722
Campbell, D. T. & Fiske, D. W. (1959). Convergent and discriminant Validation by the Multi Trait-Multimethod Matrix. Psychological Bulletin, 56(2), 81–105. https://doi.org/10.1037/h0046016
Carlson, K. D. & Herdman, A. O. (2012). Understanding the Impact of Convergent Validity on Research Results. Organizational Research Methods, 15(1), 17-32. https://doi.org/10.1177/1094428110392383
Castelló I., Etter M. & Arup Nielsen F. (2016). Strategies of Legitimacy Through Social Media: The Networked Strategy. Journal of Management Studies, 53, 402-432.
Chotratanakamol, K., Uansa-ard, S., Longthong, N. & Yaemyuean, A. (2024). The Effect of Psychological Training on Strengthening Family Behavioral Empowerment: A Path Analysis Approach. Thammasat Review, 27(1), 126–152. Retrieved from https://sc01.tci-thaijo.org/index.php/tureview/article/view/240696
Coakes, S. & Anagnostaras, J. (2024). Social Research Methods for Project Social Impact Assessment. In Handbook of Social Impact Assessment and Management (pp. 460-474). Edward Elgar Publishing.
Cohen, J. (1992). Statistical Power Analysis. Current Directions in Psychological Science, 1(3), 98-101. https://doi.org/10.1111/1467-8721.ep10768783
Cronbach, L. J. & Gleser, G. C. (1959). Interpretation of Reliability and Validity Coefficients. Journal of Educational Psychology, 50(5), 230–237. https://doi.org/10.1037/h0042848
Davies, B., Mallows, L. & Hoare, T. (2016). Supporting me Through Emotional Times, All Different Kinds of Behavior. Forensic Mental Health Service Users Understanding of Positive Behavioral Support. The Journal of Forensic Psychiatry & Psychology, 27(4), 530-550. https://doi.org/10.1080/14789949.2016.1174724
Freudenreich, B., Lüdeke-Freund, F. & Schaltegger, S. (2020). A Stakeholder Theory Perspective on Business Models: Value Creation for Sustainability. Journal of Business Ethics, 166(1), 3-18. https://doi.org/10.1007/s10551-019-04112-z
Goodman, M. S., Ackermann, N., Bowen, D. J. & Thompson, V. (2019). Content Validation of a Quantitative Stakeholder Engagement measure. Journal of Community Psychology, 47(8), 1937-1951. https://doi.org/10.1002/jcop.22239
Hair, J. F., Gabriel, M. & Patel, V. (2014). AMOS Covariance-Based Structural Equation Modeling (CB-SEM): Guidelines on Its Application as a Marketing Research Tool. Brazilian Journal of Marketing, 13(2), 44-55. https://ssrn.com/abstract=2676480
Hair, Jr., J. F., Black, W. C., Babin, B.J. & Anderson, R.F. (2010). Multivariate Data Analysis: A Global Perspective, (7th ed.). New Jersey: Pearson Prentice Hall.
Hoegl, M., Weinkauf, K. & Gemuenden, H. G. (2004). Inter Team Coordination, Project Commitment, and Teamwork in Multiteam R&D Projects: A Longitudinal Study. Organization Science, 15(1), 38-55. https://doi.org/10.1287/orsc.1030.0053
Hunsley, J. & Meyer, G. J. (2003). The Incremental Validity of Psychological Testing and Assessment: Conceptual, Methodological, and Statistical Issues. Psychological Assessment, 15(4), 446–455. https://doi.org/10.1037/1040-3590.15.4.446
Ijabadeniyi, A. & Vanclay, F. (2020). Socially-Tolerated Practices in Environmental and Social Impact Assessment Reporting: Discourses, Displacement, and Impoverishment. Land, 9(2), Article 33. https://doi.org/10.3390/land9020033
Kujala, J., Sachs, S., Leinonen, H., Heikkinen, A. & Laude, D. (2022). Stakeholder engagement: Past, present, and future. Business & Society, 61(5), 1136-1196. https://doi.org/10.1177/00076503211066595
Laude, D. (2020). Advancing quantitative Measurement in Stakeholder Theory: Indices of Stakeholder Engagement and Stakeholder Relationship Types (Doctoral dissertation) University of St. Gallen.
Meshack, M. (2004). Potential and limitations of Stakeholders' Participation in Community-Based Projects: The Case of Hanna Nassif Roads and Drains Construction And Maintenance in Dar es Salaam, Tanzania. International Development Planning Review, 26(1), 61-82. https://doi.org/10.3828/idpr.26.1.4
Miner, J. B. (1992). Industrial-Organizational Psychology. McGraw-Hill Book Company.
Mowday, R. T., Steers, R. M. & Porter, L. W. (1979). The Measurement of Organizational Commitment. Journal of Vocational Behavior, 14(2), 224-247. https://doi.org/10.1016/0001-8791(79)90072-1
Munday, J. (2021). Objective Truths or Subjective Realities: A Model of Social and Cultural Impact Assessment to Deliver Socially, Culturally, Ecologically and Economically Sustainable Development of Northern Australia (Doctoral dissertation), Charles Darwin University.
Nunnally, J. C. & Bernstein, I. H. (1994). Psychometric Theory (3rd ed.). New York, NY: McGraw-Hill.
Phillipson, J., Lowe, P., Proctor, A. & Ruto, E. (2012). Stakeholder Engagement and Knowledge Exchange in Environmental Research. Journal of Environmental Management, 95(1), 56-65. https://doi.org/10.1016/j.jenvman.2011.10.005
Rosnow, R. L., & Rosenthal, R. (2003). Effect Sizes for Experimenting Psychologists. Canadian Journal of Experimental Psychology / Revue Canadienne de Psychologie Expérimentale, 57(3), 221–237. https://doi.org/10.1037/h0087427
Sachs, M., Kaplan, J., Der Sarkissian, A. & Habibi, A. (2017). Increased Engagement of the Cognitive Control Network Associated with Music Training in Children During an fMRI Stroop Task. PLoS ONE. 12(10): e0187254. https://doi.org/10.1371/journal.pone.0187254
Schaufeli, W. B., Salanova, M., González-Romá, V. & Bakker, A. B. (2002). The Measurement of Engagement and Burnout: A Two-Sample Confirmatory Factor Analytic Approach. Journal of Happiness studies, 3, 71-92. https://doi.org/10.1023/A:1015630930326
Stutz, C. & Sachs, S. (2018). Facing the Normative Challenges: The Potential of Reflexive Historical Research. Business & Society, 57(1), 98-130. https://doi.org/10.1177/0007650316681989
Torphaiboon, P., Bhanthumnavin. D. & Bhanthumnavin. D. (2024). Research for Development and Validation of Intention to Elderly Caring Behavior Scale. Thai Interdisciplinary and Sustainability Review, 14(1), 1-11. https://doi.org/10.14456/tisr.2025.4
Winkler, A. L. P., Brown, J. A. & Finegold, D. L. (2019). Employees as Conduits for Effective Stakeholder Engagement: An Example from B Corporations. Journal of Business Ethics, 160, 913-936. https://doi.org/10.1007/s10551-018-3924-0
Ziegler, M. (2014). Stop and State Your Intentions!: Let’s not Forget the ABC of Test Construction. European Journal of Psychological Assessment, 30(4), 239-242. https://doi.org/10.1027/1015-5759/a000228