Effectiveness of training: The conceptual framework and methodological strategy of a longitudinal study in the Portuguese armed forces
More details
Hide details
Military University Institute Research and Development Centre (CIDIUM) Military University Institute, Lisbon (Portugal)
Institute of Education University of Lisbon, Lisbon (Portugal)
Online publication date: 2019-03-14
Publication date: 2019-06-12
Security and Defence Quarterly 2019;24(2):155–176
Considering that this research is still ongoing, this paper focuses on the presentation of the conceptual framework and its interconnection with the methodological strategy for the empirical study that aims to study the learning transfer to the workplace of professional military education in the context of the Portuguese Armed Forces. Factors related to the trainees’ individual characteristics, the organisational context, the courses design, the organisational learning culture, the organisational commitment and the expectations of career development, as well as the relationships established between these factors and the intention to transfer, throughout the lifelong learning process, will be discussed. The empirical study will be carried out at three junctures - before the training, at the end of the training and three to six months after the training.

The study is conceptually based on Holton’s Holistic HRD Research and Evaluation (1996), Ajzen’s Theory of Planned Behaviour (1991), Watkins and Marsick’s model of learning organisations (1993, 1996) and Meyer and Allen’s (1991) concept of organisational commitment.

The study will be developed using a mixed strategy (quantitative/qualitative), applying a hypothetical-deductive and inductive reasoning, in which a longitudinal research design with a transversal component will be followed. The data collection for the empirical study will be done through a questionnaire, individual semi-structured interviews and discussion groups about the results.
Ajzen, I., 1985. Behavioral Interventions Based on the Theory of Planned Behavior. Action Control, 11–39.
Ajzen, I., 1991. The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50 (2), 179–211.
Ajzen, I., 2005. Attitudes, Personality and Behavior. 2nd ed.
Alnowaiser, A., 2017. Th e impact of work environment, individual characteristics, training design and motivation on training transfer to the work: the case of Saudi Arabian Public Security Organisation. University of Westminster.
Alvelos, R., Ferreira, A.I., and Bates, R., 2015. The mediating role of social support in the evaluation of training effectiveness. European Journal of Training and Development, 39 (6), 484–503.
Baldwin, T.Ti.T. and Ford, J.K., 1988. Transfer of Training: a Review and Directions for Future Research. Personnel Psychology, 41 (1), 63–105.
Banerjee, P., Gupta, R., and Bates, R., 2016. Influence of Organizational Learning Culture on Knowledge Worker’s Motivation to Transfer Training: Testing Moderating Effects of Learning Transfer Climate. Current Psychology, 1–12.
Bardin, L., 2010. Análise de conteúdo. Lisboa (Portugal): Edições, 70.
Bates, R., 2004. A Critical Analysis of Evaluation Practice: the Kirkpatrick Model and the Principle of Beneficence. Evaluation and Program Planning, (27), 341–347.
Bates, R., 2018. Translation Process for Surveys: From English to a Target Language.
Bates, R., Holton, E.F., and Hatala, J.P., 2012. A revised learning transfer system inventory: Factorial replication and validation. Human Resource Development International, 15 (5), 549–569.
Bryman, A., 1988. Quantity and Quality in Social Research. New York: Taylor & Francise-Library.
Creswell, J., 2013. Research Design: Qualitative, quantitative, and mixed methods approaches. 2nd ed.
Dimitrova, B.E., 2010. Translation process. In: Y. Gambier and L. van Doorslaer, eds. Handbook of Translation Studies. 406–411.
Dirani, K.M. and Kuchinke, K.P., 2011. Job satisfaction and organizational commitment: Validating the arabic satisfaction and commitment questionnaire (ASCQ), testing the correlations, and investigating the effects of demographic variables in the lebanese banking sector. International Journal of Human Resource Management, 22 (5), 1180–1202.
Gleiman, A. and Zacharakis, J., 2016. Continuing Professional Education in the Military. NEW DIRECTIONS FOR ADULT AND CONTINUING EDUCATION, Fall (151), 81–90.
Gould, S., 1979. Characteristics of Career Planners in Upwardly Mobile Occupations. Academy of Management Journal, 22 (3), 539–550.
Holton, E.F., 1996. The flawed four-level evaluation model. Human Resource Development Quarterly; Spring, 7 (1).
Holton, E.F., 2005. Holton’s Evaluation Model: New Evidence and Construct Elaborations. Advances in Developing Human Resources, 7 (1), 37–54.
Holton, E.F., Bates, R.A., Bookter, A.I., and Yamkovenko, V.B., 2007. Convergent and divergent validity of the learning transfer system inventory. Human Resource Development Quarterly, 18 (3), 385–419.
Holton, E.F., Bates, R.A., and Ruona, W.E.A., 2000. Development of a generalized learning transfer system inventory. Human Resource Development Quarterly, 11 (4), 333–360.
Hutchins, H.M., Nimon, K., Bates, R., and Holton, E., 2013. Can the LTSI predict transfer performance? Testing intent to transfer as a proximal transfer of training outcome. International Journal of Selection and Assessment, 21 (3), 251–263.
Joo, B.-K., 2010. Organizational commitment for knowledge workers: The roles of perceived organizational learning culture, leader-member exchange quality, and turnover intention. Human Resource Development Quarterly, 21 (1), 69–85.
Kirkpatrick, B.J.D. and Kirkpatrick, W.K., 2010. ROE’s Rising Star: Why Return of Expectations are getting so much attention [online]. Kirkpatrick Partners. Available from: https://www.kirkpatrickpartner... [Accessed 13 Jan 2018].
Kirkpatrick, D., 1996. Great ideas revisited: Revisiting Kirkpatrick’s Four-Level Model. Training & Development.
Kirkpatrick, D. and Kirkpatrick, J., 2008. Evaluating Training Programs - The Four Level Model. 3rd ed. Berrett Koehler.
Kirkpatrick, D.L., 1975. Evaluating training programs. Tata McGraw-Hill Education.
Kirkpatrick, J. and Kirkpatrick, W., 2015. An Introduction to the New World Kirkpatrick Model.
Kirkpatrick, J. and Kirkpatrick, W.K., 2014. The Kirkpatrick four levels: A fresh look after 55 years 1959-2014.
Kirkpatrick, J.D. and Kirkpatrick, W.K., 2011. Creating ROE: the end is the beginning [online]. Kirkpatrick Partners. Available from: https://www.kirkpatrickpartner... articles/Creating ROE ASTD 11 11.pdf?ver=2011-11-02-142832-000 [Accessed 13 Jan 2018].
Li, F. and Liu, P., 2014. Review of Organizational Learning Culture from the Perspective of Self-dependent Innovation. JOURNAL OF CHINESE ECONOMICS, 2 (1), 53–61.
Machin, M.A. and Fogarty, G.J., 1998. Assessing the antecedents of transfer intentions in a training context. International Journal of Training and Development, 8 (3), 222–236.
Machin, M.A. and Fogarty, G.J., 2003. Perceptions of training-related factors and personal variables as predictors of transfer implementation intentions. Journal of Business and Psychology, 18 (1), 51–71.
Machin, M.A. and Fogarty, G.J., 2008. The Effects of Self-Efficacy, Motivation to Transfer, and Situational Constraints on Transfer Intentions and Transfer of Training Organisational psychology View project Psychological assessment View project. Performance Improvement Quarterly, 10 (2), 98–115.
Maroco, J., 2018. Análise Estatística com Utilização do SPSS. Pêro Pinheiro.
Marsick, V.J. and Watkins, K.E., 2003. Demonstrating the Value of an Organization’s Learning Culture: The Dimensions of the Learning Organization Questionnaire. Advances in Developing Human Resources, 5 (2), 132–151.
Meyer, J.P. and Allen, N.J., 1991. A three-component conceptualization of organizational commitment. Human Resource Management Review, 1 (1), 61–89.
Meyer, J.P. and Allen, N.J., 1997. Commitment in the workplace: Theory, Research, and Application. Human Resource Development Quarterly.
Meyer, J.P., Allen, N.J., and Smith, C.A., 1993. Commitment to Organizations and Occupations: Extension and Test of a Three-Component Conceptualization. Journal of Applied Psychology, 78 (4), 538–551.
Ministério da Defesa Nacional, 2015. Estatuto do Instituto Universitário Militar (Decreto-Lei n. o 249/2015 de 28 de outubro). Lisboa: Diário da República, 9298–9311.
Mowday, R.T., Steers, R.M., and Porter, L.W., 1978. The Measurement of Organizational Commitment. Eugene, Oregon.
Orsi, D., 2017. Professional Military Education and Broadening Assignments: A Model for the Future. Joint Force Quarterly, (86), 41–49.
Quivy, R., Campenhoudt, L., 2008. Manual de Investigação em Ciências Sociais. 5 a Edição. Trajetos. Lisboa: Gradiva.
Santos, L. and Lima, J., 2016. Orientações metodológicas para a elaboração de trabalhos de investigação. Cadernos do IESM. Lisboa.
Schein, E.H., 1985. Organizational Culture & Leadership.
Stumpf, S.A., Colarelli, S.M., and Hartman, K., 1982. The Career Exploration Survey: A Summary of its Dimensionality, Reliability, and Validity. Psychological Reports, 51 (1), 117–118.
Toronto, N.W., 2015. Does Military Education Matter? [online]. E-International Relations. Available from:
Tracey, J.B., Tannenbaum, S.I., and Kavanagh, M.J., 1995. The Scholarly Commons Applying Trained Skills on the Job: The Importance of the Work Environment Part of the Hospitality Administration and Management Commons.
Velada, A.R.R., 2007. Avaliação da efi cácia da formação profi ssional: Factores que afectam a transferência da formação para o local de trabalho. Instituto Superior de Ciências do Trabalho e da Empresa.
Velada, R., Caetano, A., Bates, R., and Holton, E., 2009. Learning transfer – validation of the learning transfer system inventory in Portugal. Journal of European Industrial Training, 33 (7), 635–656.
Yang, B., Watkins, K.E., and Marsick, V.J., 1978. The Construct of the Learning Organization: Dimensions, Measurement, and Validation. Brown & Duguid Fiol & Lyles Isaacs & Senge.
Yang, B., Watkins, K.E., and Marsick, V.J., 2004. The construct of the learning organization: Dimensions, measurement, and validation. Human Resource Development Quarterly, 15 (1), 31–55.
Zikic, J. and Klehe, U.-C., 2006. Job loss as a blessing in disguise: The role of career exploration and career planning in predicting reemployment quality. Journal of Vocational Behavior, 69 (3), 391–409.