<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1d1 20130915//EN" "JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article" xml:lang="en"><front><journal-meta><journal-id journal-id-type="publisher-id">SDQ</journal-id><journal-title-group><journal-title>Security &amp; Defence Quarterly</journal-title><abbrev-journal-title>SDQ</abbrev-journal-title></journal-title-group><issn pub-type="epub">2544-994X</issn><issn pub-type="ppub">2300-8741</issn><publisher><publisher-name>Akademia Sztuki Wojennej</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="publisher-id">SDQ-37-00160</article-id><article-id pub-id-type="doi">10.35467/sdq/144434</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group></article-categories><title-group><article-title>The performance of the Portuguese Armed Forces and the relevance of military capabilities in 21st century: The different perspectives of citizens and militaries</article-title></title-group><contrib-group content-type="authors"><contrib contrib-type="author"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-2944-8867</contrib-id><name><surname>Gomes</surname><given-names>Paulo Jorge</given-names></name><email>paulo.gomes@academiamilitar.pt</email></contrib><aff id="aff1">Administration and Leadership, Portuguese Military Academy, A. Conde Castro Guimarães, 2720-113, Amadora, Portugal</aff></contrib-group><pub-date pub-type="epub"><day>21</day><month>02</month><year>2022</year></pub-date><volume>37</volume><issue>1</issue><fpage>1</fpage><lpage>17</lpage><history><date date-type="received"><day>08</day><month>07</month><year>2021</year></date><date date-type="rev-recd"><day>12</day><month>11</month><year>2021</year></date><date date-type="accepted"><day>02</day><month>12</month><year>2021</year></date></history><permissions><copyright-statement>© 2022 P.J. Gomes published by War Studies University, Poland.</copyright-statement><copyright-year>2022</copyright-year><license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/4.0"><license-p>This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/4.0/">http://creativecommons.org/licenses/by/4.0/</ext-link>).</license-p></license></permissions><abstract><p>A high performance level in a public organisation is fundamental. The Portuguese Armed Forces can influence the environment, both external and internal, and should therefore have a high performance level and adequate development of military capabilities. For that, it is fundamental to understand the importance of military capabilities for combatting the threats of the 21st century. This paper aims to analyse the influence of military capabilities for combating the current threats and risks in fulfilling the various operations, and for optimising the performance of the Portuguese Armed Forces. A quantitative analysis was carried out from citizen and military convenience samples through correlations between variables, as well as measures of central tendency like mean and standard deviation. The results show that the development of military capabilities has a positive effect on the performance of the Portuguese Armed Forces, combatting conventional threats and risks, as well as threats to civil protection. This capabilities performance is related with the execution of military operations (external and internal). Therefore, a proper development of military capabilities (output) with a special focus on human resources and privilege and the efficiency and quality of the missions (outcomes) are essential to combat the threats of the 21st century.</p></abstract><kwd-group><kwd>armed forces</kwd><kwd>public performance</kwd><kwd>military capabilities</kwd><kwd>new public administration</kwd><kwd>national defence strategy</kwd></kwd-group></article-meta></front><body><sec id="S1"><title>Introduction</title><p>The current strategic context resulting from current budget constraints and rapid technological change poses new challenges for states. These challenges require a rapid response capacity from public and private organisations. These organisations should be able to decide, in a timely manner, to respond to the needs of the market, society and the current security environment (<xref ref-type="bibr" rid="ref7">Borges, 2013</xref>; <xref ref-type="bibr" rid="ref23">Garcia, 2015</xref>; <xref ref-type="bibr" rid="ref24">Gomes, Mendes and Carvalho, 2010</xref>; <xref ref-type="bibr" rid="ref53">Vicente, 2011</xref>). In the context of public organisations, new theoretical movements have emerged within the scope of a New Public Administration: New Public Management (NPM), New Public Governance (NPG), Public Value Management (PVM) and New Public Service (NPS).</p><p>In the New Public Administration, public organisations should produce a public service with higher quality, optimising their performance in terms of the components of the public management cycle (inputs, outputs, activities and outcomes) and the respective efficiency and effectiveness indexes (<xref ref-type="bibr" rid="ref3">Alford and O’Flynn, 2009</xref>; <xref ref-type="bibr" rid="ref24">Gomes, Mendes and Carvalho, 2010</xref>; Moore, 2012; <xref ref-type="bibr" rid="ref39">O’Flynn, 2007</xref>).</p><p>The improvement of performance in the public sector is becoming more focussed on the organisational products produced (outputs) and not so much on the resources that come in (inputs), and the results that have an impact on society (outcomes) are also increasingly relevant (<xref ref-type="bibr" rid="ref19">Epstein and Buhovac, 2009</xref>; <xref ref-type="bibr" rid="ref16">Dooren, Bouckaert and Halligan, 2015</xref>; <xref ref-type="bibr" rid="ref54">Webber, 2004</xref>). This approach varies from organisation to organisation, as does the best way to adopt and implement this management process (<xref ref-type="bibr" rid="ref14">Dooren, 2005</xref>).</p><p>One of the current public organisations at the service of the State with the potential to influence the environment, both internally and externally, is its Armed Forces, and it is crucial that they are also at the service of civil society. At the level of Armed Forces, their military capabilities are essential. These are what allow countries to defend themselves against threats and adversaries, national and foreign, in a perspective of being ready to act whenever necessary. These capabilities constitute the output of military power (<xref ref-type="bibr" rid="ref1">Aberdeen, Thiébaux and Zhang, 2004</xref>; <xref ref-type="bibr" rid="ref28">Heng, 2012</xref>).</p><p>Regarding the performance of Portuguese Armed Forces, under the current Strategic Concept of National Defence, it is essential to develop military capabilities, to face and respond to these threats and risks and to fulfil international commitments. In order for the Portuguese Armed Forces to provide a quality public service with an adequate organisational performance, they should be able to enhance the components of the public management cycle, namely, their final product (output) to allow them to carry out their missions in different scenarios (outcome).</p><p>This article aims to analyse the influence that military capabilities have in combatting current threats and risks, in fulfilling the various missions, as well optimising the performance of the Portuguese Armed Forces. In this sense, it is intended to answer the following research question: What is the impact of the military capabilities in the performance of the Portuguese Armed Forces? In terms of methodology, given the nature of this investigation, a quantitative analysis was carried out through data collection from a convenience sample of citizens and Portuguese military officers participating in promotional and training courses at the Portuguese Military University Institute.</p></sec><sec id="S2"><title>Threats to humanity in the 21st century</title><p>The current security environment is faced with a wide variety of threats, risks and challenges. The threats and risks may be the same as in the last century but they currently have different acuity and perceptions. In addition, citizens “own perceptions of current threats and risks do not always coincide with countries” institutional views (<xref ref-type="bibr" rid="ref8">Borges, 2016</xref>; <xref ref-type="bibr" rid="ref17">Drent, Hendriks and Zandee, 2015</xref>). A threat is any intentional and violent event, action or event that jeopardises human lives, the unity of the international system, international peace and security (<xref ref-type="bibr" rid="ref42">Pires, 2016</xref>; <xref ref-type="bibr" rid="ref52">United Nations, 2004</xref>).</p><p>In view of the current security paradigm, it is therefore logical to state that new, transnational and more complex threats, like the expansion of activities associated with terrorism and transnational organised crime, the globalisation of cyber threats, the emergence of regional civil and military conflicts and natural disasters, bring to light more difficulties in terms of global peace and internal security (<xref ref-type="bibr" rid="ref4">Bachmann and Gunneriusson, 2015</xref>; <xref ref-type="bibr" rid="ref18">Duke and Ojanen, 2006</xref>; <xref ref-type="bibr" rid="ref21">Feiteira, 2016</xref>; <xref ref-type="bibr" rid="ref45">Ritchie, 2011</xref>). These transnational and hybrid threats present a high risk for a State, interfering in its functions, and have a high potential for exploiting structural and cyclical vulnerabilities. Therefore, several countries ought to establish and update national defence measures (<xref ref-type="bibr" rid="ref4">Bachmann and Gunneriusson, 2015</xref>; <xref ref-type="bibr" rid="ref22">Fernandes, 2005</xref>).</p><p>As for the different threats and risks to security, <xref ref-type="bibr" rid="ref8">Borges (2016)</xref> analyses the institutional perspectives of transnational threats and risks based on a comparative analysis of the national strategies of the five permanent members of the Security Council of the United Nations (UN). Although the sample is small, the study is representative in terms of political, economic, and military weight. In this study, the author concludes that the threats of five of the members of the UN CS Council “are mostly common with regard to transnational threats, despite the different readings that are occasionally made of the same threats and the different regional and local concerns, issues directly and comprehensively related to the values, interests and political objectives of each State” (<xref ref-type="bibr" rid="ref8">Borges, 2016</xref>, p. 48).</p><p>As Portugal is a member (founder) of the North Atlantic Treaty Organisation (NATO), it is also responsible for contributing to strengthening it through the cooperative defence of peace and security in the European and Euro-Atlantic regions, within the scope of its international commitments with NATO. The modern security environment contains a wide and growing set of challenges for the security of territory and populations. Citizens of allied nations depend on NATO for their defence. Thus, NATO’s essential mission will remain the same: ensuring that it remains an unparalleled community of freedom, peace, security and shared values (<xref ref-type="bibr" rid="ref38">NATO, 2010</xref>). NATO’s current defence stance is based on an effective combination of systems, weapons and forces trained to work together seamlessly. This situation suggests that member countries must have adequate and always ready capabilities for facing these threats, and it is essential to invest correctly (<xref ref-type="bibr" rid="ref17">Drent, Hendriks and Zandee, 2015</xref>).</p><p>At NATO level, the concept of continuing to be effective against new threats remains, identifying collective defence, crisis management and cooperative security as the essential tasks to be carried out to ensure the safety of its members. By specifying these tasks better (<xref ref-type="bibr" rid="ref38">NATO, 2010</xref>), at the level of collective defence, it is essential to develop and acquire military capabilities to face the current threats, through multinational cooperation, to obtain economies of scale, reducing costs and providing interoperability of means. The NATO Defence Planning Process is the primary means of identifying and prioritising the necessary resources, with an emphasis on the defence industry in member countries. Adequate resources and new partners are required in times of change, namely to:</p><p><list list-type="bullet"><list-item><p>reconfigure the link between member countries against new threats and to guarantee the security of citizens;</p></list-item><list-item><p>work more closely with important international partners, namely the United Nations, the European Union and Russia, in the prevention and management of crises and conflicts;</p></list-item><list-item><p>create conditions for a world without nuclear weapons; however, if there are nuclear weapons in the world, NATO will remain a nuclear Alliance;</p></list-item><list-item><p>commit NATO to a more effective, efficient, and flexible alliance, so that taxpayers can see results in terms of money invested in defence.</p></list-item></list></p><p>The great certainty for the future is that NATO cannot depend on the power of the USA. The investment in the defence of the different member countries should be appropriate and reach 2% of the weight of the Gross Domestic Product in 2024 (<xref ref-type="bibr" rid="ref55">Zandee, 2019</xref>).</p><p>At the level of analysis of current challenges (threats and risks) to national security and defence, the measurement variables used are those suggested either by <xref ref-type="bibr" rid="ref21">Feiteira (2016)</xref> or by <xref ref-type="bibr" rid="ref8">Borges (2016)</xref> in terms of the security strategies of several countries and organisations. These challenges are those contained in the Eurobarometer 432 questionnaire and are also in line with the current Strategic Concept of National Defence (<xref ref-type="bibr" rid="ref33">Ministério da Defesa Nacional, 2013</xref>):</p><p><list list-type="bullet"><list-item><p>Organised crime;</p></list-item><list-item><p>Terrorism;</p></list-item><list-item><p>Cybercrime;</p></list-item><list-item><p>Border management;</p></list-item><list-item><p>Natural and man-made disasters.</p></list-item></list></p></sec><sec id="S3"><title>Public organisational performance</title><p>Performance management took on a more relevant role from the end of the seventies onwards, being seen as an integrated approach, to ensure the sustainable success of an organisation. The development of the New Public Administration was based on a variety of ideas from public management theories (<xref ref-type="bibr" rid="ref25">Gruening, 2001</xref>; <xref ref-type="bibr" rid="ref41">Osborne, 2006</xref>), with the aim of bridging the weaknesses and improving the strengths of business management.</p><p>With the introduction of business criteria and principles of public management, such as competition between the services provided, the increase in power and citizen participation, the public sector should be as efficient and effective as possible. These principles and ideas are emphasised by the approach called Public Value Management (PVM), in which public value results mainly from organisational performance (<xref ref-type="bibr" rid="ref34">Moore, 2003</xref>, p. 18, 2012; <xref ref-type="bibr" rid="ref36">Moore and Khagram, 2004</xref>; <xref ref-type="bibr" rid="ref49">Stoker, 2006</xref>). In addition to this approach, at the level of the New Public Administration, new ways of enhancing relations between citizens and public organisations have also been seen. Responding to citizens’ preferences should be one of the current major objectives so that they play an active part in improving the quality of services (<xref ref-type="bibr" rid="ref39">O’Flynn, 2007</xref>).</p><p>The focus of public management should be citizens, the community and civil society, so there must be a more humanistic approach and public policies favourable to democracy. In this way, a new relationship is established between the state and society (<xref ref-type="bibr" rid="ref46">Robinson, 2015</xref>). The citizen must be valued, and must be distinguished from a simple consumer of public goods and services (<xref ref-type="bibr" rid="ref11">Bryson, Crosby and Bloomberg, 2014</xref>; <xref ref-type="bibr" rid="ref13">Denhardt and Denhardt, 2000</xref>).</p><p>Organisational performance is obtained when the inputs produce the quantity and quality of the desired outputs through the organisation of activities, resulting in adequate outcomes for society. Assessment of the organisations’ outcomes is the main interest of performance management (<xref ref-type="bibr" rid="ref9">Bouckaert, 2013</xref>; <xref ref-type="bibr" rid="ref15">Dooren, 2006</xref>; <xref ref-type="bibr" rid="ref40">OECD, 2009</xref>). But, regarding the performance of public organisations, the inputs are difficult to measure and the outputs are hard even to conceptualise (<xref ref-type="bibr" rid="ref30">Klein et al., 2013</xref>). For a public organisation to optimise its organisational performance, it is important to understand the inputs that go to the organisation, the outputs made based on these inputs, and the outcomes that result from being made available to the society of outputs. Good organisational performance is thus obtained through the appropriate combination of these components (inputs, outputs and outcomes), analysing the following variables (<xref ref-type="bibr" rid="ref9">Bouckaert, 2013</xref>; <xref ref-type="bibr" rid="ref15">Dooren, 2006</xref>; <xref ref-type="bibr" rid="ref40">OECD, 2009</xref>):</p><p><list list-type="bullet"><list-item><p>efficiency: number of resources used per unit of service provided;</p></list-item><list-item><p>productivity: quantity of service provided per unit of resource used;</p></list-item><list-item><p>effectiveness of the service provided: number of effects or impacts on society per unit of service provided;</p></list-item><list-item><p>cost-effectiveness ratio (economy): amount of social benefit per unit of resource used.</p></list-item><list-item><p>quality: reflect the set of properties and characteristics of goods or services, giving them the ability to satisfy the explicit or implicit needs of users.</p></list-item></list></p></sec><sec id="S4"><title>The Portuguese armed forces performance</title><p>The adoption of business principles at the level of public management implies that the public sector must be efficient and effective to improve its performance. The need for a New Public Administration focused on high organisational performance now appears as a need in terms of the literature on public administration management.</p><p>With regard to public organisations, Moore (2003, p. 18, 2013) and <xref ref-type="bibr" rid="ref36">Moore and Khagram (2004)</xref> believes that citizens want their governments to have a combination of the following objectives that enhance public value:</p><p><list list-type="bullet"><list-item><p>high performance public services and not simply bureaucratic;</p></list-item><list-item><p>efficient and effective public organisations to achieve the desired social results;</p></list-item><list-item><p>public organisations that operate fairly and lead to fair conditions in society at large.</p></list-item></list></p><p>In terms of public organisational performance, the current emphasis is centred on the efficiency and effectiveness of the organisation and its results (<xref ref-type="bibr" rid="ref36">Moore and Khagram, 2004</xref>). The efficiency improvement can be achieved by increasing the outputs with the same inputs (inputs), or maintaining the results with a reduction in the inputs. Such as <xref ref-type="bibr" rid="ref29">Julnes and Holzer (2001)</xref> and <xref ref-type="bibr" rid="ref44">Poister (2003)</xref> found that outputs are essential to achieving outcomes, with output measures being more widely used than measures of inputs and outcomes. Output measures are fundamental in the allocation of resources, in the management and monitoring of programmes and, also, in the dissemination of information for management.</p><p>The importance of achieving the right outputs (outputs) is emphasised, preferably by efficiently managing the inputs (inputs) in order to improve the results (outcomes) and, thus, bring added value to public organisations (<xref ref-type="bibr" rid="ref6">Boland and Fowler, 2000</xref>; <xref ref-type="bibr" rid="ref54">Webber, 2004</xref>). Organisational performance is maximised when the inputs produce the desired outputs in quantity and quality through the organisation of activities, resulting in adequate outcomes for society (<xref ref-type="bibr" rid="ref9">Bouckaert, 2013</xref>; <xref ref-type="bibr" rid="ref15">Dooren, 2006</xref>; <xref ref-type="bibr" rid="ref40">OECD, 2009</xref>). <xref ref-type="fig" rid="F1">Figure 1</xref> emphasises the relationship between efficiency and effectiveness in order to optimise organisational performance at the public sector level.</p><fig id="F1" orientation="portrait" position="float"><label>Figure 1</label><caption><p>The public management cycle to optimize performance.</p><p>Source: Adapted from <xref ref-type="bibr" rid="ref35">Moore (2013)</xref>.</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://securityanddefence.pl/f/fulltexts/144434/SDQ-37-00160-g001_min.jpg" xlink:fullhref="https://securityanddefence.pl/f/fulltexts/144434/SDQ-37-00160-g001.jpg"/></fig><p>The measurement of outputs has two distinct advantages, namely, it uses more general performance indicators and provides opportunities for practical learning (<xref ref-type="bibr" rid="ref40">OECD, 2009</xref>). “Despite many uncertainties in the relationship between public sector outputs and the intended results or outcomes, measuring outputs is fundamental to any empirical understanding of performance in the public sector” (<xref ref-type="bibr" rid="ref40">OECD, 2009</xref>, p. 43). However, the nature of the outputs is different between organisations, and should be adjusted, thus allowing to create results with an effect on society (<xref ref-type="bibr" rid="ref15">Dooren, 2006</xref>).</p><p>The performance of the Portuguese Armed Forces is associated with the inherent fulfilment of the missions according to their Strategic Concept of National Defence (<xref ref-type="bibr" rid="ref20">Estado – Maior General das Forças Armadas, 2018</xref>). In order to perform, it is essential to implement a capacity planning methodology, considering efficiency and effectiveness criteria i.e. how well the Armed Forces uses those resources for military purposes (<xref ref-type="bibr" rid="ref5">Beckley, 2010</xref>). In Portugal, priority should be given to the development of capacities that contribute to (<xref ref-type="bibr" rid="ref2">Aguiar-Branco, 2014</xref>):</p><p><list list-type="bullet"><list-item><p>participation in international theatres, within the scope of cooperative or collective security, or in an autonomous framework, for the protection of Portuguese communities abroad in areas of crisis or conflict.</p></list-item><list-item><p>national surveillance and assertion in maritime areas under national jurisdiction.</p></list-item><list-item><p>increased resilience against cyber-attacks.</p></list-item><list-item><p>the consolidation of the Portuguese Armed Forces as a modular, flexible, and modern organisation and adapting them to the new security environment, which will imply synergies in capacity building, maintaining the objective of a credible deterrent capacity.</p></list-item></list></p></sec><sec id="S5"><title>Military defence planning for capabilities in Portugal</title><p>For public organisations, the creation, development and management of capabilities is a central point for achieving public goals (<xref ref-type="bibr" rid="ref30">Klein et al., 2013</xref>).</p><p>In Portugal, “military capabilities are understood as the set of elements that are articulated in a harmonious and complementary manner that contribute to the realisation of a set of operational tasks or effect that it is necessary to achieve. It comprehends components of doctrine, organisation, training, material, leadership, personnel, infrastructure and interoperability” (<xref ref-type="bibr" rid="ref2">Aguiar-Branco, 2014</xref>, p. 23657). These capabilities are the final product produced by the Portuguese Armed Forces, i.e. their output (<xref ref-type="bibr" rid="ref23">Garcia, 2015</xref>; <xref ref-type="bibr" rid="ref47">Santos, 2013</xref>).</p><p>The development of adequate military capabilities becomes fundamental and more important than operations in the performance of Armed Forces, allowing countries to defend themselves against threats and adversaries, national and foreign, not only to face and respond to the most likely threats and risks, but also to achieve international commitments and certain outcomes (<xref ref-type="bibr" rid="ref27">Hannay and Gjørven, 2021</xref>; <xref ref-type="bibr" rid="ref45">Ritchie, 2011</xref>; <xref ref-type="bibr" rid="ref50">Tardy, 2018</xref>).</p><p>It appears that combatting the various threats and risks is one of the main priorities of Portuguese National Defence at the moment, but they are quite different, as is the way to combat them. The development of military capabilities at the level of the Portuguese Armed Forces is essential to face and respond to the most likely threats and risks to ensure the safety of citizens, ensuring one of the objectives of the current national defence policy (<xref ref-type="bibr" rid="ref23">Garcia, 2015</xref>).</p><p>Presently, the number of personnel and the financial resources available for the development of the main programmes for the re-equipment and support of the Portuguese Armed Forces are particularly constraining. These current conditions mean that it is essential to improve organisational performance. The current Portuguese Military Defence Planning Cycle was defined through a Ministerial Guiding Directive,<sup><xref ref-type="fn" rid="fn1">1</xref></sup>.with the purpose of implementing a security planning system based on the development of military capabilities to achieve the outcomes and carry out operations. It is intended, therefore, to define the requirements of these capabilities through:</p><p><list list-type="bullet"><list-item><p>identification of gaps considered as priorities;</p></list-item><list-item><p>definition of the objectives of capabilities;</p></list-item><list-item><p>implementation and development of these capabilities;</p></list-item><list-item><p>a review of results.</p></list-item></list></p><p>In the same Directive, it is also emphasised that priority should be given to the development of capacities that contribute to participation in international Theatres of Operations within the scope of cooperative or collective security, maintaining a credible deterrent capacity and adapting these capacities to the new environment of safety.</p><p>To implement the military capabilities planning methodology and align national planning with the NATO planning cycle, the Portuguese Ministry of Defence approved another Directive in 2014, noting that the development of military capabilities is a fundamental activity in which greater effort is required. Focused on the future, the clear identification of capabilities and how to achieve them is a priority that must be integrated at different levels, always including the essential assessment of available resources and defined expenditure ratios.</p><p>The Portuguese Armed Forces should thus be able to generate and exploit the military capabilities that allow them to carry out their missions in the various general scenarios, and their employment in these scenarios must respect the priorities and guidelines contained in the Strategic Concepts (<xref ref-type="bibr" rid="ref23">Garcia, 2015</xref>). The execution of these missions makes it possible to identify areas of potential intervention by the Portuguese Armed Forces for their defence or for capacity development. The military effectiveness of these capabilities, in addressing the most likely threats and risks and in fulfilling international commitments, becomes the outcome (<xref ref-type="bibr" rid="ref51">Tellis <italic>et al</italic>., 2000</xref>).</p><p>In terms of the performance of the Portuguese Armed Forces, these being a subsector of Public Administration and with a continuous need for modernisation of equipment, our research model analyses the influence that military capabilities (outputs) have on performance, in the fight against current threats and risks and through the fulfilment of the various missions (outcomes).</p><p>The research model underlying this investigation is described in the <xref ref-type="fig" rid="F2">Figure 2</xref> below, proposing the following hypotheses:</p><fig id="F2" orientation="portrait" position="float"><label>Figure 2</label><caption><p>Research model.</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://securityanddefence.pl/f/fulltexts/144434/SDQ-37-00160-g002_min.jpg" xlink:fullhref="https://securityanddefence.pl/f/fulltexts/144434/SDQ-37-00160-g002.jpg"/></fig><p>H1:The development of military capabilities has a positive effect on the combat of actual threats and risks by the Portuguese Armed Forces.</p><p>H2: The development of military capabilities has a positive effect on Portuguese Armed Forces operations.</p><p>H3:The development of military capabilities has a positive effect on the performance of Portuguese Armed Forces.</p></sec><sec id="S6"><title>Methods</title><p>In terms of the research methodology, given the exploratory nature of this investigation, a quantitative analysis was carried out. This type of analysis seeks to determine the existence of relationships, based on the current forecast or finding of some phenomena (<xref ref-type="bibr" rid="ref12">Creswell, 2003</xref>). At the level of quantitative analysis, univariate, bivariate and multivariate analyzes were performed (<xref ref-type="bibr" rid="ref32">Marôco, 2014</xref>). The univariate analysis consisted of descriptive statistics (mean) regarding the importance of the various items analysed and also comparison of means of these items between the samples. For the comparison of means, the parametric t-Student test was used, being the most adequate test to analyse means of the same variable or the characteristic observed on two independent samples of individuals (<xref ref-type="bibr" rid="ref43">Pocinho and Figueiredo, 2000</xref>).</p><p>The bivariate analysis consisted of performing correlations, using the bivariate linear correlation (Pearson’s r), to determine the strength or intensity of a linear association between the respective variables (<xref ref-type="bibr" rid="ref10">Brites, 2016</xref>). According <xref ref-type="bibr" rid="ref37">Mukaka (2012)</xref>, correlations above 0.9 indicate a very strong correlation, between 0.7 and 0.9 indicate a strong correlation, between 0.5 and 0.7 moderate and between 0.3 and 0.5 weak.</p><p>An exploratory factor analysis (EFA) was also carried out (<xref ref-type="bibr" rid="ref32">Marôco, 2014</xref>) to reduce the information inherent to the influence that military capabilities can have on the performance of the Portuguese Armed Forces. It was found that the total explained variance was greater than 60%, but that the reliability of the extraction of the constructs was acceptable (Cronbach’s alpha &gt; 0.6). The citizens who pay for the Armed Forces should influence and indicate their needs on national basis in terms of security and defence (<xref ref-type="bibr" rid="ref45">Ritchie, 2011</xref>). To meet the interests of citizens and the guidelines defined by the military, the sample chosen to answer the questionnaire was as follows:</p><p><list list-type="bullet"><list-item><p>a convenience sample of Portuguese Officers from various posts (115 militaries) on graduation and promotion courses that teach these topics;</p></list-item><list-item><p>a convenience sample of Portuguese citizens with a higher level of education.</p></list-item></list></p><p>In terms of the author’s questionnaires, the 7-point Likert scale was preferred in order to maximise the intended effects (<xref ref-type="bibr" rid="ref31">Krosnick and Presser, 2010</xref>), where 1 corresponds to the lowest value and 7 corresponds to the highest value of the scale.</p><p>The answers “Don’t know / don’t answer” were considered missing values (<xref ref-type="bibr" rid="ref26">Hair et al., 2017</xref>).</p><p>The quantitative analysis was performed using the statistical program IBM SPSS <italic>Statistics</italic> 27.0.</p></sec><sec id="S7"><title>Results</title><p>Relatively to security threats (<xref ref-type="table" rid="T1">Table 1</xref>), according to the EFA, made to the global sample (KMO = 0.764), it was possible to ascertain two constructs. These constructs concern “conventional threats” (46.2% of the variance) and “natural and man-made disasters” (16.9% of the variance), the latter being the most important construct (mean = 6.16, σ = 0.93).</p><table-wrap id="T1" orientation="portrait" position="float"><label>Table 1</label><caption><p>Analysis of items and constructs for the challenges of Portugal National Defence.</p></caption><table frame="border" rules="groups"><thead valign="top"><tr><th rowspan="2">Importance attributed to the following challenges to Portugal’s national security &amp; defence</th><th colspan="4">Items</th><th colspan="2">Constructs Global sampleFactor loadings</th></tr><tr><th>Militaries sample<break/>Mean</th><th>Citizens sample<break/>Mean</th><th>T-test</th><th>Global sample<break/>Mean</th><th>Conventional threats</th><th>Natural and man-made disasters</th></tr></thead><tbody valign="top"><tr><td>Organised crime</td><td>6.19</td><td align="center">6.18</td><td align="center">0.047</td><td>6.18</td><td align="center"><bold>0.776</bold></td><td align="center">0.199</td></tr><tr><td>Border defence</td><td>5.56</td><td align="center">5.67</td><td align="center">−0.731</td><td>5.62</td><td align="center"><bold>0.686</bold></td><td align="center">0.475</td></tr><tr><td>Natural and man-made disasters</td><td>5.99</td><td align="center">6.28</td><td align="center"><bold>−2,617**</bold></td><td>6.15</td><td align="center">0.273</td><td align="center"><bold>0.966</bold></td></tr><tr><td>Terrorism</td><td>6.1</td><td align="center"><bold>6.29</bold></td><td align="center">−1,674</td><td>6.22</td><td align="center"><bold>0.773</bold></td><td align="center">0.27</td></tr><tr><td>Cybercrime</td><td><bold>6.36</bold></td><td align="center">6.26</td><td align="center">0.919</td><td>6.3</td><td align="center"><bold>0.671</bold></td><td align="center">0.084</td></tr><tr><td>Alpha Cronbach</td><td> </td><td> </td><td> </td><td> </td><td align="center"><bold>0.703</bold></td><td> </td></tr><tr><td>Eigenvalue</td><td> </td><td> </td><td> </td><td> </td><td align="center"><bold>2.31</bold></td><td align="center"><bold>0.844</bold></td></tr><tr><td>Explained variance</td><td> </td><td> </td><td> </td><td> </td><td align="center"><bold>46.19%</bold></td><td align="center"><bold>16.87%</bold></td></tr><tr><td>KMO</td><td> </td><td> </td><td> </td><td> </td><td colspan="2" align="center"><bold>0.764</bold></td></tr><tr><td>Construct mean</td><td> </td><td> </td><td> </td><td> </td><td align="center">6.08</td><td align="center">6.16</td></tr><tr><td>Militaries construct mean</td><td> </td><td> </td><td> </td><td> </td><td align="center">6.05</td><td align="center">5.99</td></tr><tr><td>Citizens’ construct mean</td><td> </td><td> </td><td> </td><td> </td><td align="center">6.11</td><td align="center">6.28</td></tr><tr><td>Construct T-test</td><td> </td><td> </td><td> </td><td> </td><td align="center">−0.603</td><td align="center"><bold>−2,597*</bold></td></tr></tbody></table><table-wrap-foot><fn id="TF1-1"><label>* and **</label><p>indicate p &lt; 0.05 and p &lt; 0.01 respectively.</p></fn><fn id="TF1-2"><p><italic>Note:</italic> Scale (1 = Not important at all; 4 = Neither important nor important; 7 = Extremely important).</p></fn></table-wrap-foot></table-wrap><p>The militaries differentiate these threats and their nature more, highlighting the growing importance of “conventional threats.” For citizens, although “terrorism” remains one of the most important threats, “natural and man-made disasters” (a national threat) are the second most important. The results also show that “natural and man-made disasters” should even be investigated as a separate (construct) factor, and the importance given to this threat by citizens is quite different from the importance given by the militaries (this threat is just the fifth most important for the military).</p><p>As for the Armed Forces’ missions to deal with the current threats and risks to national security (<xref ref-type="table" rid="T2">Table 2</xref>), the AFE allowed two constructs to be obtained concerning “and executing military missions” that represents 50.4% of the explained variance and the construct of “Guaranteeing the internal security of citizens” which explains 20.3% of the variance. However, from the analysis of the Portuguese Armed Forces missions that best suit national security, differences of importance have emerged between the samples from militaries and citizens. The militaries agree more with Armed Forces missions that aim to guarantee sovereignty and international peace (missions and military nature). The citizens give priority to missions to “ensure the internal security of citizens,” with a statistically significant difference between militaries and citizens (t = −3.166; p &lt; 0.001). These types of missions present the higher degree of agreement to ensure national security and defence (mean = 6.29, σ = 0.92). So, while the militaries give more importance to missions that guarantee the national independence and international peace, citizens prioritise missions that are aimed at guaranteeing the internal security of citizens.</p><table-wrap id="T2" orientation="portrait" position="float"><label>Table 2</label><caption><p>Analysis of items and constructs of Portuguese Armed Forces missions.</p></caption><table frame="border" rules="groups"><thead valign="top"><tr><th rowspan="2">Agreement on the following missions of Portuguese Armed Forces to ensure national security and defence</th><th colspan="4">Items</th><th colspan="2">Constructs Global sample Factor loadings</th></tr><tr><th>Militaries sample<break/>Mean</th><th>Citizens sample<break/>Mean</th><th>T-test</th><th>Global sample<break/>Mean</th><th>Perform military missions</th><th>Ensuring the internal security of citizens</th></tr></thead><tbody valign="top"><tr><td>Guarantee national independence and territorial integrity of the State</td><td><bold>6.6</bold></td><td align="center">6.29</td><td align="center">2,895**</td><td>6.43</td><td align="center">0.74</td><td align="center">−0.213</td></tr><tr><td>Ensure the State’s international commitments</td><td>6.33</td><td align="center">6.08</td><td align="center">2,093*</td><td>6.19</td><td align="center">0.849</td><td align="center">−0.288</td></tr><tr><td>Support peace and humanitarian aid outside the national territory</td><td>6.3</td><td align="center">6.29</td><td align="center">0.042</td><td>6.3</td><td align="center">0.853</td><td align="center">−0.388</td></tr><tr><td>Ensuring the security of Portuguese citizens</td><td>6.37</td><td align="center">6.54</td><td align="center">−1,456</td><td><bold>6.47</bold></td><td align="center">0.461</td><td align="center">−0.854</td></tr><tr><td>Perform technical-military cooperation actions</td><td>5.85</td><td align="center">5.73</td><td align="center">0.838</td><td>5.78</td><td align="center">0.727</td><td align="center">−0.441</td></tr><tr><td>Perform civil protection operations</td><td>5.87</td><td align="center">6.44</td><td align="center">−4.403**</td><td>6.2</td><td align="center">0.344</td><td align="center">−0.929</td></tr><tr><td>Cooperate with security forces to combat current threats and risks</td><td>6.04</td><td align="center">6.34</td><td align="center">−2,340*</td><td>6.22</td><td align="center">0.285</td><td align="center">−0.875</td></tr><tr><td><italic>Alpha Cronbach</italic></td><td> </td><td> </td><td> </td><td> </td><td align="center">0.799</td><td align="center">0.866</td></tr><tr><td><italic>Eigenvalue</italic></td><td> </td><td> </td><td> </td><td> </td><td align="center">3,525</td><td align="center">1,422</td></tr><tr><td>Explained variance</td><td> </td><td> </td><td> </td><td> </td><td align="center">50.36%</td><td align="center">20.31%</td></tr><tr><td>KMO</td><td> </td><td> </td><td> </td><td> </td><td colspan="2" align="center">0.77</td></tr><tr><td>Construct mean</td><td> </td><td> </td><td> </td><td> </td><td align="center">6.17</td><td align="center">6.29</td></tr><tr><td>Militaries construct mean</td><td> </td><td> </td><td> </td><td> </td><td align="center">6.27</td><td align="center">6.1</td></tr><tr><td>Citizens’ construct mean</td><td> </td><td> </td><td> </td><td> </td><td align="center">6.18</td><td align="center">6.4</td></tr><tr><td>Construct T-test</td><td> </td><td> </td><td> </td><td> </td><td align="center">1,741</td><td align="center">−3.166**</td></tr></tbody></table><table-wrap-foot><fn id="TF2-1"><label>* and **</label><p>indicate p &lt; 0.05 and p &lt; 0.01 respectively</p></fn><fn id="TF2-2"><p><italic>Note:</italic> Scale (1 = Strongly disagree; 4 = Neither agree nor disagree; 7 = Strongly agree).</p></fn></table-wrap-foot></table-wrap><p>Regarding the performance of the Armed Forces according to the current principles of the New Public Administration (<xref ref-type="table" rid="T3">Table 3</xref>), the EFA to the global sample (KMO = 0.841) reveals just one construct that refers to how the Portuguese Armed Forces act (61% of the explained variance). Acting with “efficiency” obtained a low factor loading (0.399) and is also of less importance (mean = 5.89, σ = 1.17). But there is a significant difference statistically between militaries and citizens (t = −4,171; p &lt; 0.001). For citizens, it is one of the most important ways of acting. In developing a model of performance, the results obtained reinforce the importance of efficient management of the Portuguese Armed Forces.</p><table-wrap id="T3" orientation="portrait" position="float"><label>Table 3</label><caption><p>Analysis of items and constructs of Portuguese Armed Forces ways of action.</p></caption><table frame="border" rules="groups"><thead valign="top"><tr><th rowspan="2">Importance attributed to the Portuguese Armed Forces ways of action</th><th colspan="4">Items</th><th rowspan="2">Constructs<break/>Global sample<break/>Factor loadings<break/>Principles of the New Public Administration</th></tr><tr><th>Militaries sample<break/>Mean</th><th>Citizens sample<break/>Mean</th><th>T-test</th><th>Global sample<break/>Mean</th></tr></thead><tbody valign="top"><tr><td>Efficiency</td><td align="center">5.55</td><td>6.16</td><td align="center">−4,171**</td><td align="center">5.89</td><td align="center">0.399 (a)</td></tr><tr><td>Economy</td><td align="center">6.09</td><td>6.1</td><td align="center">−0.083</td><td align="center">6.09</td><td align="center">0.792</td></tr><tr><td>Effective</td><td align="center">6.08</td><td>6.19</td><td align="center">−1,014</td><td align="center">6.17</td><td align="center">0.795</td></tr><tr><td><italic>Input quality</italic></td><td align="center">6.07</td><td>5.96</td><td align="center">0.843</td><td align="center">6.02</td><td align="center">0.802</td></tr><tr><td><italic>Output quality</italic></td><td align="center">6.29</td><td>6.26</td><td align="center">0.274</td><td align="center">6.27</td><td align="center">0.837</td></tr><tr><td><italic>Outcome quality</italic></td><td align="center">6.41</td><td>6.41</td><td align="center">0.027</td><td align="center">6.41</td><td align="center">0.82</td></tr><tr><td><italic>Alpha Cronbach</italic></td><td> </td><td> </td><td> </td><td> </td><td align="center">0.861</td></tr><tr><td><italic>Eigenvalue</italic></td><td> </td><td> </td><td> </td><td> </td><td align="center">3,671</td></tr><tr><td>Explained variance</td><td> </td><td> </td><td> </td><td> </td><td align="center">61.19%</td></tr><tr><td>KMO</td><td> </td><td> </td><td> </td><td> </td><td align="center">0.841</td></tr><tr><td>Construct mean</td><td> </td><td> </td><td> </td><td> </td><td align="center">6.13</td></tr><tr><td>Militaries construct mean</td><td> </td><td> </td><td> </td><td> </td><td align="center">6.07</td></tr><tr><td>Citizens’ construct mean</td><td> </td><td> </td><td> </td><td> </td><td align="center">6.19</td></tr><tr><td>Construct T-test</td><td> </td><td> </td><td> </td><td> </td><td align="center">−1,316</td></tr></tbody></table><table-wrap-foot><fn id="TF3-1"><label>**</label><p>indicate p &lt; 0.01.</p></fn><fn id="TF3-2"><p><italic>Note:</italic> Scale (1 = Not important at all; 4 = Neither important nor important; 7 = Extremely important).</p></fn></table-wrap-foot></table-wrap><p>From the analysis to the importance of the various components in terms of developing military capabilities (<xref ref-type="table" rid="T4">Table 4</xref>), the results show that for both samples, personnel and training are the most important components (mean = 6.55, σ = 0.77 and mean = 6.53, σ = 0.79, respectively). This reveals the importance of building adequate military capabilities (output), with a special focus on human resources and their training.</p><table-wrap id="T4" orientation="portrait" position="float"><label>Table 4</label><caption><p>Analysis of items for the components of military capabilities.</p></caption><table frame="border" rules="groups"><thead valign="top"><tr><th rowspan="3">Importance attributed to the following components for development military capabilities</th><th colspan="7">Items</th></tr><tr><th colspan="2">Military sample</th><th colspan="2">Citizens sample</th><th rowspan="2">T-test</th><th colspan="2">Global sample</th></tr><tr><th>Mean</th><th>σ</th><th>Mean</th><th>σ</th><th>Mean</th><th>σ</th></tr></thead><tbody valign="top"><tr><td>Training</td><td><bold>6.54</bold></td><td>0.69</td><td align="center"><bold>6.52</bold></td><td align="center">0.85</td><td align="center">0.247</td><td align="center"><bold>6.53</bold></td><td align="center">0.79</td></tr><tr><td>Equipment</td><td>6.42</td><td>0.7</td><td align="center">6.42</td><td align="center">0.85</td><td align="center">−0.064</td><td align="center">6.42</td><td align="center">0.79</td></tr><tr><td>Personnel</td><td><bold>6.62</bold></td><td>0.63</td><td align="center"><bold>6.51</bold></td><td align="center">0.86</td><td align="center">1.203</td><td align="center"><bold>6.55</bold></td><td align="center">0.77</td></tr><tr><td>Infrastructure</td><td>6.06</td><td>0.95</td><td align="center">6.29</td><td align="center">0.92</td><td align="center"><bold>−2,121*</bold></td><td align="center">6.19</td><td align="center">0.9</td></tr><tr><td>Interoperability</td><td>6.28</td><td>0.88</td><td align="center">6.29</td><td align="center">0.92</td><td align="center">−0.088</td><td align="center">6.29</td><td align="center">0.9</td></tr><tr><td>Leadership</td><td>6.5</td><td>0.81</td><td align="center">6.38</td><td align="center">0.93</td><td align="center">1,142</td><td align="center">6.43</td><td align="center">0.88</td></tr></tbody></table><table-wrap-foot><fn id="TF4-1"><label>*</label><p>indicate p &lt; 0.05.</p></fn><fn id="TF4-2"><p><italic>Note:</italic> Scale (1 = Not important at all; 4 = Neither important nor important; 7 = Extremely important).</p></fn></table-wrap-foot></table-wrap><p>The results obtained according to the correlations made (<xref ref-type="table" rid="T5">Table 5</xref>) showed that military capabilities have a positive influence in combatting current threats and risks in carrying out missions and in their performance. However, although all correlations are positive and, for the most part, statistically significant, their value is somewhat different.</p><table-wrap id="T5" orientation="portrait" position="float"><label>Table 5</label><caption><p>Military capabilities impact on Portuguese Armed Forces performance.</p></caption><table frame="border" rules="groups"><thead valign="top"><tr><th>Constructs</th><th>Military capabilities</th></tr></thead><tbody valign="top"><tr><td>Combating natural and man-made disasters</td><td align="center">0.414**</td></tr><tr><td>Combating conventional threats</td><td align="center">0.383**</td></tr><tr><td>Perform military missions</td><td align="center">0.668**</td></tr><tr><td>Perform internal missions to ensure security of citizens</td><td align="center">0.505**</td></tr><tr><td>Ways of action by Principles of New Public Administration</td><td align="center">0.767**</td></tr></tbody></table><table-wrap-foot><fn id="TF5-1"><label>**</label><p>The correlation is relevant at 0.01 level.</p></fn></table-wrap-foot></table-wrap><p>The results allow us to accept Hypothesis 1 (H1), verifying that military capabilities positively influence the fight against current threats and risks, although there are weak, but similar intensities between the correlations. There was a weak correlation between “military capabilities” and the fight against “conventional threats” (0.383) and the fight against “natural and man-made disasters” (0.414). Despite these weak correlations, the results also show that the importance given to the threat from “natural and man-made disasters” by citizens is quite different from the importance given by the military (this threat is only the fifth most important for the military). In terms of combat using military capabilities, this threat will even be considered as a construct apart.</p><p>The results obtained also allow the validation of Hypothesis 2 (H2), in which military capabilities positively influence military missions (0.668) and missions that “guarantee the internal security of citizens” (0.505). The correlations obtained between “military capabilities” and the missions to be performed were moderate, but it was possible to see that the development of military capabilities must be essential for the fulfilment of internal missions that guarantee the security of citizens and classic missions (peace and national independence).</p><p>Regarding the validation of Hypothesis 3 (H3), we found that military capabilities should also allow the Armed Forces to act in accordance with the current principles of the New Public Administration (obtained construct), with a strong correlation also being found (0.767), despite the citizens preferring the performance of the Armed Forces for efficiency, while the militaries prefer the execution of missions with quality.</p><p>As a theoretical contribution to the level of the performance of public organisations, this article shows that military capabilities (outputs) are essential to the fulfilment of missions (outcomes). These results corroborate <xref ref-type="bibr" rid="ref54">Webber (2004)</xref>, <xref ref-type="bibr" rid="ref19">Epstein and Buhovac, (2009)</xref> and <xref ref-type="bibr" rid="ref16">Dooren, Bouckaert and Halligan (2015)</xref>.</p></sec><sec id="S8" sec-type="conclusions"><title>Conclusions</title><p>The current expectations of society demand that public organisations produce better quality public services and optimise their rates of efficiency and effectiveness. In this way, the aim is to meet the guiding principles of the New Public Administration. To answer the central research problem and the respective research objectives, it was crucial to understand the interorganisational complexity of the public sector, as well as of the Portuguese Armed Forces, and trying to evaluate how this public sub-sector measures its performance. Within the scope of this “new” public administration, it is essential for the Portuguese Armed Forces to develop adequate military capabilities (output) to see the extent of its missions (outcome) to respond to the threats and risks of 21st century.</p><p>We found that military capabilities have a positive impact on the performance of the Portuguese Armed Forces, namely, in combatting current threats and risks (conventional and civil protection) and in the execution of military operations (external and internal), meaning it can optimise its performance. The performance should improve the efficiency and quality of the missions. With regard to dealing with current threats and risks, we found that military capabilities have to face “conventional threats,” as well as threats caused by “natural and man-made disasters.” These last threats are actually the most important from the perspective of citizens and they need to be seen as just as relevant. As for the missions of the Portuguese Armed Forces, military capabilities have a positive influence on the execution of military missions that guarantee national sovereignty, as well as ensure the inherent international commitments, which are the missions the military are most in agreement with. However, military capabilities must also guarantee the internal security of citizens, which citizens are most in agreement with.</p><p>The results also show that the citizens rate the performance of the Portuguese Armed Forces as efficient, while the military point to the quality of missions. This reveals the importance of the proper development of military capabilities, with a special focus on human resources.</p><p>The use of a convenience sample was a limitation because it could mean that the results are not reflective of the entire population. However, <xref ref-type="bibr" rid="ref48">Saunders, Lewis and Thornhill (2009)</xref> consider that this type of sample is suitable for a study like this that is eminently exploratory.</p><p>With regard to the relevance of the topic, future researchers can propose an evaluation model with key performance indicators to measure the performance of the military capabilities.</p></sec></body><back><sec id="S9"><title>Funding</title><p>This research received no external funding.</p></sec><sec id="S10"><title>Author contributions</title><p>The author has read and agreed to the published version of the manuscript.</p></sec><sec id="S11"><title>Data availability statement</title><p>The data presented in this study are available in supplementary material.</p></sec><sec id="S12"><title>Disclosure statement</title><p>No potential conflict of interest was reported by the authors.</p></sec><fn-group><fn id="fn1"><label>1</label><p>Order no. 04 / MDN / 2011, of January 31.</p></fn></fn-group><ref-list><ref id="ref1"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Aberdeen</surname>, <given-names>D</given-names></string-name>., <string-name><surname>Thiébaux</surname>, <given-names>S</given-names></string-name>. and <string-name><surname>Zhang</surname>, <given-names>L</given-names></string-name></person-group>. (<year>2004</year>) <article-title>‘Decision-theoretic military operations planning’, in <italic>International Conference on Automated Planning and Scheduling</italic></article-title>, pp. <fpage>402</fpage>–<lpage>412</lpage>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="https://www.aaai.org/Papers/ICAPS/2004/ICAPS04-047.pdf">https://www.aaai.org/Papers/ICAPS/2004/ICAPS04-047.pdf</ext-link> (Accessed: 1 June 2021)</comment>.</mixed-citation></ref><ref id="ref2"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Aguiar-Branco</surname>, <given-names>J.P.C</given-names></string-name></person-group>. (<year>2014</year>) <chapter-title><italic>Diretiva Ministerial de Planeamento de Defesa Militar</italic></chapter-title>. <publisher-loc>Portugal</publisher-loc>: <publisher-name>Diário da República</publisher-name>, <comment>2<sup>a</sup> série, n<sup>o</sup> 175, 11set</comment>.</mixed-citation></ref><ref id="ref3"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Alford</surname>, <given-names>J</given-names></string-name>. and <string-name><surname>O’Flynn</surname>, <given-names>J</given-names></string-name></person-group>. (<year>2009</year>) <article-title>‘Making sense of public value: Concepts, critiques and emergent meanings’</article-title>, <source>International Journal of Public Administration</source>, <volume>32</volume>(<issue>3–4</issue>), pp. <fpage>171</fpage>–<lpage>191</lpage>. doi: <pub-id pub-id-type="doi">10.1080/01900690902732731</pub-id>.</mixed-citation></ref><ref id="ref4"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Bachmann</surname>, <given-names>S.-D</given-names></string-name>. and <string-name><surname>Gunneriusson</surname>, <given-names>H</given-names></string-name></person-group>. (<year>2015</year>) <article-title>‘Hybrid wars: The 21st century’s new threats to global peace and security’</article-title>, <source>Scientia Militaria–South African Journal of Military Studies</source>, <volume>43</volume>(<issue>1</issue>), pp. <fpage>77</fpage>–<lpage>98</lpage>. doi: <pub-id pub-id-type="doi">10.5787/43-1-1110</pub-id>.</mixed-citation></ref><ref id="ref5"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Beckley</surname>, <given-names>M</given-names></string-name></person-group>. (<year>2010</year>) <article-title>‘Economic development and military effectiveness’</article-title>, <source>Journal of Strategic Studies</source>, <volume>33</volume>(<issue>1</issue>), pp. <fpage>43</fpage>–<lpage>79</lpage>. doi: <pub-id pub-id-type="doi">10.1080/01402391003603581</pub-id>.</mixed-citation></ref><ref id="ref6"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Boland</surname>, <given-names>T</given-names></string-name>. and <string-name><surname>Fowler</surname>, <given-names>A</given-names></string-name></person-group>. (<year>2000</year>) <article-title>‘A systems perspective of performance management in public sector organisations’</article-title>, <source>International Journal of Public Sector Management</source>, <volume>13</volume>(<issue>5</issue>), pp. <fpage>417</fpage>–<lpage>446</lpage>. doi: <pub-id pub-id-type="doi">10.1108/09513550010350832</pub-id>.</mixed-citation></ref><ref id="ref7"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Borges</surname>, <given-names>J.J.B.V</given-names></string-name></person-group>. (<year>2013</year>) <article-title>‘As Forças Armadas na Segurança Interna: Mitos e Realidades’</article-title>, <source>Revista Militar</source>, <volume>2532</volume>(<issue>1</issue>), pp. <fpage>25</fpage>–<lpage>41</lpage>.</mixed-citation></ref><ref id="ref8"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Borges</surname>, <given-names>J.J.B.V</given-names></string-name>. and <string-name><surname>Rodrigues</surname>, <given-names>T. F</given-names></string-name></person-group> (<year>2016</year>) <chapter-title>‘Ameaças e riscos transnacionais. Perspetivas institucionais’, in <italic>Ameaças e riscos transnacionais no novo mundo global</italic>. 1<sup>a</sup> Edição</chapter-title>. <publisher-loc>Porto</publisher-loc>: <publisher-name>Fronteira do Caos Editores, Lda</publisher-name>., pp. <fpage>29</fpage>–<lpage>50</lpage>.</mixed-citation></ref><ref id="ref9"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Bouckaert</surname>, <given-names>G</given-names></string-name></person-group>. (<year>2013</year>) <article-title>‘Performance measurement and budgeting in the public sector’, in <italic>Para uma Reforma Abrangente da Organização e Gestão do Sector Público</italic></article-title>. <source>Fundação Calouste Gulbenkian</source>, pp. <fpage>54</fpage>–<lpage>67</lpage>.</mixed-citation></ref><ref id="ref10"><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name><surname>Brites</surname>, <given-names>R</given-names></string-name></person-group>. (<year>2016</year>) <article-title>Curso introdutório de Análise de dados com IBM SPSS</article-title>. <source>Lisboa</source>.</mixed-citation></ref><ref id="ref11"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Bryson</surname>, <given-names>J.M</given-names></string-name>., <string-name><surname>Crosby</surname>, <given-names>B.C</given-names></string-name>. and <string-name><surname>Bloomberg</surname>, <given-names>L</given-names></string-name></person-group>. (<year>2014</year>) <article-title>‘Public value governance: Moving beyond traditional public administration and the new public management’</article-title>, <source>Public Administration Review</source>, <volume>74</volume>(<issue>4</issue>), pp. <fpage>445</fpage>–<lpage>456</lpage>. doi: <pub-id pub-id-type="doi">10.1111/puar.12238</pub-id>.</mixed-citation></ref><ref id="ref12"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Creswell</surname>, <given-names>J.W</given-names></string-name></person-group>. (<year>2003</year>) <chapter-title><italic>Research design: Qualitative, quantitative, and mixed method approaches</italic></chapter-title>. <edition>2nd ed</edition>. <publisher-loc>Thousand Oaks, CA</publisher-loc>: <publisher-name>Sage Publications</publisher-name>.</mixed-citation></ref><ref id="ref13"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Denhardt</surname>, <given-names>R.B</given-names></string-name>. and <string-name><surname>Denhardt</surname>, <given-names>J.V</given-names></string-name></person-group>. (<year>2000</year>) <article-title>‘The new public service: Serving rather than steering’</article-title>, <source>Public Administration Review</source>, <volume>60</volume>(<issue>6</issue>), pp. <fpage>549</fpage>–<lpage>559</lpage>. doi: <pub-id pub-id-type="doi">10.1111/0033-3352.00117</pub-id>.</mixed-citation></ref><ref id="ref14"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Dooren</surname>, <given-names>W.V</given-names></string-name></person-group>. (<year>2005</year>) <article-title>‘What makes organisations measure? Hypotheses on the causes and conditions for performance measurement’</article-title>, <source>Financial Accountability &amp; Management</source>, <volume>21</volume>(<issue>August</issue>), pp. <fpage>363</fpage>–<lpage>384</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.0267-4424.2005.00225.x</pub-id>.</mixed-citation></ref><ref id="ref15"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Dooren</surname>, <given-names>W.V</given-names></string-name></person-group>. (<year>2006</year>) <chapter-title><italic>Performance measurement in the Flemish public sector: A supply and demand approach</italic></chapter-title>, <source>Faculteit Sociale Wetenschappen</source>. <publisher-loc>Leuven</publisher-loc>: <publisher-name>Faculteit Sociale Wetenschappen</publisher-name>.</mixed-citation></ref><ref id="ref16"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Dooren</surname>, <given-names>W.V</given-names></string-name>., <string-name><surname>Bouckaert</surname>, <given-names>G</given-names></string-name>. and <string-name><surname>Halligan</surname>, <given-names>J</given-names></string-name></person-group>. (<year>2015</year>) <chapter-title><italic>Performance management in the public sector</italic></chapter-title>. <edition>2nd ed</edition>. <publisher-loc>New York</publisher-loc>: <publisher-name>Routledge</publisher-name>.</mixed-citation></ref><ref id="ref17"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Drent</surname>, <given-names>M</given-names></string-name>., <string-name><surname>Hendriks</surname>, <given-names>R</given-names></string-name>. and <string-name><surname>Zandee</surname>, <given-names>D</given-names></string-name></person-group>. (<year>2015</year>) <chapter-title><italic>New threats, new EU and NATO responses</italic></chapter-title>. <publisher-loc>Hague</publisher-loc>: <publisher-name>Netherlands Institute of International Relations Clingendael</publisher-name>.</mixed-citation></ref><ref id="ref18"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Duke</surname>, <given-names>S</given-names></string-name>. and <string-name><surname>Ojanen</surname>, <given-names>H</given-names></string-name></person-group>. (<year>2006</year>) <article-title>‘European integration bridging internal and external security: Lessons from the European security and defence policy’</article-title>, <source>Journal of European Integration</source>, <volume>28</volume>(<issue>5</issue>). doi: <pub-id pub-id-type="doi">10.1080/07036330600979714</pub-id>.</mixed-citation></ref><ref id="ref19"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Epstein</surname>, <given-names>M.J</given-names></string-name>. and <string-name><surname>Buhovac</surname>, <given-names>A.R</given-names></string-name></person-group>. (<year>2009</year>) <chapter-title><italic>Performance measurement of non-profit organizations</italic></chapter-title>. <publisher-loc>New York</publisher-loc>: <publisher-name>American Institute of Certified Public Accountants</publisher-name>.</mixed-citation></ref><ref id="ref20"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>Estado – Maior General das Forças Armadas</collab></person-group> (<year>2018</year>) <chapter-title><italic>Diretiva Estratégica 2018/2021</italic></chapter-title>. <publisher-loc>Lisboa</publisher-loc>: <publisher-name>Estado-Maior General das Forças Armadas</publisher-name>.</mixed-citation></ref><ref id="ref21"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Feiteira</surname>, <given-names>A</given-names></string-name></person-group>. (<year>2016</year>) <chapter-title>‘Tendência das ameaças globais. Ordem jurídica internacional e Intelligence’, in <italic>Ameaças e riscos transnacionais no novo mundo global</italic></chapter-title>. <source>1a Edição</source>, pp. <fpage>290</fpage>–<lpage>302</lpage>. <publisher-loc>Porto</publisher-loc>: <publisher-name>Fronteira do Caos Editores, Lda</publisher-name>.</mixed-citation></ref><ref id="ref22"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Fernandes</surname>, <given-names>L. F</given-names></string-name></person-group>. (<year>2005</year>) <article-title>‘As novas ameacas como instrumento de mutação do conceito “Segurança”’, in <italic>I Colóquio de Segurança Interna</italic></article-title>. <publisher-loc>Coimbra</publisher-loc>: <publisher-name>Almedina</publisher-name>, pp. <fpage>123</fpage>–<lpage>152</lpage>.</mixed-citation></ref><ref id="ref23"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Garcia</surname>, <given-names>F.P</given-names></string-name></person-group>. (<year>2015</year>) <article-title>‘O Instrumento Militar e as Forças Armadas’</article-title>, <source>Revista Militar</source>, <volume>2556</volume>(<issue>1</issue>), pp. <fpage>17</fpage>–<lpage>32</lpage>.</mixed-citation></ref><ref id="ref24"><mixed-citation publication-type="web"><person-group person-group-type="author"><string-name><surname>Gomes</surname>, <given-names>P</given-names></string-name>., <string-name><surname>Mendes</surname>, <given-names>S</given-names></string-name>. and <string-name><surname>Carvalho</surname>, <given-names>J</given-names></string-name></person-group>. (<year>2010</year>) <article-title>‘O Balanced Scorecard como instrumento de medida de desempenho das forças policiais’, <italic>Global Economics and Management Review</italic></article-title>, pp. <fpage>91</fpage>–<lpage>114</lpage>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://www.scielo.mec.pt/scielo.php?pid=S0873-74442010000200006&amp;script=sci_arttext">http://www.scielo.mec.pt/scielo.php?pid=S0873-74442010000200006&amp;script=sci_arttext</ext-link> (Accessed: 1 June 2021)</comment>.</mixed-citation></ref><ref id="ref25"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Gruening</surname>, <given-names>G</given-names></string-name></person-group>. (<year>2001</year>) <article-title>‘Origin and theoretical basis of new public management’</article-title>, <source>International Public Management Journal</source>, <volume>4</volume>, pp. <fpage>1</fpage>–<lpage>25</lpage>. doi: <pub-id pub-id-type="doi">10.1016/S1096-7494(01)00041-1</pub-id>.</mixed-citation></ref><ref id="ref26"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Hair</surname>, <given-names>F</given-names></string-name>., <string-name><surname>Hult</surname>, <given-names>M</given-names></string-name>., <string-name><surname>Ringle</surname>, <given-names>C</given-names></string-name>., and <string-name><surname>Sarstedt</surname>, <given-names>M</given-names></string-name></person-group>. (<year>2017</year>) <chapter-title><italic>A primer on partial least squares structural equation modeling (PLS-SEM)</italic></chapter-title>. <edition>2nd ed</edition>. <publisher-loc>London</publisher-loc>: <publisher-name>Sage Publications</publisher-name>.</mixed-citation></ref><ref id="ref27"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Hannay</surname>, <given-names>J.E</given-names></string-name>. and <string-name><surname>Gjørven</surname>, <given-names>E</given-names></string-name></person-group>. (<year>2021</year>) <article-title>‘Leveraging network-centric strategic goals in capabilities’</article-title>, <source>Journal of Military Studies</source>, pp. <fpage>1</fpage>–<lpage>15</lpage>. doi: <pub-id pub-id-type="doi">10.2478/jms-2021-0001</pub-id>.</mixed-citation></ref><ref id="ref28"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Heng</surname>, <given-names>T.W</given-names></string-name></person-group>. (<year>2012</year>) <article-title>‘The concept of a decisive battle and the key takeaways for the Singapore armed forces’</article-title>, <source>Journal of the Singapore Armed Forces</source>, <volume>42</volume>(<issue>1</issue>), pp. <fpage>1</fpage>–<lpage>11</lpage>.</mixed-citation></ref><ref id="ref29"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Julnes</surname>, <given-names>P.D.L</given-names></string-name>. and <string-name><surname>Holzer</surname>, <given-names>M</given-names></string-name></person-group>. (<year>2001</year>) <article-title>‘Promoting the utilization of performance measures in public organizations: An empirical study of factors affecting adoption and implementation’</article-title>, <source>Public Administration Review</source>, <volume>61</volume>(<issue>6</issue>), pp. <fpage>693</fpage>–<lpage>708</lpage>. doi: <pub-id pub-id-type="doi">10.1111/0033-3352.00140</pub-id>.</mixed-citation></ref><ref id="ref30"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Klein</surname>, <given-names>P. G</given-names></string-name>., <string-name><surname>Mahoney</surname>, <given-names>J. T</given-names></string-name>., <string-name><surname>Mcgahan</surname>, <given-names>A. M</given-names></string-name>., and <string-name><surname>Pitelis</surname>, <given-names>C. N</given-names></string-name></person-group>. (<year>2013</year>) <article-title>‘Capabilities and strategic entrepreneurship in public organizations’</article-title>, <source>Strategic Entrepreneurship Journal</source>, <volume>7</volume>, pp. <fpage>70</fpage>–<lpage>91</lpage>. doi: <pub-id pub-id-type="doi">10.1002/sej.1147</pub-id>.</mixed-citation></ref><ref id="ref31"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Krosnick</surname>, <given-names>J.A</given-names></string-name>. and <string-name><surname>Presser</surname>, <given-names>S</given-names></string-name></person-group>. (<year>2010</year>) <chapter-title>‘Question and questionnaire design’, in <italic>Handbook of survey research</italic></chapter-title>. <edition>2nd ed</edition>. <publisher-loc>West Yorkshire</publisher-loc>: <publisher-name>Emerald Group</publisher-name>.</mixed-citation></ref><ref id="ref32"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Marôco</surname>, <given-names>J</given-names></string-name></person-group>. (<year>2014</year>) <chapter-title><italic>Análise Estatística com o SPSS Statistics</italic></chapter-title>. <source>6a Edição</source>. <publisher-loc>Pêro Pinheiro</publisher-loc>: <publisher-name>Gráfica Manuel Barbosa e Filhos</publisher-name>.</mixed-citation></ref><ref id="ref33"><mixed-citation publication-type="web"><person-group person-group-type="author"><collab>Ministério da Defesa Nacional</collab></person-group> (<year>2013</year>) <article-title>Conceito Estratégico de Defesa Nacional</article-title>. <source>Lisboa</source>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="https://www.defesa.gov.pt/pt/comunicacao/documentos/Lists/PDEFINTER_DocumentoLookupList/Conceito-Estrategico-de-Defesa-Nacional.pdf">https://www.defesa.gov.pt/pt/comunicacao/documentos/Lists/PDEFINTER_DocumentoLookupList/Conceito-Estrategico-de-Defesa-Nacional.pdf</ext-link> (Accessed: 11 February 2022)</comment>.</mixed-citation></ref><ref id="ref34"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Moore</surname>, <given-names>M.H</given-names></string-name></person-group>. (<year>2003</year>) <chapter-title><italic>The public value scorecard: A rejoinder and an alternative to ‘strategic performance measurement and management in non-profit organizations’ by Robert Kaplan</italic></chapter-title>. <publisher-loc>Cambridge</publisher-loc>: <publisher-name>Harvard University</publisher-name>.</mixed-citation></ref><ref id="ref35"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Moore</surname>, <given-names>M.H</given-names></string-name></person-group>. (<year>2013</year>) <chapter-title><italic>Recognizing Public Value</italic></chapter-title>. <publisher-loc>Cambridge</publisher-loc>: <publisher-name>Harvard University Press</publisher-name>.</mixed-citation></ref><ref id="ref36"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Moore</surname>, <given-names>M</given-names></string-name>. and <string-name><surname>Khagram</surname>, <given-names>S</given-names></string-name></person-group>. (<year>2004</year>) <chapter-title><italic>On creating public value: What business might learn from government about strategic management</italic></chapter-title>. <source>A Working Paper of the Corporate Social Responsibility Initative No. 3</source>. <publisher-loc>Cambridge</publisher-loc>: <publisher-name>Harvard University, John F. Kennedy School of Government</publisher-name>.</mixed-citation></ref><ref id="ref37"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Mukaka</surname>, <given-names>M.M</given-names></string-name></person-group>. (<year>2012</year>) <article-title>‘Statistics corner: A guide to appropriate use of correlation coefficient in medical research’</article-title>, <source>Malawi Medical Journal</source>, <volume>24</volume>(<issue>3</issue>), pp. <fpage>69</fpage>–<lpage>71</lpage>.</mixed-citation></ref><ref id="ref38"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>NATO</collab></person-group> (<year>2010</year>) <article-title><italic>Strategic concept for the defence and security of NATO</italic></article-title>. <publisher-loc>Brussels</publisher-loc>: <publisher-name>NATO Public Diplomacy Division</publisher-name>, pp. <fpage>1</fpage>–<lpage>40</lpage>.</mixed-citation></ref><ref id="ref39"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>O’Flynn</surname>, <given-names>J</given-names></string-name></person-group>. (<year>2007</year>) <article-title>‘From new public management to public value: Paradigmatic change and managerial implications’</article-title>, <source>The Australian Journal of Public Administration</source>, <volume>66</volume>(<issue>3</issue>), pp. <fpage>353</fpage>–<lpage>366</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1467-8500.2007.00545.x</pub-id>.</mixed-citation></ref><ref id="ref40"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>OECD</collab></person-group> (<year>2009</year>) <chapter-title><italic>Measuring government activity</italic></chapter-title>. <publisher-loc>Paris</publisher-loc>: <publisher-name>OECD Publishing</publisher-name>.</mixed-citation></ref><ref id="ref41"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Osborne</surname>, <given-names>S.P</given-names></string-name></person-group>. (<year>2006</year>) <article-title>‘The new public governance?’</article-title>, <source>Public Management Review</source>, <volume>8</volume>(<issue>3</issue>), pp. <fpage>377</fpage>–<lpage>387</lpage>. doi: <pub-id pub-id-type="doi">10.1080/14719030600853022</pub-id>.</mixed-citation></ref><ref id="ref42"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Pires</surname>, <given-names>N.C.B.D.L</given-names></string-name></person-group>. (<year>2016</year>) <chapter-title>‘Das ameaças e riscos intangíveis aos estados frágeis e às guerras civis’, in <italic>Ameaças e riscos transnacionais no novo mundo global</italic></chapter-title>. <source>1a Edição</source>. <publisher-loc>Porto</publisher-loc>: <publisher-name>Fronteira do Caos Editores, Lda</publisher-name>., pp. <fpage>153</fpage>–<lpage>174</lpage>.</mixed-citation></ref><ref id="ref43"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Pocinho</surname>, <given-names>M</given-names></string-name>. and <string-name><surname>Figueiredo</surname>, <given-names>J.P</given-names></string-name></person-group>. (<year>2000</year>) <article-title>‘SPSS: Uma ferramenta para a base de dados’</article-title>. <publisher-loc>Guarda</publisher-loc>: <publisher-name>Instituto Politécnico da Guarda</publisher-name>, pp. <fpage>1</fpage>–<lpage>76</lpage>.</mixed-citation></ref><ref id="ref44"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Poister</surname>, <given-names>T.H</given-names></string-name></person-group>. (<year>2003</year>) <chapter-title><italic>Measuring performance in public and nonprofit organizations</italic></chapter-title>. <publisher-loc>San Francisco</publisher-loc>: <publisher-name>Jossey-Bass</publisher-name>.</mixed-citation></ref><ref id="ref45"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Ritchie</surname>, <given-names>N</given-names></string-name></person-group>. (<year>2011</year>) <article-title>‘Rethinking security: A critical analysis of the strategic defence and security review’</article-title>, <source>International Affairs</source>, <volume>87</volume>(<issue>2</issue>), pp. <fpage>355</fpage>–<lpage>376</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1468-2346.2011.00977.x</pub-id>.</mixed-citation></ref><ref id="ref46"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Robinson</surname>, <given-names>A.M</given-names></string-name></person-group>. (<year>2015</year>) <chapter-title><italic>From old public administration to the new public service implications for public sector reform in developing countries</italic></chapter-title>. <publisher-loc>Singapore</publisher-loc>: <publisher-name>Global Centre for Public Service Excellence</publisher-name>.</mixed-citation></ref><ref id="ref47"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Santos</surname>, <given-names>J.L.D</given-names></string-name></person-group>. (<year>2013</year>) <article-title>‘Reformar o Estado–Forças Armadas’, <italic>Revista Militar</italic>, November</article-title>, pp. <fpage>981</fpage>–<lpage>988</lpage>.</mixed-citation></ref><ref id="ref48"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Saunders</surname>, <given-names>M</given-names></string-name>., <string-name><surname>Lewis</surname>, <given-names>P</given-names></string-name>. and <string-name><surname>Thornhill</surname>, <given-names>A</given-names></string-name></person-group>. (<year>2009</year>) <chapter-title><italic>Research methods for business students</italic></chapter-title>. <edition>5th ed</edition>. <publisher-loc>Harlow</publisher-loc>: <publisher-name>Pearson Education Limited</publisher-name>.</mixed-citation></ref><ref id="ref49"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Stoker</surname>, <given-names>G</given-names></string-name></person-group>. (<year>2006</year>) <article-title>‘Public value management: A new narrative for networked governance?’</article-title>, <source>American Review of Public Administration</source>, <volume>36</volume>(<issue>I</issue>), pp. <fpage>41</fpage>–<lpage>57</lpage>. doi: <pub-id pub-id-type="doi">10.1177/0275074005282583</pub-id>.</mixed-citation></ref><ref id="ref50"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Tardy</surname>, <given-names>T</given-names></string-name></person-group>. (<year>2018</year>) <article-title>‘European security does European defence really matter? Fortunes and misfortunes of the common security and defence policy’</article-title>, <source>European Security</source>, <volume>27</volume>(<issue>2</issue>), pp. <fpage>119</fpage>–<lpage>137</lpage>. doi: <pub-id pub-id-type="doi">10.1080/09662839.2018.1454434</pub-id>.</mixed-citation></ref><ref id="ref51"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Tellis</surname>, <given-names>A.J</given-names></string-name>., <string-name><surname>Bially</surname>, <given-names>J</given-names></string-name>., <string-name><surname>Layne</surname>, <given-names>C</given-names></string-name>. and <string-name><surname>McPherson</surname>, <given-names>M</given-names></string-name></person-group>. (<year>2000</year>) <chapter-title><italic>Measuring national power in the postindustrial age</italic></chapter-title>. <publisher-loc>Santa Mónica</publisher-loc>: <publisher-name>RAND Corporation</publisher-name>.</mixed-citation></ref><ref id="ref52"><mixed-citation publication-type="web"><person-group person-group-type="author"><collab>United Nations</collab></person-group> (<year>2004</year>) <article-title><italic>Report of the high-level panel on threats, challenges and change, a more secure world: Our shared responsibility</italic></article-title>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://www.un.org/secureworld/">http://www.un.org/secureworld/</ext-link></comment>.</mixed-citation></ref><ref id="ref53"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Vicente</surname>, <given-names>P</given-names></string-name></person-group>. (<year>2011</year>) <article-title>‘As Forças Armadas e a Segurança Interna</article-title>. <source>O Caso Nacional’, Boletim Ensino/Investigação</source>, <volume>10</volume> (<issue>May</issue>), pp. <fpage>771</fpage>–<lpage>789</lpage>.</mixed-citation></ref><ref id="ref54"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Webber</surname>, <given-names>D</given-names></string-name></person-group>. (<year>2004</year>) <article-title>‘Managing the public’s money: From outputs to outcomes–And beyond’</article-title>, <source>OECD Journal on Budgeting</source>, <volume>4</volume>(<issue>2</issue>), pp. <fpage>101</fpage>–<lpage>122</lpage>. doi: <pub-id pub-id-type="doi">10.1787/budget-v4-art10-en</pub-id>.</mixed-citation></ref><ref id="ref55"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Zandee</surname>, <given-names>D</given-names></string-name></person-group>. (<year>2019</year>) <article-title>‘70 years of NATO: The alliance in troubled waters’</article-title>, <source>Militaire Spectator, (April)</source>, pp. <fpage>172</fpage>–<lpage>179</lpage>.</mixed-citation></ref></ref-list></back></article>
