Inter-Organisational Exercises in Dry and Wet Context—Why Do Maritime Response Organisations Gain More Knowledge from Exercises at Sea Than Those on Shore?

This is a study of inter-organisational exercises arranged by on-shore organisations (ONSOs) and off-shore organisations (OFFSOs). The aim was to compare findings from trained emergency staffs’ perceptions of the impact of exercises. The data were retrieved from surveys conducted by the research team in conjunction with exercises. The surveys included staff from the coast guard, sea rescue, police department, fire department and ambulance services. A total of 94 professional emergency personnel participated in the ONSO exercises and 252 in the OFFSO exercises. The study was based on the suggestion that collaborative elements during an inter-organisational exercise promote learning, and learning is important to make the exercises useful. Collaboration proved to be a predictor for some of the items in learning, and learning was a predictor for some of the items in utility. There was, however, a stronger covariation between collaboration, learning and utility in the OFFSOs exercises than in the ONSOs. One reason might be the different cultures of emergency staff involved in on-shore and off-shore organisations. The OFFSOs’ qualifications may be dominated by seamanship, together with professional practice, and all parties are expected to act as first responders. ONSOs, on the other hand, practice exercises from a strict professional and legal perspective.


Introduction
Strategic sustainability infers a built-in resistance to the prominence and effects of crisis events. A common way to maximise society sustainability is by maintaining the emergency response via regular exercises. Inter-organisational exercises are supposed to help authorities to become better at handling accidents, crises and disasters. Exercises involving different emergency services are carried out with the purpose of strengthening the inter-organisational ability to deal with difficult events that require extensive resources in a short time. There are, however, few studies of the efficiency of inter-organisational exercises in terms of learning and utility. One exception is Scandinavia, where inter-organisational exercises at sea and ashore have been studied [1][2][3][4][5]. The concept of inter-organisational exercises, as it is used in Scandinavia, describes exercises aiming to prevent organisational fragmentation, and develop integration and distribution of tasks [6,7].
The risks related to going aground or collisions with ice, or fire are not in accordance with the number of available rescue services, especially in remote areas. Disasters in wastelands and distant maritime areas put collaboration over organisational and national borders to the test [31]. Rescue missions at sea are, however, performed by all available actors and not just those who are specialised in emergency response. Long distances and severe weather conditions have forced different parties to collaborate, regardless of whether they are publicly financed rescue services, voluntary financed services (e.g., Red Cross and Society for Sea Rescue), fishing fleets or the merchant navy [32].
Several catastrophes have led to updated and sharpened legislations in the maritime context. This was intensified after a series of shipping accidents with grave environmental damages during late 1960s and early 1970s. The subsequent investigations concluded that the main cause of these accidents was human errors, resulting from poor training and lack of inter-organisational competencies [33]. Subsequently, maritime mass-casualty disasters like the Scandinavian Star disaster in 1990 [34], the Estonia disaster in 1994 [35] and the Costa Concordia wreckage in 2012 [36] shed light on the need to put more efforts in inter-organisational education and training. Hence, the maritime domain started harmonising and regulating its educational standards worldwide.
The International Maritime Organisation (IMO)-a technical agency of the United Nations-was introduced in 1959 to harmonise standards of international maritime activities, including training and qualification of mariners who navigate ships. In 1978, the IMO launched its first educational standards-the Standards of Training, Certification and Watch Keeping for Seafarers (STCW). It was considered a breakthrough, as there were practically no international standards in maritime exercises [37]. However, the STCW did not succeed in harmonizing the already established national standards around the world. Several revisions seeking to repair the shortcomings of its predecessors were made, and new conventions were prepared including the recent Manilla amendments, STCW 2010. STCW 2010 highlighted and homogenised concepts of intra-organisational exercises for mariners. The STCW standardised security exercises in different scenarios such as attacks by pirates and operations in polar waters [38].
With regard to collaboration during emergencies in land-based contexts, there are no such standards as those provided by IMO. Some standardisation in crisis organisations and crisis work can be seen within certain covenants like the European Union. Nonetheless, there is still a lack of international as well as national standards in inter-organisational exercises. At the country level, there is some fragmentation. It has been reported about intra-organisational autonomy during emergency response operations from Sweden and Norway. The official evaluation following the 2011 terrorist attacks in Norway found, among other conclusions, that the emergency response had been insufficient, and that inter-organisational collaboration efforts in particular had been inadequate [10]. An article titled "Why is collaboration minimized at the accident scene?" reported on the difference between rhetoric and practice in connection with accident work. Collaboration is seen as a rhetorical ideal rather than something that is carried out in real life accident work. The results from the study showed that police force, fire fighters and prehospital healthcare staff have an intention to develop excellent forms of collaboration at the accident scene but avoid this because of asymmetries in standards and lack of incentives [39]. A study from a tunnel exercise in Norway showed a risk for competition within organisations with unclear hierarchies. A lack of clarity in the distribution of roles and power struggles was identified as potential risks affecting the handling of emergencies [40]. Short distances and high accessibility can also be reasons why land-based emergency staff can uphold a degree of autonomy. In contrast to operations at sea, land-based operations can most often be reached by all the required resources within reasonable time and normally do not need to rely on each other's willingness to cross professional borders [41]. Information exchange during land-based emergency response operations is also known to uphold a certain degree of autonomy. Each organisation in the response network has operational field units at different levels, different functional command structures, separate back offices and intraorganisational radio communications channels [42,43].
Scandinavian countries like Norway and Sweden have a lot of similarities and few differences. Because of a long border between Norway and Sweden, partly in populated areas, they have agreements on sharing resources and coordinating actions during emergencies. The response organisations of the two countries perform common inter-organisational exercises; moreover, the radiocommunication systems, "Nødnett" in Norway and "Rakel" in Sweden, have been connected since 2016 (MSB 2018). The open borders between the countries have a long tradition, based on similar languages, constitutional monarchies, democracy and governments appointed by a parliament in both countries. They share national emergency preparedness principles of responsibility, equality and proximity in their respective legislations [8].
The dependence between organisations at incident locations is well known, which justifies the need for inter-organisational exercises to be conducted regularly [39,44]. Obviously, there are similarities and differences between OFFSOs and ONSOs' collaborative strategies during emergencies. After decades of naval disasters, OFFSOs have developed harmonised standards, while, in the ONSO context, the routines are still fragmented. The ONSO context seems to be more affected by the perception of collaboration as a rhetorical ideal while OFFSOs are characterised by a willingness to cross organisational boarders. We still do not know if collaboration exercises differ in their impact on OFFSOs and ONSOs. Despite a lack of studies [45], inter-organisational exercises arranged by off-shore organisations (OFFSOs) as well as on-shore organisations (ONSOs) are practised at considerable cost, with the supposition that they contribute to learning and utility in real life disasters [3]. We aim to find similarities and differences in the outcome from inter-organisational exercises, in terms of learning and utility, in the maritime versus land-based contexts. The study is supposed to reveal context-specific challenges, weaknesses and differences in traditions of emergency preparedness in order to suggest how to improve the outcome from inter-organisational exercises [46].

Methods
Five studies from a Norwegian/Swedish research team was chosen to compare inter-organisational exercises arranged by ONSOs and OFFSOs. One of the studies provided data from three ONSO exercises. Four studies contained data from six OFSO exercises, four of the OFSO exercises were pooled into two datasets. The questionnaire used to collect data during all included exercises was the collaboration, learning and utility instrument (CLU) measuring collaboration, perceived learning and utility from 1 (strongly disagree) to 5 (strongly agree) on a Likert scale [1][2][3][4][5] (see the Supplementary Materials). The CLU scale has been applied in similar studies of crisis exercises [1,4,47,48]. Primarily, it was developed by a team of academic instrument-developers together with emergency practitioners from response organisations. The development was made in different steps based on Stein's [21] learning theories, which have their out spring from Klabber's [49] perspectives on how institutions learn, Meyer and Rowan's 1977 decoupling theory [50], Berlin and Carlström's theories on sequential, parallel and synchronous collaboration [51]. The collaboration dimension encompassed questions about the collaborative characteristics of an exercise. The learning dimension elaborated lessons learnt from collaboration during the exercises. The utility dimension determined if the exercise was perceived to be useful during real emergencies. In addition, questions were elaborated about experience and affiliation.
The CLU surveys were all distributed and collected from emergency personnel in connection with inter-organisational exercises at the included ONSOs exercises. Regarding the OFFSOs exercises, the survey was e-mailed to the participants from an e-mail list. The homogeneity of the 17 items showed a Cronbach's α of between 0.68 and 0.88. Statistical significance was established at p = 0.05, and all tests were two-tailed [52]. The analysis stems primarily from descriptive data and regressions (bivariate and multiple). Data were imported and analysed in Statistical Packages for the Social Sciences (SPSS) version 24.0.

The Context of the Survey
The studied inter-organisational exercises were full-scale field exercises. All the organisations that normally participated in the scenario, e.g., coast guard, sea rescue, police department, fire department and ambulance services, were engaged in each exercise. Moreover, the exercises aimed to improve inter-organisational collaboration, crossing organisational boundaries during accidents and disasters. The exercises took place in different parts of Norway and Sweden (Table 1).

Procedures
The survey included staff in different positions, for example, operational staff in the field, and staff officers from levels of management. Informed consent was obtained from the organisers, and each respondent was provided with written information. They were informed about confidentiality and the opportunity to withdraw from participation in the survey at any time. The data were collected with informed verbal consent.
Self-administered questionnaires collecting data were distributed. The questionnaires were coded for each exercise, and the completed questionnaires were collected anonymously by the authors. The questionnaires from the ONSOs were in paper form, and the later was outlined as web-based documents, while the questionnaires of the OFFSOs were web based.

Participants
A total of 94 participants responded to the ONSO paper form survey and 252 to the web-based OFFSO survey.
The response rate was 95% for the ONSO survey and 49% for the OFFSO survey. The participants of the ONSOs and the OFFSOs had previously participated in 1 to 12 exercises (ONSOs M = 2.87, SD = 2.24; OFFSOs M = 3.53, SD = 1.64) before the study. Their age ranged from 25 to 49 years for the ONSOs and 18-55 for the OFFSOs. In the ONSO survey, all participants (100%) belonged to the public sector (police personnel, fire fighters and ambulance services). For the OFFSO survey, 86% belonged to the public sector, 10% to private sector and 4% to volunteer sector.

Learning
The majority of the ONSO and the OFFSO respondents replied that they learnt new things to a certain degree during the exercises (ONSOs M

Bivariate Regressions
The causal effects of collaboration, learning and utility in the ONSO and OFFSO contexts were tested in a number of bivariate regressions. The collaborative dimension of the exercises was significantly correlated to the mean learning score across most of the items associated with the learning measurements in both exercise contexts. The strongest significant correlation on ONSOs was found between the item 'well-known activities during the exercise' and learning (R = 0.48), with this item explaining a significant proportion of variance in the mean learning score (R 2 = 0.23, F = 27.67, p < 0.00). The strongest significant correlation on OFFSOs was the item 'my point of view was regarded' and learning (R = 0.40), with this item explaining a significant proportion of variance in the mean learning score (R 2 = 0.16, F = 48.86, p < 0.00) ( Table 2).

Bivariate Regressions
The causal effects of collaboration, learning and utility in the ONSO and OFFSO contexts were tested in a number of bivariate regressions. The collaborative dimension of the exercises was significantly correlated to the mean learning score across most of the items associated with the learning measurements in both exercise contexts. The strongest significant correlation on ONSOs was found between the item 'well-known activities during the exercise' and learning (R = 0.48), with this item explaining a significant proportion of variance in the mean learning score (R 2 = 0.23, F = 27.67, p < 0.00). The strongest significant correlation on OFFSOs was the item 'my point of view was regarded' and learning (R = 0.40), with this item explaining a significant proportion of variance in the mean learning score (R 2 = 0.16, F = 48.86, p < 0.00) ( Table 2). Some of the items in the learning dimension were significantly correlated to the usefulness items. The strongest significant correlation of ONSOs was found between the item 'learnt new things' and usefulness (R = 0.47, R 2 = 0.22, F = 26.35, p < 0.00). A somewhat weaker correlation was found for the OFFSOs for the same item (R = 0.35, R 2 = 0.11, F = 31.99, p < 0.00) ( Table 3).

Multiple Regressions
Significant variables from the bivariate regressions were tested separately for the ONSOs and the OFFSOs in multiple regressions. In the case of ONSOs, the collaborative features together predicted 53% (R 2 = 0.53) of learning and for the OFFSOs, they predicted 25% (R 2 = 0.25) of the variance in learning. This meant that 47% and 75% of the predicted variance was non-unaccounted for in the case of ONSOs and OFFSOs, respectively. In the case of ONSOs, four variables were still significant: 'opportunities to improvise', 'well-known activities during the exercise', 'clear instructions for collaborative practices during the exercises' and 'my points of view were regarded'. The OFFSOs showed one still significant variable: 'my points of view were regarded'. The remaining variables displayed somewhat lower t-values and lacked significance on their own (Table 4). In the next multiple regression, it was found that the items of learning predicted 26% (R 2 = 0.26) of the variance in usefulness in the ONSO and the OFFSO context. This meant that 74% of the predicted variance was still missing in the regressions. One variable was still significant, 'learnt new things' in the ONSO and the OFFSO contexts and 'learnt new concepts' in the OFFSO context. The other variables displayed moderate t-values and lacked significance on their own (Table 5).

Discussion
The OFFSOs considered the exercises to be focused on collaboration to a higher degree (88.1%) than the ONSOs (75.6%). In all items of collaboration, the OFFSOs scored a stronger result except on the item, 'if the actions were those they usually practiced'. Only 5.2% of the OFFSOs did not consider the actions to be those they usually practiced (ONSOs, 44.6%). A similar relation was found within the learning dimension. The majority replied they learnt new things, but the mean for all items within the learning dimension was higher for the OFFSOs (3.67) than for the ONSOs (3.03). The OFFSOs reported they learnt about communication patterns such as concepts and acronyms (60.3%) as well as prioritising (47.9%) to a higher degree than the ONSOs (22.4% and 17%). However, both OFFSOs and ONSOs showed equal results in the utility dimension. A few more participants in the ONSOs dimension perceived the exercises to be more useful during real life events than the OFFSOs (84.1% and 77.1%, respectively).
The multivariate regressions proved that collaboration had a higher degree of explanatory impact on learning for the ONSOs (R 2 = 0.53) than the OFFSOs (R 2 = 0.25). The impact of learning on the utility dimension was similar at sea and on dry land (R 2 = 0.26). The still significant items contributing to learning was 'my point of view was regarded' (OFFSOs and ONSOs). Additionally, 'well-known activities', 'clear instructions' and 'opportunity to improvise' had impact on learning in the ONSOs context.
The results of the study boil down to the finding that communication, learning new things and different points of view are regarded as important to achieve learning and utility from inter-organisational exercises. This calls for communicative and interactive processes during exercises [43]. There are, however, obstacles to achieving such a process. ONSOs repeat well-known activities and are known to be organisationally differentiated. OFFSOs seem to be more integrated than ONSOs, but they are restricted by international regulations. Furthermore, inter-organisational exercises often seem to strictly follow a predetermined manuscript, not allowing much room for improvisation. Consequently, exercises tend to restrict the learning and to be repetitive, drill-like and intra-organisational because of the lack of timeouts, spontaneous assessments and inter-organisational discussions, allowing for reflections on alternative ways to handle tricky situations [24,25,53]. The bivariate regressions, however, display that well-known activities had some impact on learning, especially in the ONSOs context (R 2 = 0.23 and OFFSO, R 2 = 0.03). A potential explanation can be the use of instrumental learning objectives, leaving little opportunity for improvisation [54]. This means that it is important to exercise well-known and repetitive everyday scenarios, and that new strategies may be developed to improve emergency responses. The result suggests that none of these extremes, (the unknown versus the familiar) can be excluded from inter-organisational exercises [42].
Lessons can be learned from inter-organisational exercises, both on-and offshore if they make room for the participants to talk informally before and after the training. In a recent study, the labelled side effect of the collaborative exercise was highlighted as more important than intra-organisational practices [40]. The opportunity to get to know each other and discuss structures improved collaboration in real life emergencies. This means that even though the inter-organisational exercise per se seems to have poor results, it might lead to the creation of a collaborative culture among the participants. The ability to form and develop relationships might be more valuable than the planned formal learning.
The reason for the surprisingly high degree of learning from OFFSOs exercises, in terms of communication patterns, may be traced to the fact that crisis management in the maritime context is a high-tech sector. Due to several digital and analogous communication and positioning systems as well as international and national regulations, the complexity in training for an accident, or a disaster at sea will be very educational, even if the techniques and scenarios have been practised before. Moreover, if the size of the exercise is too big, it can hamper the possibility for learning, as different actors may focus more on their individual goals and solve discipline-specific tasks rather than on cross-border collaboration and the sharing of resources [40].
Another reason for the stronger learning outcomes in the maritime context may be different cultures at sea and on dry land. ONSOs practise manoeuvres unique to their intra-organisational context, e.g., weapons, advanced medical equipment, fire and rescue equipment from a strict professional and legal perspective. The OFFSOs qualifications, on the other hand, may primarily be dominated by seamanship together with professional practice. The seamanship is a common necessity for all collaborating OFFSOs, whereas the different professions, to some extent, are limited within the physical boundaries of the ship itself. A second factor that is important for the evolvement of cultural bonds is a tradition of spontaneous communication between crews at sea. On dry land, we have bystanders, i.e., the public, and first responders, but in the maritime context all parties are expected to act as first responders, regardless of whether they are publicly financed rescue services. In densely populated areas on land, it is easier to hide behind the crowd during an emergency than it is at sea. Petrenj studied collaboration during accidents on land and highlighted that the main obstacles to collaboration was a lack of incentives and ambiguity in roles and expectations [55]. In the maritime context, actors have proven to be aware of a common and core value of understanding and agreement [56]. Such a value can offer synergies focused on the big picture rather than just prioritising specific tasks they are trained for [19]. In contrast to ONSOs, collaboration at sea seems to be part of the preparedness for everyday work and the ethos of seamanship.

Practical Implications
This study shows collaboration and learning may be obtained from exercises based on already well-known activities. In this study, well-known activities were combined with opportunities as independent factors for learning. These results can inspire exercise planners to combine the unknown with familiar scenarios. The results may also encourage planners to use timeouts, seminars and repetitions of actions in order to elaborate highly efficient types of inter-organisational collaboration. The use of scripts may hamper learning and utility. This can be addressed by increased the focus on improvisation, together with a new training methodology. Crossing organisational borders during exercises can contribute to a culture that stimulates collaboration, learning and utility in actual emergency work.

Limitations
There are limited studies on exercises and even fewer conducting meta-analysis of exercises. This study is based on five studies on nine exercises and the ONSOs were collected from only one study. In order to verify the results, several more context specific explorations have to be performed. Furthermore, studies on inter-organisational exercises on land and in the maritime context should be extended to other areas such as the aerospace industry and other security-intensive contexts. Even though Norway and Sweden, where the data for this study were collected, have a lot of similarities, exercises from different cultural contexts can provide important results, contributing to the understanding of how to improve learning and utility from inter-organisational exercises.
The poor participation for the OFFSO survey may be due to a lack of research interest among participants, but also the lack of influence of big scale exercises. It can also be related to intra-organisational focus-and sector-specific objectives. Another reason may be the web-based questionnaires. Compared to paper questionnaires, web-based questionnaires have proven to be less responsive in the Scandinavian context [57].
Author Contributions: Conceptualization, all; methodology, E.C. and J.L.S.; writing-original draft, E.C.; writing-review and editing, all; supervision, E.C. All authors have read and agreed to the published version of the manuscript.