Documente Academic
Documente Profesional
Documente Cultură
Safety Science
journal homepage: www.elsevier.com/locate/ssci
Department of Philosophy and the History of Technology, Division of Philosophy, KTH, Teknikringen 78B, 100 44 Stockholm, Sweden
Vattenfall Power Consultant, Box 527, SE-162 16 Stockholm, Sweden
a r t i c l e
i n f o
Article history:
Received 25 April 2008
Received in revised form 10 March 2009
Accepted 5 February 2010
Keywords:
Experience feedback
Accidents
Incidents
Evaluation studies
Accident investigation
CHAIN model
a b s t r a c t
A model of experience feedback (the CHAIN model) that emphasizes the whole chain from initial reporting to preventive measures is used to identify important research needs in the eld of learning from accidents. Based on the model, six quality criteria for experience feedback after an accident or incident are
presented. Research on experience feedback from accidents is reviewed. The overall conclusion is that
the discipline of experience feedback has not been sufciently self-reective. The process of experience
feedback can and should be applied to experience feedback itself, but that is rarely done. Evaluation studies are needed that provide hard (evidence-based) information about the effects of various methodologies
and organizational structures. Four types of studies are particularly important for the development of evidence-based accident investigation practices: (1) studies of the effects and the efciency of different accident investigation methods, (2) studies of the dissemination of conclusions from accident investigation,
(3) follow-up studies of the extent to which accident investigation reports give rise to actual preventive
measures, and (4) studies of the integration of experience feedback systems into overall systems of risk
management.
2010 Elsevier Ltd. All rights reserved.
1. Introduction
In order to prevent accidents it is essential to learn from previous accidents and incidents. Much learning from accidents occurs
spontaneously, such as when a child changes her behaviour after
fallen off her bicycle. In other cases learning from accidents has
to be institutionalized in order to overcome various social barriers
and to disseminate information so that new insights in accident
prevention are as widely applied as possible. Both governmental
and private organizations have been created to ensure that the
appropriate conclusions are drawn from accidents. One of these
organizations, the Swedish Centre for Lessons Learned from Incidents and Accidents (NCO) has described the systematic learning
from accidents as follows:
Learning from accidents is to extract, put together and analyse
and also to communicate and bring back knowledge on accidents
and near-accidents, from discovery to course of event, damage,
and cause to all who need this information. The purpose is to prevent the occurrence of similar events, to limit damage, and thereby
improve safety work.1
The scientic literature on experience feedback from accidents
has grown signicantly in the last few decades. However, this liter-
* Corresponding author. Tel.: +46 (0) 8 790 94 25; fax: +46 (0) 8 790 95 17.
E-mail address: a-klindberg@infra.kth.se (A.-K. Lindberg).
1
Swedish Rescue Services Agency: www.srv.se/nco Downloaded 2006-06-01.
(Translation from Swedish by the authors.)
0925-7535/$ - see front matter 2010 Elsevier Ltd. All rights reserved.
doi:10.1016/j.ssci.2010.02.004
715
Workplace
Workplace
Workplace
Workplace
Workplace
Workplace
Workplace
Workplace
Accident
investigation
g
board
Workplace
Workplace
Workplace
Workplace
Workplace
Workplace
Workplace
Workplace
Workplace
Workplace
W k l
Workplace
W k l
Workplace
Reporting
Selection
Investigation
Dissemination
5
Prevention
716
accidents. The goal of the nal stage in the process is that, based on
this information, such accidents should be prevented.
Finally, the method of experience feedback should be applied to
the process itself. In other words, the process should be self-reective, and include evaluation activities that lead to improvements of
the process. In summary, our six basic quality criteria for experience feedback are as follows:
Initial reporting. All events that are plausible candidates for indepth accident investigation should be reported in sufcient
detail for a decision on whether such an investigation should
take place.
Selection methodology. The events selected for in-depth investigation should be those from which as much information as possible can be extracted that is useful for preventive work.
Investigation. The procedures and methodologies of investigation
are constructed to provide information that is as useful as possible for the prevention of future accidents.
Dissemination of results. The investigation results are distributed
to all those who can use them to prevent future accidents.
Preventive measures. The information from accident investigations is used to prevent future accidents.
Evaluation. The experience feedback process is regularly evaluated, and is itself improved through experience feedback.
3. Initial reporting
The rst stage in the learning process is the initial reporting of
accidents and incidents. What events are reported depends on how
accidents are dened, and on the routines and regulations for
reporting (Duffey and Saull, 2003).
In Section 3.1 we focus on the basic requirements for initial reports. In the following two subsections we discuss two topics that
have been dealt with fairly extensively in the research literature,
namely whether reporting should include incidents that did not
develop into completed accidents (Section 3.2) and the use of databases for the collection of reported accidents and incidents (Section 3.3).
3.1. Basic requirements on initial reports
The quality requirement on initial reporting that was mentioned in Section 2.2 can be operationalized by dividing it into
three components: (1) All plausible candidates for in-depth accident investigation should be reported. (2) These initial reports
should contain the information needed for the selection of events
for in-depth investigation. (3) These reports should reach those
who make this selection, and reach them as soon as possible after
the event.
Concerning the rst of these criteria, the coverage of reporting,
a fair amount of empirical information is available in the research
literature. It is well-known how the reporting of accidents is organized and how it differs between sectors and between individual
companies and organizations (Kjelln, 2000; Cox et al., 2006).
Many countries have legislation that requires employers to report
occupational accidents to the authorities (Kjelln, 2000). The quality of reporting differs between countries and between types of
industry. Generally speaking, accidents in smaller companies and
accidents not leading to severe injuries tend to be underreported.
Several sectors have industry-specic reporting systems that cover
both occupational risks and risks to the public. Hence, most industrial countries have reporting systems that cover accidents on
roads and in the railroad system. The aviation industry, the nuclear
industry and the offshore oil and gas industry all have well-devel-
2
Joint Research Centre: http://mahbsrv.jrc.it/Activities-WhatIsMars.html Downloaded 2006-01-09.
3
Joint Research Centre: http://mahbsrv.jrc.it/mars/Default.html Downloaded
2007-06-14.
4
English translation: Central Reporting and Evaluation Ofce for Hazardous
Incidents and Incidents in Process Engineering Facilities.
5
Swedish Road Administration: http://www20.vv.se/fudinfoexternwebb/pages/
ProjektVisaNy.aspx?ProjektId = 1260 Downloaded 2006-06-16.
717
4. Selection
The second step in the CHAIN model is the selection of accidents and incidents for investigations. The selection process depends on the size and structure of the organisation, the
investigation resources and the number of accidents of different
types. An organisation with many non-serious accidents may
have to exclude many accidents from in-depth investigation,
whereas an organisation where accidents are rare but serious
has good reasons to investigate all of them, and probably also a
signicant number of incidents and near-accidents. Sectors with
a tradition of careful investigations of accidents and serious incidents include aviation, the nuclear industry, space programmes,
and the offshore oil industry. In most sectors with many accidents, the only feasible strategy is to investigate only a selection
of the accidents.
The selection of accidents for investigation can be performed in
different ways, for instance with a preference for representative
accidents, unusual accidents, accidents with unknown causes, or
accidents with particularly serious outcomes. For instance, workplace accidents in the Netherlands are selected by the following
criteria: accidents causing death, permanent injury, or inpatient
treatment in hospital (Hale et al., 2007a,b). The selection criteria
for in-depth investigations performed by the Swedish Work Environment Authoritys accident investigation board were fatal
accidents, accidents in the building and process industries, accidents involving heavy machinery, accidents involving several
employers, accidents that can generate signicant media interest,
and accidents of national interest (Lindberg and Hansson, 2006).
The Swedish accident investigation board (SHK) that investigates
accidents in several areas such as aviation, shipping, road and rail
trafc, chemical accidents etc. use rather simple criteria. It is the
718
23.
In 2001/2002 the European Safety, Reliability and Data Association (ESReDA) commissioned a study of accident investigation in
three sectors. The sectors were transport, energy production, and
production and storage of hazardous materials. A questionnaire
was sent out to about 150 organisations and 49 answers were treated in the ESReDA report covering 15 countries in Europe. A 53% of
the answers came from an organisation or institution in a Nordic
country. The respondents were divided into three main categories:
authority (27), company (15), and research (7). The study showed
that the main stated objectives of the investigation teams were to
collect facts, to nd primary and underlying causes of an accident,
and to prevent similar accidents in the future. Accident investigation boards/bureaus usually have investigators on their own payrolls, but sometimes they also contract external investigators.
Other authorities or government bodies, research centres, and universities have either permanent investigators or temporary investigation teams. Only 11 of the organisations stated that they used
some kind of recommended investigation method. The largest
group answered that they had no standard method for the investigation of accidents (Roed-Larsen et al., 2004).
Le Coze (2008) compared the investigation methods used in different types of accident investigations. He concluded that different
type of investigation tools should be used, depending on the purpose and the resources of the particular investigation.
As already mentioned, descriptions of various methods for the
investigation of accidents take up a large part of the literature on
experience feedback. However, we have not been able to nd studies that systematically evaluate and compare these methods with
respect to their efciency in identifying measures to be taken to
avoid future accidents. Such studies should, in our view, be an
important addition to the literature. They would have to pay close
attention to the underlying conceptualizations of causality, agency,
and responsibility that shape these methodologies.
6. Dissemination
The fourth step in the CHAIN model is the dissemination of reports and information on the accident. Several authors have
emphasized the importance of efcient dissemination of accident
investigation reports. According to Johnson (2002), a major reason
for failure of dissemination may be that investigation reports are
too long and not written in a sufciently accessible language. Johnson and Holloway (2003) point out the importance of ensuring that
insights gained from an accident investigation are disseminated
both within and between organisations. Amoore and Ingram
(2002) emphasize the importance of dissemination of information
in healthcare, particular about failures of medical devices. In an
evaluation of the Swedish accident investigation board for workplace accidents (Lindberg and Hansson, 2006) it was found that
the dissemination stage was the weak link in the chain, leaving
considerable scope for improvement.
According to Trevor Kletz it is a major problem that even when
lessons are learnt, they are often soon forgotten. He proposes that
both new and old accidents should be discussed in safety newsletters and on safety meetings, making use of knowledge from people
with long experience. Serious accidents should be discussed in the
training of new personnel. He also proposes that old reports be
made more accessible (Kletz, 1993). Even when we prepare a
good report and circulate it widely, all too often it is read, led
and forgotten. Organizations have no memory. Only people have
memories and after a few years they move on taking their memories with them (Kletz, 2002, p. 5).
One organisation that has put considerable effort into the dissemination of information from accident investigation is the US
NTSB. Since its inception in 1967 it has issued about 12,000 safety
719
7. Prevention
As was noted by Johnson and Holloway (2003), an accident
investigation process has not come to an end until its recommendations have been implemented for the future safety of the system
to be protected. Similarly, Sweedler (1995) emphasizes that accident investigation is just one step along the way. The investigation
does not in itself improve safety or prevent accidents. The real
change takes place when these recommendations are
implemented.
We have only found a few studies of the effects of accident
investigations on actual preventive measures. As was mentioned
in Section 6, the implementation of proposals by the NTSB has been
evaluated. It was found that as many as 82% of the recommendations have been adopted by those for whose action they are intended (Sweedler, 1995). The evaluation of the Swedish accident
investigation board for workplace accidents (Lindberg and Hansson, 2006) followed through the proposals of the investigation
board and asked those to whom the proposals had been addressed
whether the proposals had been implemented. The result was
mixed. In several cases, the proposals had been used and had
reportedly given rise to preventive measures. However, in some
cases, the respondents reported that they had not been given the
opportunity to act on the investigation report, either because it
had not reached them at all or because it was nished only after
they had already decided on what measures to take.
The purpose of MARS is to help companies prevent the repetition of accidents from the past. However, Balasubramanian and
Louvar (2002) report that as yet, the efforts made to ensure that
the recommendations of MARS lead to actual prevention have been
insufcient.
There are too few follow-up studies of the actual effects of acci7
National
Downloaded
8
National
Downloaded
720
9. Conclusions
The overall conclusion from this investigation is that the discipline of experience feedback has not been sufciently self-reective. Experience feedback is based on the idea that we can
improve by systematically and critically evaluating our previous
performance. This idea is fully applicable to experience feedback itself, but such applications are rare. Although there is a considerable literature on experience feedback processes, there is a lack
of evaluation studies that could provide hard (evidence-based)
information about the effects of various methodologies and organizational structures for accident investigation on the future prevalence of accidents. Intervention studies in which objects of
investigation (accidents or incidents) are randomized between different procedures or methods of investigation would provide the
best chances to determine the relative value of alternative methodologies (Hansson, 2007). Other studies increase our knowledge
about the workings and the efciency of experience feedback are
also needed. In this overview we have identied nine important
topics for future studies of experience feedback:
Differences between reporting systems in different social sectors
and different countries.
The quality of initial reports and the promptness with which
they are delivered
How reports on incidents can be elicited in different types of
organizations.
How accident databases are actually used.
How accidents or incidents are selected for investigation.
The efciency of different accident investigation methods, and
how the choice of methodology should depend on factors such
as the type of accident and the type of organisation in which it
occurred.
How and to what extent conclusions from accident investigations are disseminated.
The actual effects of accident investigation reports on preventive
measures.
The integration of experience feedback systems into overall systems of risk management.
We give the highest priority to the last four of these issues, since
they are key issues for the development of evidence-based accident
investigation practices.
Acknowledgement
This research was supported by the Swedish Rescue Services
Agency (Grant PNR 04-30).
References
Amoore, J., Ingram, P., 2002. Quality improvement report: learning from adverse
incidents involving medical devices. British Medical Journal 325 (7358), 272
275.
Anderson, J.G., Ramanujam, R., Hensel, D., Anderson, M.M., Sirio, C.A., 2006. The
need for organizational change in patient safety initiatives. International
Journal of Medical Informatics 75 (12), 809817.
Ashcroft, D.M., Cooke, J., 2006. Retrospective analysis of medication incidents
reported using an on-line reporting system. Pharmacy World & Science 28 (6),
359365.
Balasubramanian, S.G., Louvar, J.F., 2002. Study of major accidents and lessons
learned. Process Safety Progress 21 (3), 237244.
Barach, P., Small, S., 2000. Reporting and preventing medical mishaps: lessons from
non-medical near miss reporting systems. British Medical Journal 320 (7237),
759763.
Baxter, T., 1995. Independent investigation of transportation accidents. Safety
Science 19 (23), 271278.
Benner, L., 1975. Accident investigations. Multilinear events sequencing methods.
Journal of Safety Research 7 (2), 6773.
Bentley, T.A., Page, S.J., Laird, I.S., 2001. Accidents in the New Zealand adventure
tourism industry. Safety Science 38 (1), 3148.
Carol, S., Vilchez, J.A., Casal, J., 2002. Study of the severity of industrial accidents
with hazardous substances by historical analysis. Journal of Loss Prevention in
the Process Industries 15 (6), 517524.
Choularton, R., 2001. Complex learning: organizational learning from disasters.
Safety Science 39 (12), 6170.
Cox, S., Jones, B., Collinson, D., 2006. Trust relations in high-reliability organizations.
Risk Analysis 26 (5), 11231138.
de Almeida, I.M., Binder, M.C.P., Fischer, F.M., 2000. Blaming the victim: aspects of
the Brazilian case. International Journal of Health Services 30 (1), 7185.
Dien, Y., Llory, M., Montmayeul, R., 2004. Organisational accidents investigation
methodology and lessons learned. Journal of Hazardous Materials 111 (13),
147153.
Drogaris, G., 1993. Learning from major accidents involving dangerous substances.
Safety Science 16 (2), 89113.
Duffey, R.B., Saull, J.W., 2003. Know the Risk: Learning from Errors and Accidents:
Safety and Risk in Todays Technology. Butterworth-Heinemann, Boston.
Fernald, D., Pace, W.D., Harris, D.M., West, D.R., Main, D.S., Westfall, J.M., 2004.
Event reporting to a primary care patient safety reporting system: a report from
the ASIPS collaborative. Annals of Family Medicine 2 (4), 327332.
Fleming, M., 1999. Safety Culture Maturity Model. UK HSE Offshore Technology,
Report OTO 2000/049, HSE Books, Norwich.
Galea, E.R., Finney, K.M., Dixon, A.J.P., Siddiqui, A., Cooney, D.P., 2006. Aircraft
accident statistics and knowledge database: analyzing passenger behavior in
aviation accidents. Journal of Aircraft 43 (5), 12721281.
Gibson, J., 1961. The contribution of experimental psychology to the formulation of
the problem of safety. In: Herbert, H.J. (Ed.), Behavioral Approaches to Accident
Research. Association for the Aid of Crippled Children, New York.
Groeneweg, J., 1998. Controlling the Controllable: The Management of Safety.
DSWO Press, Leiden.
Haddon, W., 1968. The changing approach to epidemiology, prevention and
amelioration of trauma. American Journal of Public Health 58 (8), 14311438.
Hale, A., Ale, B.J.M., Goossens, L.H.J., Heijer, T., Bellamy, L.J., Mud, M.L., Roelen, A.,
Baksteen, H., Post, J., Papazoglou, I.A., Bloemhoff, A., Oh, J.I.H., 2007a. Modeling
accidents for prioritizing prevention. Safety Science 92 (12), 17011715.
Hale, A., Kirwan, B., Kjelln, U., 2007b. Safe by design: where are we now? Safety
Science 45 (12), 305327.
Hansson, S.O., 2007. Praxis relevance in science. Foundations of Science 12 (2), 139
154.
Heinrich, H.W., 1959. Industrial Accident Prevention A Scientic Approach, fourth
ed. McGraw-Hill, New York.
Hollnagel, E., 2004. Barriers and Accident Prevention. Ashgate Publishing Limited,
England.
721