Documente Academic
Documente Profesional
Documente Cultură
Peer-Reviewed
Risk Assessments
Top 10 Pitfalls & Tips for Improvement
By Bruce K. Lyon and Bruce Hollcroft
O
rganizations face a wide range of risks sessments, preparing for common challenges, and
each day that can affect their ability to expanding overall knowledge and skill in applying
achieve certain business objectives and stay risk assessment techniques.
in business. Risk assessment is an important and
sophisticated process used to assess an organiza- Effective SH&E Management Systems
tion’s risks so that it can mitigate and reduce risks The ultimate goal of an occupational SH&E man-
to an acceptable level. agement system is to continually improve perfor-
Over the past 30 years as risk control consul- mance, and to minimize risk and associated costs of
tants, the authors have performed, facilitated, occupational incidents as indicated by ANSI/ASSE/
participated in and observed thousands of risk as- AIHA Z10-2012, Occupational Health and Safety
sessments for almost all industry types and sizes. Management Systems, and similar management
Based on those experiences, they have concluded system standards and guidelines. For such a system
that many organizations fail to perform effective to reach this goal, risks must be continually identi-
risk assessments. fied, analyzed and evaluated to understand their po-
This article describes the authors’ top 10 reasons tential for occurring and their magnitude of loss, as
organizations fail to perform good risk assessments well as existing controls and needed improvements.
and provides advice on avoiding these failures. This key element is known as risk assessment.
Most of these obser-
IN BRIEF vations can be tied Risk Assessment & Recent Standards
•Risk assessment is a tool used to assess op- directly to key com- Risk assessments are common in Europe, Aus-
erational risks so an organization can effective- ponents found in two tralia, New Zealand, Canada and other parts of the
ly mitigate and manage risks to an acceptable consensus standards: world. In the U.K., risk assessments have been le-
level. Unfortunately, many organizations fail to •ANSI/ASSE gally required since 1999 by the Health and Safe-
perform quality risk assessments. Z590.3-2011, Preven- ty Executive. However, few risk assessments are
•In 2011, two consensus standards establish- tion Through Design, mandated in the U.S., with the exception of OSHA
ing guidance on the risk assessment process Guidelines for Ad- 29 CFR 1910.119, Process Safety Management of
were released: ANSI/ASSE Z590.3, Prevention dressing Occupational Highly Hazardous Chemicals, and EPA 40 CFR Part
Through Design, and ANSI/ASSE Z690.3, Risk Hazards and Risks in 68, Risk Management Plan.
Assessment Techniques. They represent a new Design and Redesign In 2011, two ANSI standards addressing risk as-
emphasis on the role of risk assessment in the Processes; sessment were released. ANSI/ASSE Z590.3, Pre-
safety profession. •ANSI/ASSE vention Through Design, Guidelines for Addressing
•SH&E professionals should become familiar Z690.3-2011, Risk As- Occupational Hazards and Risks in Design and Re-
with these standards, and strengthen their sessment Techniques. design Processes, represents a milestone in the safe-
proficiency and skills in performing risk as- This article reviews ty profession. Fred Manuele, who has deep roots in
sessments. key steps in perform- the safety through design movement, led efforts to
ing successful risk as- develop Z590.3, which began as a technical report
(ASSE TR-Z790.001) in 2009. ANSI/ASSE Z690.3,
Risk Assessment Techniques, one of three risk man-
Bruce K. Lyon, P.E., CSP, ARM, CHMM, is director of risk control with Hays agement standards adopted from ISO, provides
Cos., a commercial insurance brokerage firm. He holds a B.S. in Industrial Safety detailed guidance on selecting and applying risk as-
and an M.S. in Occupational Safety Management/Fire Science from the University sessment techniques as part of the risk management
of Central Missouri. Lyon is a professional member and past president of ASSE’s process. These standards provide a solid foundation
Heart of America Chapter and a recipient of the Region V Safety Professional of
the Year Award. He is advisory board chair to the University of Central Missouri’s for the safety profession to build on in terms of risk
Safety Sciences Program. assessments (Figure 1).
The term risk assessment is often misused. In the
Bruce Hollcroft, CSP, ARM, CHMM, is director of risk control with Hays Cos. authors’ experience, some have referred to hazard
He holds a B.S. in Industrial Safety from the University of Central Missouri. Hol- inspections, hazard surveys and compliance au-
lcroft is a professional member of ASSE and past president of both the Heart of dits as risk assessments. According to ANSI/ASSE
America and Columbia-Willamette chapters. He also has chaired the Oregon
Governor’s Occupational Safety and Health Conference. Z690.1-2011, Vocabulary for Risk Management, risk
assessment has three distinct components:
28 ProfessionalSafety DECEMBER 2012 www.asse.org
Figure 1
Risk Management Process
•risk identification, which involves finding, rec-
ognizing and recording hazards; Establishing
the
context
(5.3)
•risk analysis, which entails understanding con-
sequences, probabilities and existing controls;
•risk evaluation, which encompasses comparing Risk
assessment
(5.4)
levels of risk and considering additional controls.
Since risk assessment is fundamental to the risk
Risk
identification
(5.4.2)
management process, SH&E professionals must be
clear on what a risk assessment entails and how it Communication
and
Monitoring
and
review
consultation
(5.2) (5.6)
is performed. This article describes 10 reasons why Risk
analysis
(5.4.3)
organizations fail to perform good risk assessments,
and reviews key strategies to avoid these problems
Risk
evaluation
(5.4.4)
and improve the risk assessment process.
The authors selected these particular failures
based on their direct and indirect work experience
as safety consultants in the insurance and SH&E Risk
treatment
(5.5)
consulting industries. Although the method used
to select these common failures is not based on
statistical data, the selected failures correlate with
Note. Adapted from ANSI/ASSE Z690.2-2011, p.21, by ANSI/ASSE, 2011,
primary requirements found in ANSI/ASSE Z590
Des Plaines, IL: Author.
and Z690.
Reason 10: Fail to Perform a Formal Assessment In the U.S., many organizations have relied on
In many cases, risk assessments are simply checklist-and-hazard-inspection methods that fo- Risks must be con-
not performed. Consider, for example, the Deepwater cus on regulatory compliance, and prescribed haz- tinually identified,
Horizon explosion. According to estimates, the losses ards and conditions to evaluate workplace safety analyzed and evalu-
from the offshore oil rig disaster caused 11 fatalities, and health. Unfortunately, such methods do not ated to understand
cost $40 billion and released 4.9 million barrels of oil provide a true measure of risk. their potential for
into the Gulf. BP’s internal investigation team con- An organization should have a strategy to deter- occurring and their
cluded that a key cause of the explosion was that no mine where, when and how risks must be assessed magnitude of loss,
risk assessment had been performed on the cement as described in ANSI Z690.3 Section 4.2, Risk As- as well as existing
slurry barrier application. According to the team’s re- sessment and the Risk Management Framework controls and needed
port, “The investigation team has not seen evidence (p. 12). Basic criteria for establishing the need for improvements.
of a documented risk assessment regarding annulus risk assessment may include:
barriers” (BP, 2010, p. 36). The accuracy of cement •projects or tasks that have not had a formal risk
slurry barriers was described as “critical” in the re- assessment;
port, yet no formal risk assessment was performed. •new facilities, processes or equipment;
Unfortunately, BP is not alone. In ASSE’s (2011) •when several risks are present or introduced
webinar, “Prevention Through Design: Guidelines that make it necessary to apply risk priorities in an
for Addressing Occupational Hazards and Risks in organized manner;
Design and Redesign Processes,” presenter Bruce •when a risk could have serious consequences
Main quoted a study conducted by a Fortune 500 and where control measures are unclear;
company which indicated that 65% of serious in- •where there is a planned change to equipment,
cidents had no previous risk assessment. This machinery or a particular process (as outlined in
number may be indicative of other Fortune 500 ANSI Z10, 5.1.2, Design Review and Management
companies, and supports the authors’ experience of Change).
that many smaller companies perform few, if any, Lack of proper risk assessment can lead to cata-
risk assessments. strophic results.
Organizations can cite many reasons to not per-
form risk assessments: Reason 9: Fail to Define the Context
•belief that since no significant incidents have & Objectives of the Assessment
occurred, the organization has adequately assessed Without appropriate guidance, a risk assessment
and managed risks by informal means; may wander aimlessly and far from its intended
•reliance on insurance coverage and outside risk purpose. A quality risk assessment starts with es-
control services to manage risks; tablishing the objectives and context by defining
•misconception that simple hazard identification basic parameters, scope and criteria.
and correction methods are adequate; The purpose and scope of a risk assessment
•hazards-based and compliance-type approach; should be determined by those who will use the
•fear of discovering and documenting certain resulting information to make informed deci-
risks that may be difficult to address or mitigate; sions. The purpose should be concise and avoid
•lack of knowledge and/or resources to perform complex statements; it should be written so that
a risk assessment internally; everyone on the team can continuously refer to it
•no mandate or corporate requirement to per- in order to stay focused and avoid wandering too
form risk assessment.
www.asse.org DECEMBER 2012 ProfessionalSafety 29
Figure 2 The
ALARP
Principle
The ALARP Principle
of these unidentified risks later caused a serious
Immediate action required. Operation fire and explosion. Had the organization defined
Unacceptable Region 4 not permissible, except in rare and
extraordinary circumstances. and communicated acceptable risk levels and risk
assessment criteria, the risk may have been identi-
Remedial action is to be given fied and the incident avoided.
3
ALARP Region high priority. Manuele (2010) suggests that safety professionals
Steps must be taken to reduce risk have not yet fully embraced the concept of accept-
to as low as reasonably practicable. Remedial action to be taken at
2
appropriate time.
able risk. Some organizations promote zero risk as
their primary SH&E goal. However, some residual
1 Remedial action is discretionary. risk will always remain. As described in ANSI/
Negligible Risk Procedures are to be in place to ASSE/AIHA Z10, Appendix F, safety and health
ensure that this risk level is management goals should be specific, measurable,
maintained.
actionable, realistic and time-oriented. A zero risk
Note. Adapted from ANSI Z690.3, by ANSI/ASSE, 2011, Des Plaines, IL:
Adopted from ANSI Z690.3; Manuele goal is not realistic and should be redefined to an
Author. achievable and acceptable level for the organization.
What is an achievable and acceptable level of risk?
far from the intended goal. Following is a sample ANSI Z690.3 explains that the potential for harm
purpose statement once used by the authors (al- must be reduced until the cost of further reduction is
The potential for though words such as “emergencies/disasters” disproportionate to the benefit gained—to the level
harm must be and “impact” many need to be more precisely de- of as low as reasonably practicable (ALARP, Figure
reduced until the fined): “The purpose of this risk assessment is to 2). The criteria used to determine this level should
cost of further re- determine the potential emergencies/disasters that include the organization’s SH&E goals and the use
duction is dispro- could have the most impact on the organization.” of cost-benefit analyses of risks and their treat-
portionate to the Communicating the purpose and scope to the ment; it also will be influenced by its culture and
benefit gained— risk assessment team should include a common industry setting (ANSI/ASSE 2011c, p. 21). Typi-
to the level of as understanding of terminology to be used. For ex- cally, as an organization matures and improves its
low as reasonably ample, when using qualitative risk analysis, a clear risk control measures, the acceptable risk level will
practicable. explanation of the terms used and their meanings move closer to the negligible risk level.
should be communicated and understood by the
assessment team and management (ANSI/ASSE Reason 7: Fail to Assemble the Best Team
2011c, p. 18) to Perform the Risk Assessment
Determining the assessment’s scope can be even Depending on the assessment’s scope, a team of
more complicated than its purpose, but it is as im- objective, knowledgeable, experienced and comple-
portant to the success of the risk assessment. The mentary personnel should be created. Unfortu-
endeavor needs a tightly defined beginning and end nately, some risk assessments are performed from
so the team is not tempted to take it further than a less-than-objective viewpoint or a single perspec-
intended or make it too complicated. tive. For example, a company near the Port of Oak-
For example, the assessment of potential emer- land, CA, initially failed to include security in its risk
gencies/disasters might need some limitations. assessment for emergency planning purposes. After
Should the assessment address only emergencies/ the authors suggested that security be involved, civil
disasters at facility sites or should it include offsite unrest and train derailments were identified as sig-
events? Should it include natural, man-made or nificant risks. Soon after, Occupy Oakland occurred
technological emergencies/disasters, or all of them? and the area was closed, but the company was pre-
Setting the scope too narrow might prevent a haz- pared because it had included security.
ard and the resulting risk from being identified and In some cases, risk assessments are performed
assessed; setting it too broad could prevent the risk just to document them in order to meet some inter-
assessment from achieving its true purpose. Again, nal or external requirement. Such assessments are
input from those who will use the risk assessment to often performed by limited teams and may be led
make decisions is crucial. by a dominant individual who is primarily focused
on completing the task. Experience has shown that
Reason 8: Fail to Understand an this leads to incomplete risk assessments where
Organization’s Acceptable Risk Level some hazards are not identified and risks are not
An organization must define its acceptable risk fully assessed.
levels and incorporate them into the risk assess- Teams of three to 10 competent members seem
ment process. Otherwise, paralysis by analysis will to work well. Such teams usually offer sufficient
lead to wasting time and resources on acceptable perspectives on a risk assessment, yet are not too
risks, and possibly stall or short-circuit the process. large to manage and keep focused. Team members
For example, an organization with new manage- should be selected based on their knowledge, expe-
ment declared that every facility would perform a rience and commitment to the effort, and will vary
thorough risk assessment. With no specific guid- depending on the hazards and risks being assessed.
ance about the type or level of risks to include, For example, a team assessing a product might
many risks, including trivial ones, were collected; include representatives from research and devel-
unfortunately, resources were consumed without opment, design, engineering, production, quality,
identifying some important and serious risks. One legal, sales, service, risk management and safety.
30 ProfessionalSafety DECEMBER 2012 www.asse.org
A transportation risk assessment might include a tion. Certain techniques have specific applications.
driver, routing/scheduling, DOT compliance, ser- For example, hazard analysis and critical control
vice and maintenance, risk management and safe- points is often used in food and beverage pro-
ty. These members can be directed to gather input cessing. ANSI/ASSE Z690.3 describes 31 different
from their departments if the process is not confi- techniques (pp. 22-25; Figure 3), while ANSI/ASSE
dential because external parties often contribute to Z590.3 features eight. Three risk assessment tech-
the risk assessment. niques are highlighted in ANSI Z590.3 as being
Risk assessments are excellent opportunities for more practical for most risk situations: preliminary
employee involvement, which is critical to the suc- hazard analysis, what-if/checklist analysis, failure
cess of any safety effort. Employee involvement is modes and effects analysis (FMEA) (Figure 3).
required by all safety management system stan- The technique selected should be justifiable and
dards (e.g., ANSI/ASSE Z10, OHSAS 18001, OSHA appropriate for the situation; provide useful results;
VPP). It also is required by some state OSHA regu- and be traceable, verifiable and consistent. Selec-
lations and specific regulations such as OSHA’s tion criteria should be based on the assessment’s
process safety management standard. Employee defined context and objectives (Reason 9) and
involvement leads to a better risk assessment. should consider the following:
•complexity of problem;
Reason 6: Fail to Use the •type and range of risks;
Best Risk Assessment Techniques •potential magnitude;
To achieve desired results, an organization must •risk assessment team’s degree of experience;
properly match the technique used to the expo- •available data;
sure. Many techniques are not well understood or •regulatory requirements.
used properly. Experience is important in proper In some cases, more than one technique may be
selection and application. needed. For example, an organization can use brain-
In some cases, it may be necessary to use more storming to develop a list of concerns and qualified
than one method. For example, a large die-casting risks, then prioritize risks using a risk matrix (Figure
operation relied strictly on checklist audits to iden- 4, p. 32); this can be followed by a breakdown of
tify and correct hazards. The checklists were not each concern using a fishbone diagram or cause-
regularly reviewed or updated, and did not include and-effect analysis.
specific risks such as condition and control of alu- However, specific concerns, such as ergonomic
minum for the furnace. As a result, scrap alumi- risk factors, may not be fully identified or measured
num containing moisture was placed in the furnace using standard risk assessment techniques. Specific
and a serious explosion of molten metal critically tools that focus on ergonomic risks, such as the rapid
injured several employees. upper limb assessment, the Snook tables, NIOSH’s
Many different risk assessment techniques exist, lifting formula and similar tools, are available to as-
some complex (quantitative) and specific, and oth- sess ergonomic-related risk factors.
ers more basic (qualitative) and broad in applica- The assessment and its output should be consis-