Introduction To The Fault Management Assistant FMA

Security Level:
1/27/17
Introduction to the Fault Man

agement Assistant (FMA)
www.huawei.com
HUAWEI TECHNOLOGIES CO., LTD.
Huawei Confidential
Content
Background
Key Function
Scenario
Detailed Function
Accident Recovery SOP
Download
Huawei Confidential
Page 2
Background
1. Times of accident
(include non-quality)
for 2010 reaches about
238, and pressure of
production line is very
higher
2. Restored time of
accident is too longer,
and average value is
136 minutes by
statistic in last year.
Now, in Canada, the
accident recovery SOP
has been deployed(use
FMA tool), and time
decreases as 40
minutes.
3. Quickly restored
accident becomes a
key task for production
Longer Restored
Time of Accident
1. Lacked method of
location, and inefficient
for maintenance
2. Various type of log.
The size of log is larger
for download by hand
and time is longer
3. Generous information.
It is inefficient to
gather information of
accident
Inefficient
Location
Various Tools
OMSTAR InsightSharp NIC UMAT PRESTA

R
Huawei Confidential
Page 3
Function
Accident Log
Collection
Accident Log Collect
Fault
Diagnosis
CHR&PCHR
Quickly
Effectual relationship
Quickly Location
Experience integration
Uniform maintenance
plane
Convenience
Real-time
UKPI
Monitor
MML
Comparison
and Feature
Scan
Huawei Confidential
DashBoard
FMA
Performance
Browsing
&Compariso
n
Alarm and
Operation
log Analysis
Page 4
Scenario
Fault
Assistant
Analysis
Function
MML
MMLComparison
Comparison
Feature
FeatureScan
Scan
MBSC UO
PC
1. Accident Log
Collection
FMA
Tool
CHR&PCHR
CHR&PCHRAnalysis
Analysis
Fault
FaultDiagnosis
Diagnosis
Diagnosis Report
DashBoard
DashBoard
1 MML Scripts
2 Alarm Log
3 Performance
4 Operation
5 CHR&PCHR
Performance
PerformanceAnalysis
Analysis
1.Phenomena
3.Workaround
4.Information
Alarm
AlarmAnalysis
Analysis
Operation
OperationAnalysis
Analysis
2. Performance
Comparison Online
3. Real-time UKPI
Monitor
Online
Function
2.Result
Focus Issue
Engineer of
Fault Analysis
The UO Mode of MBSC is supported by

Current FMA Version
Huawei Confidential
Page 5
Scenario
FMA
Scenari
o
Accident happens in
commercial network
1.
2.
3.
4.
5.
6.
1.
2.
3.
Degraded KPI of network

Safeguard for holiday or cell
Which feature is opened?
What is network?
Fault Analysis and Location
Accident log collection

Fault diagnosis and workaround
Dashboard, associate performance,
alarm and operation log
Performance browsing and
comparison online, recognize fault
point quickly
Alarm and operation log analysis
CHR&PCHR analysis
CHR&PCHR analysis
Performance browsing, and TOPN Cell
MML Comparison
Real-Time UKPI monitor

Feature & License Scan in MML scripts
MML parsing and exported key information
MML parsing, alarm, performance,
operation log, CHR log Analysis, MML
comparison
Huawei Confidential
Page 6
Detailed Function Introduction (1)

Functi
on
Detailed
Information
Remark
Level
Acciden
t Log
Collecti
on
1. Accident log collection, and

divide for two batches. The size of
the first batch is less than 5M, and
30M for second batch,
2. Provide to collect transmission
log
3. Provide to collect SOP log
1.
2.
The function has been

deployed with accident
recovery SOP for global
operators (about 53 operators
has been used)
During the accident, it takes
about 10 minutes to feedback
the accident log
1. Collect expediently, and do not

worry about missing log
2. The size of collection log is
small, and easy to deliver to HQ
by Email
Collection
data
Huawei Confidential
Page 7

Functi
on
Detailed Information
Remark
Level
Fault
Diagnos
is
1. Associate the alarm, performance and operation log

by MML script
2. Provide the key KPI and alarm statistic of different
SPU and INT board
3. Provide the visual plane of MML script, and
relationship information of cell, link and neighboring
cell
4. Based on the various original rules, and draws a
workaround
1.
1.
2.
3.
2.
Get
conclusion
quickly
Classificatio
n
Impaction
clearly
Cover about 40~50%

Scenario of accident
The function has
been deployed with
accident recovery
SOP for global
operators (about 53
operators has been
used)
The FMA has been deployed in

accident SOP of Canada
Run the FMA to check whether result is right

or not when accident occurs
Huawei Confidential
Page 8

MML Script Parsing and Visual Display
Zoom Figure of
Subrack
Extract MML Scripts
It is not painful to extract MML scripts

of Node and information link now!
Visual display for
Plane
Huawei Confidential
Page 9

Functio
n
DashBoa
rd
1. Relationship display for performance,

alarm and operation
2. The counter can be queried and drawn as
curve and recognize the impaction of KPI
3. Frequency of alarm statistic and chart
1.
Remark
Level
It can be used for
analysis of accident,
and recognize the
impaction of alarm
and operation log for
Thisaccident.
function is edge tool
to
analyze the accident log. It is
convenience to browse the
performance (KPI) , alarm and
operator log, and relationship
with them.
2. If the SR of RRC or RAB is
deteriorated, this function can
check the alarms and operator
log during the worsen period or
KPI.
Huawei Confidential
Page 10

Functio Detailed Information
n
Alarm
Analysi
s
Remark
Level
1. Alarm log parses and display quickly

It has been used
2. Filter, classification and highlight

widely in
3. Relationship between alarm and MML scrip, and
maintenance, test
provide the SPU subsystem, port and Node
and other
information for each fault alarm
department
4. Statistic for alarm, provide the proportion of fault
alarm for SPU subsystem or port, and frequency of
alarm to analyze the accident log
1. Relationship between
2.
alarm and MML scrip is

a light spot
Recognize the issue
quickly, and check
whether the issue in
happened on SPU or
interface board
Frequency of
Alarm
Huawei Confidential
Page 11

Functi
on
Detailed
Information
Remark
Level
Operati
on Log
Analysi
s
1. Normal and BAK operation log

browsing
2. Filter
3. Priority of command
(Critical/Normal)
4. Backup operator log to browse
It has been used widely

in maintenance
department
The traditional accident is caused by the

wrong MML command easily, and w
hether this issue is caused by comma
nd or not?
Use the function and browse or filter the
commands quickly.
The backup operation log for several months ago can be

analyzed by FMA
Huawei Confidential
Page 12

Functi
on
Remark
Level
Real-Time
UKPI
Monitor
1. Connect with OMU online, and get UKPI

file and User number information
2. Chart to display the UKPI and user
number information, convenience to monitor
3. Cluster Cell to monitor hotspot cell
It has been used widely

in safeguard for the
South Africa World
Cup, Asia Sport Game
in Guangzhou, Hajj of
Saudi Arabia
The FMA can help you to

monitor performance of
system during the holiday
Huawei Confidential
Page 13

Function Detailed Information
Remark
Level
MML
Comparis
on
It has been used

widely in
maintenance,
performance and other
department
1. Comparison for two scripts of different

RNC or different version of RNC
2. Color to denote the results
3. Filter and extract
The result of comparison with two types

Huawei Confidential
1. Comparison for two

scripts of
different/same RNC or
different version of
RNC(V2 and V9), and
display the difference
2. The function can be
used for degraded KPI
caused by wrong
parameter
Page 14

Remark
Level
NodeB
XML2MM
L
It has been used

widely in
maintenance,
performance and other
department
Convert the NodeB XML configuration

file to MML commands. The user needs to
browse the XML file to confirm the
configuration by CME tool.
XML configuration
MML Commands
Huawei Confidential
Page 15

Functio Detailed
n
Information
Remark
Level
Perform
ance
Analysi
s
1. It has been used

widely in
maintenance, test and
other department
2. The efficiency of
analysis for about one
week is more higher
than other tool, such
as OMSTAR,
NASTAR
1. Support browsing quickly for about

maximal 200 files, and take about 3
minutes
2. Normal KPI browsing, query, and
chart to display
3. TOPN cell analysis, including access,
drop call
4. Provide KPI analysis for cluster cell,
and counter query
5. Health check, and provide about 300
rules
6. Defined counter, support expression
and logical operation
7. Voice model
Huawei Confidential
Page 16

Performance Analysis(to be)
1. FMA can analyze for about 200 performance file(1~2M zip) on normal PC
with 2G memory, and it takes about 1.2s to parse one file averagely.
2. Much experience has been integrated into FMA, and user can analyze
TOPN cell, heath check and voice model expediently.
Huawei Confidential
Page 17

Performance Analysis(to be)
1. TOPN Analysis
Huawei Confidential
Page 18

Function
Remark
Level
Performanc
e
Comparison
1. Different period of performance to compare

for same RNC and same or different version of
RNC
2. Draw the chart quickly for normal KPI
3. Collection performance files online
The function has

been deployed in
Canada
Huawei Confidential
Page 19

Remark
Level
CHR&PC
HR
Analysis
It has been used

widely in
maintenance
department
1. CHR&PCHR browsing quickly

2. Classification of fault for CHR and PCHR
3. Filter, filter by column value or filter by
condition
4. Statistic for point code
5. Statistic for parameter
1. About 0~1s to parse one

CHR log file
2. About 2~3s to parse one
PCHR log file
3. About 0~1s to filter one
CHR/PCHR log file
Analyze and browse

CHR&PCHR log expediently
and quickly, and easy to
locate KPI issue
Huawei Confidential
Page 20
CHR&PCHR Analysis (to be)
The Fault Classification based on the CHR or PCHR log,

and analyze the KPI issue quickly by the function
Huawei Confidential
Page 21

The chart is shown as the trend of statistic for RRC attempts

times. The FMA can provide the other statistic, such as RAB
attempts /Succ times, or given condition
Huawei Confidential
Page 22

The chart is shown as the trend of CPU with second period

Huawei Confidential
Page 23

The statistic of given parameter

Huawei Confidential
Page 24

n
Remark
Level
Feature
&
License
Scan
It has been firstly

used in test
department
1. Feature scans for MML scripts and License

feature scans for License file
2. Feature compares for MML scripts or
between MML script and License file
3. Rule of feature is defined by user in excel file
Result of License
Scan
It is quick to known which feature is open for some operator?

Huawei Confidential
Page 25
MML&License Feature Scan

1.
2.
3.
MML Feature Scan

License File Scan
Feature Comparison
between MML and
License File
Result of License
Dialog of feature scan
Feature
definition
Scan
Result in
Excel
It is quick to known which feature is

open for some operator?
Huawei Confidential
Page 26

Feature 1. Feature scans for MML scripts and License
n
feature scans for License file
&
Node
B
License
main
Scan
board
log
parse
2.
foralarm
MMLlog,
scripts
or cell
1. Feature
Includedcompares
of run log,
call log,
between
MMLlog
script
License
file
log, operation
.etcand
parse
function.
3.
Ruleconfigure
of featurefile
is defined
by user in excel file
2. The
figure shown.
3. DRD configure compared between RNC
script and Node B script.
4. Transmission configure compared between
RNC script and Node B script.
Remark
It has been firstly

used in test
department
It has been used in
department.
Provide fast parse
function and
RNC/Node B script
compare function.
Level
It is quick and convenient to known the site configuration.

Huawei Confidential
Page 27
It is quick and convenient to known where is the

problem of DRD configuration.
It is quick and convenient to known where is the problem

of transmission configuration.
Huawei Confidential
Page 28
Accident Recovery SOP

The accident recovery SOP is guide to
prevent or recover the accident quickly for
the front, and provides technology and
support.
1)Precaution and preparative operation for
accident
2) The network and guide for accident
collection tool
Application :
The FMA tools has been deployed for about 53

operators. The following table is sample for
Canada, and the recovery time of accident are
listed.
Op
Time
Phenomena
Recover
time(mi
n)
Canada
Sasktel
2011-8-4
It is different to connect
for user
15
Canada
Dry Run
2011-7-6
CS RAB SR is decreased
as 80%
30
Canada
Dry Run
2011-6-3
PS RAB SR is worse
quickly
50
1) The time of collection of accident is saved

by using the tool
Canada
Telus
2011-4-27
RRC SR is decreased as
90%
37
2) The efficiency of analysis for accident is

improved. FMA can display the key
information of accident and provide the
result of diagnose quickly.
Canada
SASKTEL
2011-4-6
RRC SR is decrease as
50%
90
Canada
Bell
2011-2-17
10
3) The front can recover the accident based

on the emergency solution
The traffic with 72 NodeB

are interrupted under one
RNC 3811
Canada
Bell
2011-1-28
The PS traffic for 6 RNC

are impacted
24
4)The average recovery time of accident of

UMTS is decreased as 50% with last year
Canada
Bell
2011-1-27
The traffic with 789

NodeB are interrupted
62
The SPU Boards in

Page
Subrack
1,2,329
are reset
50
3) The FMA guide book

4) The emergency solution for accident, and
recover the accident by the guide
Benefit
Canada
2011-1-6
Huawei
Confidential
Telus
Download
The download time of FMA tool in Support network, and the comparison
with the other tools
Up to 2011-8-30 the download time of FMA has reached more than

1000 times. The tool has been widely to use by Maintenance, R&D,
Test, NTS, GTAC and the front engineer.
Huawei Confidential
Page 30
Download
1. UMTS Accident Log Collection Tool

2. UMTS FMA analysis tool
Huawei Confidential
Page 31
Thank you
www.huawei.com

Introduction To The Fault Management Assistant FMA

Încărcat de

Informații document

Titlu original

Drepturi de autor

Formate disponibile

Partajați acest document

Partajați sau inserați document

Opțiuni de partajare

Vi se pare util acest document?

Este necorespunzător acest conținut?

Drepturi de autor:

Formate disponibile

Introduction To The Fault Management Assistant FMA

Încărcat de

Drepturi de autor:

Formate disponibile

Security Level:

Introduction to the Fault Man

HUAWEI TECHNOLOGIES CO., LTD.

HUAWEI TECHNOLOGIES CO., LTD.

OMSTAR InsightSharp NIC UMAT PRESTA

HUAWEI TECHNOLOGIES CO., LTD.

Accident Log Collect

HUAWEI TECHNOLOGIES CO., LTD.

HUAWEI TECHNOLOGIES CO., LTD.

The UO Mode of MBSC is supported by

Degraded KPI of network

HUAWEI TECHNOLOGIES CO., LTD.

Accident log collection

Real-Time UKPI monitor

Detailed Function Introduction (1)

1. Accident log collection, and

The function has been

1. Collect expediently, and do not

HUAWEI TECHNOLOGIES CO., LTD.

Detailed Function Introduction (2)

1. Associate the alarm, performance and operation log

Cover about 40~50%

The FMA has been deployed in

Run the FMA to check whether result is right

Detailed Function Introduction (2)

Extract MML Scripts

It is not painful to extract MML scripts

HUAWEI TECHNOLOGIES CO., LTD.

Detailed Function Introduction (3)

1. Relationship display for performance,

It can be used for

HUAWEI TECHNOLOGIES CO., LTD.

Detailed Function Introduction (4)

1. Alarm log parses and display quickly

2. Filter, classification and highlight

alarm and MML scrip is

Detailed Function Introduction (5)

1. Normal and BAK operation log

It has been used widely

The traditional accident is caused by the

The backup operation log for several months ago can be

Detailed Function Introduction (6)

1. Connect with OMU online, and get UKPI

It has been used widely

The FMA can help you to

Detailed Function Introduction (7)

It has been used

1. Comparison for two scripts of different

The result of comparison with two types

1. Comparison for two

Detailed Function Introduction (8)

It has been used

Convert the NodeB XML configuration

HUAWEI TECHNOLOGIES CO., LTD.

Detailed Function Introduction (9)

1. It has been used

1. Support browsing quickly for about

HUAWEI TECHNOLOGIES CO., LTD.

Detailed Function Introduction (9)

Detailed Function Introduction (9)

Detailed Function Introduction (10)

1. Different period of performance to compare

The function has