Measurement and Analysis Process

Measurement and Analysis Process Version 0.1

GPIT Ltd. Bangladesh

GPIT/DEV/MA/P/01

Internal

Page 1 of 14

Measurement and Analysis Process

Table of Contents
A. B.

Document Information................................ ................................ ................................ . 4 Document History ................................ ................................ ................................ ........ 5 Measurement and Analysis ................................ ................................ .......................... 6 Planning for Metrication ................................ ................................ .............................. 7 Activity Definition ................................ ................................ ................................ ..... 7 Objective ................................ ................................ ................................ .................. 7 Input ................................ ................................ ................................ ........................ 7 Output ................................ ................................ ................................ ..................... 7 Entry Criteria ................................ ................................ ................................ ............ 7 Exit Criteria................................ ................................ ................................ ............... 7 Procedures ................................ ................................ ................................ ............... 7 Approvals ................................ ................................ ................................ ................. 8 Quality Records ................................ ................................ ................................ ........ 8 Metrics Identification & Definition ................................ ................................ ............... 9 Activity Definition ................................ ................................ ................................ ..... 9 Objective ................................ ................................ ................................ .................. 9 Input ................................ ................................ ................................ ........................ 9 Output ................................ ................................ ................................ ..................... 9 Entry Criteria ................................ ................................ ................................ ............ 9 Exit Criteria................................ ................................ ................................ ............... 9 Procedures ................................ ................................ ................................ ............... 9 Approvals ................................ ................................ ................................ ............... 10 Quality Records ................................ ................................ ................................ ...... 10 Data Collection & Monitoring of Measurements ................................ ........................ 11 Activity Definition ................................ ................................ ................................ ... 11 Objective ................................ ................................ ................................ ................ 11 Input ................................ ................................ ................................ ...................... 11 Output ................................ ................................ ................................ ................... 11 Entry Criteria ................................ ................................ ................................ .......... 11 Exit Criteria................................ ................................ ................................ ............. 11 Procedures ................................ ................................ ................................ ............. 11 GPIT/DEV/MA/P/01 Internal Page 2 of 14

1.0 2.0 2.1 2.2 2.3 2.4 2.5 2.6 2.7 2.8 2.9 3.0 3.1 3.2 3.3 3.4 3.5 3.6 3.7 3.8 3.9 4.0 4.1 4.2 4.3 4.4 4.5 4.6 4.7

Measurement and Analysis Process

4.8 4.9 5.0 5.1 5.2 5.3 5.4 5.5 5.6 5.7 5.8 5.9

Approvals ................................ ................................ ................................ ............... 12 Quality Records ................................ ................................ ................................ ...... 12 Computation & Analysis of Metrics ................................ ................................ ............ 13 Activity Definition ................................ ................................ ................................ ... 13 Objective ................................ ................................ ................................ ................ 13 Input ................................ ................................ ................................ ...................... 13 Output ................................ ................................ ................................ ................... 13 Entry Criteria ................................ ................................ ................................ .......... 13 Exit Criteria................................ ................................ ................................ ............. 13 Procedures ................................ ................................ ................................ ............. 13 Approvals ................................ ................................ ................................ ............... 14 Quality Records ................................ ................................ ................................ ...... 14

GPIT/DEV/MA/P/01

Internal

Page 3 of 14

Measurement and Analysis Process

A.

Document Information
Measurement and Analysis Process Nujhat Nahar The purpose of the document is to defineprocess for Measurement and Analysis DSI,GPIT 1

Document Name Document Author Document Objective Document Owner Document No Document Location Document Version Release Date Recommendation

Review by Review Date Review Time Approved By Approval Date Rejected By Rejection Date Rejection Reason Next Revision Date N/A N/A N/A

GPIT/DEV/MA/P/01

Internal

Page 4 of 14

Measurement and Analysis Process

B.

Document History
Date Section No A/M/D Description of Change Author

A=Added, M=Modified, D=Delete

Version No

GPIT/DEV/MA/P/01

Internal

Page 5 of 14

Measurement and Analysis Process

1.0

Measurement and Analysis

GPIT/DEV/MA/P/01

Internal

Page 6 of 14

Measurement and Analysis Process

2.0
2.1

Planning for Metrication

Activity Definition This sub process comprises of activities of preparation and maintenance of the Metrication Plan for GPIT Objective The objective is to: y Plan all activities related to quantitative process management in the organization; y Document and baseline such a plan; y Tracking performance against the plan; y Maintaining the plan in accordance with the directives of the QMG (Quality Management Group) of the organization. Input y The business objectives of GPIT ; y The Quality Policy of GPIT ; y The PDIP; y Customer defined measures or metrics, if any (e.g. service levels); y Needs arising out of managing various projects / processes in GPIT; y Ideas put forward by QMG or Metrics Council or other members of GPIT. Output y Base lined Metrication Plan. Entry Criteria y The business objectives of GPIT are defined; y The Quality Policy of GPIT is defined; y The PDIP(Project Development and Improvement Plan ) is released; y The Metrics Council (MC) is formed; y QMG decides to prepare or update the Metrication Plan. Exit Criteria y The Metrication Plan is base lined. Procedures 1 Initially, the business objectives and the Quality Policy of GPIT are defined by the top management. These are documented in the Quality Manual. 2 The QMG studies and analyses the business objectives and the Quality Policy, and prepares and releases the PDIP, in accordance with the provisions of the Quality Management Process. The Metrics Council (MC) is also formed. 3 Members of MC discuss the PDIP, and other inputs, as available, and prepare the Metrication Plan for the organization in consultation with the QMG members. 4 The Metrication Plan thus prepared is reviewed by the members of the QMG and corrections / modifications, if any, are done by the MC members. Once the QMG approves the plan, the same is base lined and released by the Metrics Council. The Metrication Plan is kept under configuration management. 5 The Metrics Council also draws up awareness for facilitating the implementation of the Metrication Plan in the organization. The awareness aims to spread the concept of the metrics and their importance to the organization s process improvement initiatives.

2.2

2.3

2.4 2.5

2.6 2.7

GPIT/DEV/MA/P/01

Internal

Page 7 of 14

Measurement and Analysis Process

2.8 2.9

6 Modification to the existing Metrication Plan may be done through resolution in the Metrics Council, which is subsequently approved by the QMG. Such needs are typically triggered through discussions in the meetings of the Metrics Council / QMG / Management Review Meeting. Any changes to the Metrication Plan are done in accordance with the change control procedure as defined in the Configuration Management Process, i.e. through approval of change requests, by the Quality Coordinator. The amended Metrication Plan is reviewed and approved by the QMG, and is released by the Metrics Council. The revised plan is base lined, released, and brought under Configuration Management. Approvals y QMG approves the Metrication Plan. Quality Records y Review records of the Base lined Metrication Plan; y Approved Change requests, if any; y Configuration control records (entries in the CI-Configaration Iteam Register).

GPIT/DEV/MA/P/01

Internal

Page 8 of 14

Measurement and Analysis Process

3.0
3.1

Metrics Identification & Definition

Activity Definition This activity comprises of identifying the various metrics that would be used in GPIT. This also includes activities like introduction of any new metric in the organization, abolishing any existing metric, and effecting any adjustment to the definition of existing metrics. Objective The objective is to: 1. Identify which metrics would be used; 2. Clearly defining the metrics for projects and processes; 3. Managing change in the definition / introduction of metrics. Input y The business objectives of GPIT; y The Quality Policy of GPIT; y Customer defined measures or metrics, if any (e.g. service levels); y Needs arising out of managing various projects / processes in GPIT; y Ideas put forward by QMG or Metrics Council or the top management or other members of GPIT. Output y List of metrics and their definitions documented in the Guidelines for Measurement & Analysis. Any addition of metrics or changes / modifications made to the existing set of metrics may be effected through publication of new releases / versions of the said Guidelines and the information may be circulated through mail to relevant GPIT members. Entry Criteria y The Metrication Program is launched in GPIT; y A need for a new metric or the need for a change in an existing metric is expressed in the Metrics Council meeting or QMG meeting or the Management Review meeting or the meeting of the top management; y Some GPIT member puts in a suggestion expressing need for a new metric or the need for a change in an existing metric. Exit Criteria y The QMG approves the metrics that would be used in GPIT, and the Quality Coordinator (Quality Audit Group) releases the Guidelines for Measurement & Analysis. Procedures 1 Initially, the measures and metrics are identified by members of Metrics Council in consultation with the QMG members. The measures, metrics and their definitions are documented and described in the Guideline for Measurement & Analysis Guideline for Measurement & Analysis by the Metrics Council members. The same is reviewed and approved in accordance with the provisions of the Document Control Process, (where it states that the SC-Management Representatives ultimately approves the document) and the Quality Coordinator (Quality Audit Group) releases the document. 2 So, the Guidelines for Measurement & Analysis contain the basic elements of definition of the various measures and metrics to be used in GPIT. These are as follows: y Name of the Measure / Metric; GPIT/DEV/MA/P/01 Internal Page 9 of 14

3.2

3.3

3.4

3.5

3.6

3.7

Measurement and Analysis Process

Description; Unit of Measurement; Measurement Formula; Usage; Source and format of data capture; Periodicity of data capture; Method of analysis; Periodicity of analysis; Responsibilities for: y Collection of data; y Reporting of data; y Analysis of data. 3 Modification to the existing set of metrics may be typically triggered through discussions in the meetings of the Metrics Council / QMG / SC Meeting / MT meeting. A request for a change may also be triggered by a customer request / business requirement or may come as an idea from any member of the organization. In all such cases, the request for change may lead to y Introduction of a new metric; y Change in the definition of an existing metric, or; y Abolishing the use of an existing metric.
y y y y y y y y y

3.8 3.9

4 Such a request / need for change are taken up for discussion by the MC. If the MC agrees with the request for change, it puts it forward to the QMG who reviews the matter and approves the action, if appropriate, with necessary approval of the SC. 5 If the change request is approved by the QMG, the Metrics Council takes necessary action to update the Guideline for Measurement and Analysis in accordance with the provisions of the Document Control Process, (where it states that the SC ultimately approves the document) and the Quality Coordinator release the document. 6 Measures are taken by the Metrics Council to spread the awareness regarding any addition of metrics or changes / modifications made to the existing set of metrics through circulation of the information by mail to relevant GPIT members, and may be, through other appropriate means as well. Approvals y The final approval comes from the sc. Quality Records y Approved requests for change in Metrics definitions; y Related minutes of meetings of Metrics Council and QMG; y Review records of Guidelines for Measurement & Analysis; y Configuration control records (entries in the CI Register).

GPIT/DEV/MA/P/01

Internal

Page 10 of 14

Measurement and Analysis Process

4.0
4.1

Data Collection & Monitoring of Measurements

Activity Definition This activity comprises of planning and collecting data for measurements from projects/processes and monitoring the data collection activity on a regular basis. Objective The objective is to: 1. Ensure that reliable data is collected from the various projects and processes as per the method described through the Guidelines for Measurement & Analysis. Input 2. PDIP; 3. Project Management Plan; 4. Estimation Sheet; 5. Review Records; 6. Test log / Defect Log; 7. Project Schedules as updated; 8. Project Status Report; 9. Customer feedback; 10. Training records; 11. Internal Quality Audit Reports; 12. Others, as mentioned in the Guidelines for Measurement & Analysis. Output Metrics Data Sheets, in accordance with the method descriptions in the Guidelines for Measurement & Analysis. Entry Criteria 1. Projects plan for collection of metrics data, in conformity with the method descriptions in the Guidelines for Measurement & Analysis; 2. Process groups plan for collection of metrics data, in conformity with the method descriptions in the Guidelines for Measurement & Analysis. Exit Criteria Measurement data are obtained from both projects and process group in s accordance with the method descriptions in the Guidelines for Measurement & Analysis. Procedures 1. The Metrics Plan for a project shall be documented in the Project Management Plan. The Project Manager /Representative of Project Matrix Council shall be responsible for collecting measurement data for his / her respective project and for recording those in Metrics Data Sheet, which will be submitted to the Metrics Council. They shall also submit other input as defined in the Guideline for Measurement and Analysis to the Metrics Council. 2. Similarly, persons in charge of process groups such as. P&O, Development teams and, Project managers, Operations and QMG etc. shall be responsible for collecting measurement data for his / her respective process and for recording those in Metrics Data Sheet, which will be submitted to the Metrics Council. They shall also submit other input as defined in the Guideline for Measurement and Analysis to the Metrics Council. GPIT/DEV/MA/P/01 Internal Page 11 of 14

4.2

4.3

4.4

4.5

4.6

4.7

Measurement and Analysis Process

3. Project Managers and persons in charge of process groups such as P&O, Development teams and, Project managers, Operations and QMG etc. shall ensure the integrity of data collected before submitting the same to the Metrics Council. 4.8 Approvals 1. Project Manager / Project Leaders 2. Process leaders 4.9 Quality Records Metrics Data Sheets submitted to MC

GPIT/DEV/MA/P/01

Internal

Page 12 of 14

Measurement and Analysis Process

5.0
5.1

Computation & Analysis of Metrics

Activity Definition These activities comprise of computing Metrics from the collected measures, analyzing those to benchmark product quality and establish process performance capabilities, and keeping in view the results of such analysis, setting the quantitative goals for the future. Objective The objective is to measure product quality and process performance across the organization and accordingly decide on quantitative goals for further process improvement. Input Metrics Data Sheets. Output Process Capability Baselines (PCB) Report, which includes depiction of past performance of the organization in terms of product quality and process effectiveness, capability of processes in the organization, and lays down Organizational Quality Goals. Entry Criteria 1. Relevant Metrics Data Sheets have been obtained from Projects and Process Groups, and 2. The Organization's Metrication Plan warrants that the Metrics Council shall do the computation of metrics and analysis thereof. Exit Criteria The Process Capability Baselines (PCB) Report is released for use by the relevant GPIT members. Procedures 1. The Metrics Council shall be responsible for computing metrics from measurement data and for analyzing those. They shall consolidate data collected for different projects and Process Groups. After appropriate analysis of data collected, baselines shall be established organization- wide for all projects taking into consideration all the past data collected. Baselines shall be established considering projects of similar type sharing similar engineering processes. Once this is done, the Metrics Council shall submit the Process Capability Baselines Report to QMG for initial review and finalization of the draft PCB. 2. The QMG shall review and approve the draft of the PCB. Once approved, the draft shall be submitted to the SC and the top management for their information and perusal. The SC and the top management shall then decide on further process improvement strategies based on the PCB and determine the organization wide quantitative performance targets for projects and process groups, they shall intimate the same to the QMG, MC, and the project managers, project leaders, and process leaders. The project manager/Process owners shall accordingly set performance goals for their respective projects / process groups. 3. The MC shall incorporate the organization- wide quantitative performance targets for projects and process groups, as set by the SC and the top management, in the

5.2

5.3 5.4

5.5

5.6

5.7

GPIT/DEV/MA/P/01

Internal

Page 13 of 14

Measurement and Analysis Process

5.8

5.9

draft PCB, only when the PCB will be complete. The PCB thus completed shall be reviewed by the SC and approved finally, if appropriate. 4. The Metrics Council shall release the Process Capability Baselines (PCB) Report, and also provide feedback to the Project Managers / Project Leaders / Process Leaders on the analysis of measurement data. The PCB will be kept under version control. 5. A Process Database (PDB) with data on process and product measurements shall be maintained, with controlled access. 6. Release of the PCB shall be announced to the relevant audience whenever a new PCB Report is released. 7. Metrics data shall be collected continually and these data shall be used to predict the process performance and to set up the quantitative goals for the future. Approvals 1. The SC shall review and approve the Process Capability Baselines Report. 2. The management sets the organization-wide quality goals / performance targets. Quality Records 1. Review records of the PCB.

GPIT/DEV/MA/P/01

Internal

Page 14 of 14