The Quality Review Technique & Quality in the Project Environment

PRINCE2® has two chapters amongst the many elements it contains that are related to quality.

Presented first here is the Quality Review Technique: it tells us how to administer a walkthrough. That is the roles involved and what they should be doing in each of three (really four) timeframes. Quality Review Technique is provided in case you don't have your own procedure (EG Fagin Inspection). Quality review of specialist products is conducted in Executing a Work Package (MP2) and of Management Products one might argue in the the SU, IP, SB & CP processes in preparation for acceptance of management products in DP. The Red-Book never says so explicitly.

Presented second is the over-arching description of how quality starts with (A.7) Customer’s Quality Expectations which arrive with the participants, become enshrined in (A.1) Acceptance Criteria,  (A.22) Product Description and (A.36) Work Package and are confirmed to have been met in Executing a Work Package (MP2) and  Decommissioning a Project (CP1) . In PRINCE2® terms the whole set of high-level intentions is described in the (A.31) Project Quality Plan. The PQP would be better titled Policy than Plan as it is not the same in form, intent or structure of most of the elements PRINCE2® labels Plan.

Top of Page

TOC

bullet

Quality Review Technique
bullet

Syllabus: Quality Review

bullet

QU06: Quality Path

bullet

Quality Ch18 & Ch24 Figs 18.2 & 18.3

bullet

QR01: Purpose & Benefits of a Quality Review Ch-24

bullet

QR02,9: Three Steps of a Quality Review 24.4.3

bullet

QR02,3,4: Step 1

bullet

QR02,3,4: Step 2

bullet

QR02,3,4: Steps 3

bullet

QR03: Products Used in a Quality Review

bullet

QR05: Roles Involved in Quality Review

bullet

QR05: Roles Used in a Quality Review

bullet

Applying PRINCE2®

bullet

Quality in a Project Environment
bullet

Syllabus: Quality in a Project Environment

bullet

QU01: The Purpose of Quality Management

bullet

Quality Organisation Structure

bullet

QU05: Responsibilities for Quality Management

bullet

The Quality Management Responsibilities

bullet

More Responsibilities

bullet

QU07: Quality Assurance and Project Assurance

bullet

QU01: The Purpose of Project Quality Management

bullet

QU01: The Purpose of Quality Management

bullet

QU02: The Project Quality Plan

bullet

QU02: The Product Description

bullet

QU02: Identify the Products of Quality Management

bullet

Purpose & Content of Quality Log

bullet

QU03: Quality Depends on Specification

bullet

QU03: The Importance of the Customer’s Quality Expectations

bullet

Applying PRINCE2®

bullet

Quality Practitioner Question

bullet

Process Practitioner Question

 Top of Page

Syllabus: Quality Review

bullet

QR01      understand the purpose and benefits of a Quality Review

bullet

QR02      understand the three steps of a Quality Review as described in PRINCE2

bullet

QR03      understand the purpose and content of the products used in a Quality Review

bullet

QR04      understand where in the 8 processes Quality Reviews are planned & conducted, & the roles of the project management team involved in their planning and conduct

bullet

QR05      understand the roles used in a Quality Review, and how these relate to the standard PRINCE2 roles

bullet

QR06      create, modify or discuss the products of Quality Review in a project scenario

bullet

QR07      apply the Quality Review technique to any given project scenario

bullet

QR08      discuss in detail the links between a Quality Review, the processes & project management team roles, & show how this could be applied to a project scenario

bullet

QR09      understand where the planning and resourcing of a Quality Review takes place

Top of Page

QU06: Quality Path

Top of Page

Quality Ch18 & Ch24 Figs 18.2 & 18.3

Top of Page

QR01: Purpose & Benefits of a Quality Review Ch-24

bullet

24.1 “A structured procedure to assess a product’s fitness for purpose”**
bullet

A technique for checking quality of products
bullet

All PRINCE2® techniques are optional (although the USE of a Product Based Approach isn't(?))

bullet

Also known outside PRINCE2® as a “walkthrough”, or “inspection”

bullet

Any form of examining and making comments upon a product for response by the producer

bullet

A means of error detection, not correction

bullet

24.2 “Early identification of defects…
bullet

An objective measurement* for management progress control …

bullet

…all vested interests contribute to improved product quality…

bullet

…helps build the team approach to development

bullet

… user(s), who are represented … are more willing to commit to that product.”

bullet

Results in a signed-off (approved) product safely frozen in the CM system

bullet

* Actually a bunch of people agreeing is not “objective” but a product completing QR is the basis to recognise value earned or progress made

bullet

** Actually the review is probably only able to confirm the product conforms to its specification, which is quiet a different state and the cause of many project problems

Top of Page

QR02,9: Three Steps of a Quality Review 24.4.3

bullet

Review consists of three steps
bullet

Preparation, Review meeting and Follow-up

bullet

Before the 3 steps (the 0th step) is Quality Planning p326
bullet

Conducted during stage and/or team planning (SB1, SB6 or MP1 via PL2, 3 & 5)

bullet

Identify and describe the products in PBS, and Product Descriptions (PL2)

bullet

Define the testing and review activities (identified in PL3 and carried out in MP2)

bullet

Assign team members to review roles (PL5)
bullet

4 Primary roles: Chair-person, Producer, Reviewer & Scribe

bullet

Schedule reviews for specific dates (PL5)

bullet

Add empty records to the quality log to hold the results of intended checks (SB1/6)

Top of Page

QR02,3,4: Step 1

bullet

Preparation (carried out in MP2)
bullet

Chair: Confirm the product and reviewers are ready as scheduled in stage plan

bullet

Producer: Make the Product Description & product available for inspection*
bullet

Prepare responses to Question lists and advise chair for setting of agenda

bullet

Reviewers: Assess product and send comments/ questions lists to the chair
bullet

Annotate (mark) minor document errors on the product itself

bullet

Add all other comments to a Question List and submit to the Chair

bullet

Chair: Plan the meeting & establish agenda covering all questions

bullet

*The (B.9) Configuration Librarian probably does the actual distribution

bullet

Note the lucky scribe normally gets delegated to do everyone else’s leg work in every stage

Top of Page

QR02,3,4: Step 2

bullet

Review meeting (MP2)
bullet

Chair: Move meeting through the agenda to raise questions & comments
bullet

Postpone the meeting if insufficient people attend or are not adequately prepared

bullet

Reviewers & producer: Discuss, clarify and agree Follow-up Actions to product
bullet

Note the review should specifically avoid designing solutions

bullet

Scribe: Note agreements and any Follow-up Actions

bullet

All: Agree review outcome and next action (eg Sign-off, minor fixes & sign-off, Complete Re-work & Re-review)

bullet

Chair: Update Quality Log to show the actual results & inform PM
bullet

Raise Project Issues for faults found in any product not under review or any tolerance threats identified

bullet

Note the lucky scribe normally gets delegated to do everyone else’s leg work in every stage

Top of Page

QR02,3,4: Steps 3

bullet

Follow-up
bullet

Producer: Carry out remedial work (MP2) and secure sign-off from reviewers

bullet

Reviewers: Advise chair of agreement to fixes or of on-going concerns

bullet

Chair: Record results to Quality Log for agreed changes and to Project Issues for on-going concerns
bullet

Raise a Project Issues for any concern in a product other than that under review

bullet

Remedial actions within work package tolerance conducted in MP2
bullet

Amendments within stage tolerance require MP2->CS2->S5->CS7 to assign corrective actions

bullet

Out with stage tolerance requires CS8 to raise Project Issue to the Board (DP4) for guidance
bullet

May trigger premature closure (CP) or exception handling (CS8->SB6,2,3,4,5->DP3 then CS1 or CP)

Top of Page

QR03: Products Used in a Quality Review

bullet

Suitably qualified individuals compare a product to it’s A22 Product Description
bullet

Product description states
bullet

Quality criteria:    Acceptance Criteria specific to this product

bullet

Quality Method: How the ACs will be proved to be present

bullet

Quality tolerance: Any ranges to measures of ACs and improvements required over time (somebody knows the work of Tom Gilb!)

bullet

Quality checking skills or people: Either the qualifications or actual person needed to confirm the ACs

bullet

As identified in the Stage/ Team Quality Plan (a subsection of the Stage Plan)
bullet

States “Who does what checks”, “on what dates”, “using what resources”

bullet

Quality Review Meeting is run to an agenda and Question List
bullet

Agenda structures meeting

bullet

Question lists allow producer to prepare responses pre meeting

bullet

Results are recorded to the (A32) Quality Log

Top of Page

QR05: Roles Involved in Quality Review

bullet

4 roles specific to the Quality Review plus 4 roles whose day-job encompasses the quality review 22.4.2

bullet

Specific roles described earlier: Review Chairperson, Product producer(s), Product reviewer(s), Scribe

bullet

Roles whose day-job includes Quality Review involvement
bullet

PM: Plan the reviews in outline and actions to address remedial work while preparing Stage Plans and contained Stage Quality Plan
bullet

Project Support: Arrange meeting rooms, distribute products, act as scribe etc

bullet

Team Manager: Plan reviews in detail, appoint people to review roles, monitor review results and report to PM

bullet

Project Assurance: Voice opinion on chosen reviewers (their technical suitability and familiarity with the Quality Review technique)
bullet

Check procedures are followed, standards used, results recorded and followed-up

bullet

Liaise with Quality Assurance on the improvement of standards & procedures

Top of Page

QR05: Roles Used in a Quality Review

bullet

How these relate to the standard PRINCE2® roles
bullet

Project staff members are appointed to quality review roles based on skills and availability during stage planning (or team planning)

bullet

Review chairperson: e.g Project Support, Senior User, Senior Supplier or other capable person
bullet

“…[Chairs] the quality review [not the project board!]

bullet

…Check that the product is ready …

bullet

Ensure that the quality review is properly organised (venue, date, time, attendees, duration)

bullet

Gather in the question lists and set the review meeting agenda

bullet

Provide final review sign-off [or] Institute exception procedures [for problems that cannot be resolved in Quality Tolerance]”

bullet

Scribe (May be a Project Support resource)
bullet

“Assist the chairperson … administrative”

Top of Page

Applying PRINCE2®

bullet

QR 06 create, modify or discuss any of the products of Quality Review in a given project scenario

bullet

QR 07 apply the Quality Review technique to any given project scenario

bullet

QR 08 discuss in detail the links between a Quality Review, the processes and project management team roles, and to show how this could be applied to any given project scenario

Top of Page

Quality in a Project Environment

bullet

Quality in a Project Environment
bullet

Syllabus: Quality in a Project Environment

bullet

QU01: The Purpose of Quality Management

bullet

Quality Organisation Structure

bullet

QU05: Responsibilities for Quality Management

bullet

The Quality Management Responsibilities

bullet

More Responsibilities

bullet

QU07: Quality Assurance and Project Assurance

bullet

QU01: The Purpose of Project Quality Management

bullet

QU01: The Purpose of Quality Management

bullet

QU02: The Project Quality Plan

bullet

QU02: The Product Description

bullet

QU02: Identify the Products of Quality Management

bullet

Purpose & Content of Quality Log

bullet

QU03: Quality Depends on Specification

bullet

QU03: The Importance of the Customer’s Quality Expectations

bullet

Applying PRINCE2®

bullet

Quality Practitioner Question

bullet

Process Practitioner Question

Top of Page or Top of Section

Syllabus: Quality in a Project Environment

bullet

Candidates are not required to have any detailed understanding of ISO 9000:2000

bullet

QU 01 describe the purpose of Quality Management (p)

bullet

QU 02 identify the products of Quality Management, and understand their purpose and content (p)

bullet

QU 03 describe the importance of the Customer’s Quality Expectations (p)

bullet

QU 04 understand the part played by a possible quality management system from the user or supplier in contributing to a Project Quality Plan (p)

bullet

QU 05 understand the Quality Management responsibilities and activities of the various PRINCE2® roles within each of the eight processes (p)

bullet

QU 06 understand the quality path through a project as illustrated by PRINCE2® (p)

bullet

QU 07 understand the relationship between quality assurance and the Project Assurance role (p)

bullet

QU 08 discuss the role played by Project Assurance in the various PRINCE2® processes, components and techniques

bullet

QU 09 create, modify or discuss the products of Quality Management in a given project scenario

bullet

QU 10 apply Quality Management to a given project scenario

bullet

QU 11 identify the relationship between Quality Management and other PRINCE2® components within any given project scenario

Top of Page or Top of Section

QU01: The Purpose of Quality Management

bullet

18.3 Quality Management is “the process of ensuring that the quality expected by the customer is achieved”
bullet

Quality Management is a corporate capability that encompasses PRINCE2® as the project management component

bullet

Quality is achieved using a Quality Management System (QMS)
bullet

QMS may be constructed to the ISO 9000 standard (The “Requirements specification” for a generic QMS)

bullet

QMS Includes
bullet

Quality Policy: the company’s attitude to quality

bullet

Procedures, processes and responsibilities (Organisation structure)
bullet

Used to conduct normal business in accordance with Quality Policy

bullet

Processes cover tools, techniques and working practices.

bullet

Project Quality is owned by the Project Board
bullet

QMS is owned and operated by corporate Quality Assurance

bullet

Quality Assurance are NOT part of the project

Top of Page or Top of Section

Quality Organisation Structure

bullet

18.4.1 p270 “The quality organisation structure indicates the responsibilities for quality
bullet

Who sets the quality policy

bullet

Who sets the standards to meet the policy

bullet

Any external body imposing quality constraints

bullet

Who monitors use of the standards

bullet

Any quality training group

bullet

Much of this work is often done by a central quality assurance function”

Top of Page or Top of Section

QU05: Responsibilities for Quality Management

bullet

Project’s quality responsibilities lie with the Project Board
bullet

Often delegate to those with necessary skills and time
bullet

Known as “Project Assurance”

bullet

Project Assurance often drawn from ranks of & work closely with Quality Assurance

bullet

Project Board
bullet

Ultimate responsibility for quality

bullet

Specify quality required and ensure/ confirm quality is being achieved
bullet

Via their (possibly delegated) project assurance responsibilities

bullet

Project Assurance
bullet

Police all aspects of project and product quality

bullet

Ensure the right people do the right things at the right time
bullet

Staff have the skills (are properly trained) and the time

bullet

Quality Review Follow-Ups Actions are completed

Top of Page or Top of Section

The Quality Management Responsibilities

bullet

Senior Users
bullet

Define requirements and test products (represents those who...)

bullet

Specifications are complete, accurate and reflect needs of all users (SU/ IP)

bullet

Confirm products are being built to specification (MP2)

bullet

Confirm products are acceptable and accepted (MP3 & CP1)

bullet

Interested in “Fitness for Purpose”

bullet

Senior Supplier
bullet

Ensure products are built to specification*

bullet

Specifications are complete, understood and achievable to known cost and timescale (SU5/ IP & PL)

bullet

Ensure use of correct product oriented standards and quality of workmanship (MP1&2)

bullet

(only) Interested in “Conformance to Specification”

bullet

Executive
bullet

Concerned that specification exactly matches purpose

bullet

Project Manager
bullet

Ensure the project is producing products of suitable quality (CS)

bullet

Team manager
bullet

Follow standards when producing products

bullet

Follow quality control process

bullet

Update the Quality Log with Quality Review results

bullet

Project Support
bullet

Administer the Quality Review process

bullet

Quality Review Chairperson: See Quality Review Chair above

bullet

Quality responsibilities documented in the Project Quality Plan

bullet

* Note references to Conformance-2-Sec & Fit-For-Purpose. Quality Reviews are conducted in Executing a Work Package (MP2) where the product is compared to its (A22) Product Description - thus a Quality Review is a supplier side conformation of Conformance to specification

Top of Page or Top of Section

QU07: Quality Assurance and Project Assurance

bullet

Quality Assurance are a corporate function outside the PRINCE2® project
bullet

Receive project’s A17 Lessons Learned Report from CP3

bullet

Apply experiences from using the QMS to improve future projects

bullet

Project Assurance are the people with roles within the project
bullet

Reviews team plans and the work of all project members

bullet

May have been recruited from Quality Assurance

bullet

Advise the project board on the reliability of results reported to them
bullet

Answer the board’s question “Can we trust the information we receive from the PM is true, complete and a fair view”

Top of Page or Top of Section

QU01: The Purpose of Project Quality Management

bullet

Projects are temporary
bullet

Project quality approach must be created for each project

bullet

Required in advance of specifying tasks, timescales, costs and resources
bullet

Will drive activities and resourcing described in project and stage plans

bullet

Approach or policy documented in Project Quality Plan A31 (IP1?IP6?DP2)
bullet

Part of the Project Initiation Document (PID)

bullet

Describes project’s policy or philosophy towards quality (not truly a plan)

bullet

Creating the PQP should merge customer’s policy and QMS with supplier’s
bullet

Customer policy takes precedents

Top of Page or Top of Section

QU01: The Purpose of Quality Management

bullet

IP1 performs Project Quality planning
bullet

Answers “How quality will be achieved on this project”
bullet

Selection of standards for project management and product development activities

bullet

Driven by A25 Project Approach plus A7 Customer Quality Expectations as translated to A1 Acceptance Criteria in SU4
bullet

CQEs taken from the Project Mandate and/or captured in SU4

bullet

IP1 and PQP say “Who, what and how” at highest level

bullet

SB1/6 and MP1 perform Product Quality Planning
bullet

Specifies activities to build and check products based on product standards (PL3)

bullet

Assigning staff with checking skills to dated Quality Reviews (PL5)
bullet

Driven by Product Descriptions created in PL2

bullet

Stage and Team Quality Plans say
bullet

“Who what and how to validate products” at lowest level

bullet

True plans! part of Stage Plan or Team plan

Top of Page or Top of Section

QU02: The Project Quality Plan

bullet

A31 Project Quality Plan (Not a Plan but a Policy Document)
bullet

Identifies the techniques and standards required to achieve quality

bullet

Quality responsibilities

bullet

Control and audit process for both specialist and management work

bullet

Change management procedure and configuration management plan

bullet

Customer Quality Expectations and Quality tolerances

bullet

Acceptance Criteria

bullet

Any tools used to ensure quality

Top of Page or Top of Section

QU02: The Product Description

bullet

A.22 Product Description
bullet

Provides a detailed description of product’s derivation, appearance, quality, construction & acceptance considerations

bullet

Identifier: unique key, probably from configuration management (minus version number)

bullet

Title: name by which the product is known

bullet

Purpose: background to such ideas as robustness, complexity etc

bullet

Composition and Derivation: May link to a PBS/ PFD and other sourcing information

bullet

Format and presentation

bullet

Allocated to: skills or people needed to create the product

bullet

Quality criteria, Quality method, Quality tolerance and Quality Checking skills or people required: How the Acceptance Criteria will be demonstrated

bullet

Note there may be many products per Product Description
bullet

Intermediate (Integrative) and simple products in the PBS may have a PD

bullet

Each product will have an (A5) Configuration Item Record that records “owner” & status

Top of Page or Top of Section

QU02: Identify the Products of Quality Management

bullet

A25 Project Approach
bullet

“Define the type of solution to be developed by the project and/or the method of delivering that solution”

bullet

Must match A1 Acceptance Criteria (and A7 Customer Quality Expectations)

bullet

A.25.2 Composition
bullet

Options considered

bullet

Chosen option and reasons for selection/rejection, for example, part of programme approach

bullet

Operational environment (identification of any environment into which the solution must fit)

bullet

Options considered are typically combinations of
bullet

“buy or build”/ “in-house or outsourced”/ “from scratch or by adaptation”/ “tailored or off-the shelf”

Top of Page or Top of Section

Purpose & Content of Quality Log

bullet

A 32 Quality Log
bullet

“Summary of all the quality checks that are planned (1st) and have (2nd) taken place“

bullet

Reference number

bullet

Product

bullet

Method of quality checking

bullet

Staff responsible, name, role

bullet

Planned date and Actual date

bullet

Result

bullet

Number of action items

bullet

Target sign-off date (as defined when agreeing Follow-Up Actions) and Actual sign-off date

bullet

A 32.3 “Entries are made when a quality check or test is entered on a Stage Plan. The remaining information comes from the actual performance of the check. The sign-off date is when all corrective action items have been signed off
bullet

An initial, blank Quality Log is created during Planning Quality (IP1)”

Top of Page or Top of Section

QU03: Quality Depends on Specification

bullet

Planning is dependant on knowing the Customer’s Quality Expectations A.7
bullet

Meeting CQE’s depends on having agreed, measurable, prioritise definitions

bullet

SU4 extracts CQE from the Project Mandate A.29
bullet

Senior User specifies and confirms agreement

bullet

Translated to agreed, measurable Acceptance Criteria A.1

bullet

Recorded in the Project Brief A.26 (p.329 & p.331)

bullet

Project Approach A.25 matched to the Acceptance Criteria (in SU5)

bullet

IP2 creates Project Plan A.30 based on Acceptance Criteria, Project Approach and the Project Quality Plan

bullet

Acceptance Criteria
bullet

A prioritised list of criteria that the final product(s) must meet before the customer will accept them; a measurable definition of what must be done for the final product to be acceptable to the customer. They should be defined as part of the Project Brief and agreed between customer and supplier no later than the project initiation stage. They should be documented in the Project Initiation Document - (Note the definition makes AC supplier centric, Statement of Work centric, conformance to spec centric, NOT Statement of Outcome, fit-for-purpose oriented)

Top of Page or Top of Section

QU03: The Importance of the Customer’s Quality Expectations

bullet

Customer’s quality expectations §18.4.1 & Glossary

“A statement from the customer about the quality expected from the final product. This should be obtained during the start-up of a project in Preparing a Project Brief (SU4) as an important feed into Planning Quality (IP1), where it is matched against the Project Approach and the standards that will need to be applied in order to achieve that quality”

bullet

Expectations are initial thoughts
bullet

Often ill-defined

bullet

Customers CQEs may be in conflict at the start of the project

bullet

Acceptance Criteria are the result of work to define and align CQEs Acceptance Criteria may require compromises to arrive at an agree state

bullet

Acceptance Criteria A1
bullet

Criteria may be objective (preferred) or subjective
bullet

It is almost always possible to define objectively measurable criteria. But it is not always worth the effort - p274 slightly paraphrased

bullet

Project performance AC are Target dates, Costs, Interfaces to be maintained, Control of changes, Scope, Timings

Top of Page or Top of Section

Applying PRINCE2®

bullet

QU 08 discuss the role played by Project Assurance in the various PRINCE2® processes, components and techniques

bullet

QU 09 create, modify or discuss the products of Quality Management in a given project scenario

bullet

QU 10 apply Quality Management to a given project scenario

bullet

QU 11 identify the relationship between Quality Management and other PRINCE2® components within any given project scenario

Top of Page or Top of Section

Quality Practitioner Question

bullet

Part A is a convergence of quality and product based planning

bullet

Part B gives 4 questions and 16 marks and all ask for two selections – Ie they carry 2 marks each – should be possible to catch-up some time for slower questions

bullet

Re-read the scenario S:5.1 if you need to
bullet

There is ‘Additional Information’ specific to this question

bullet

Answer the question using a blank answer grid from S:5.3 then mark your answer using S:5.4

bullet

Research any questions where you disagree with the marking scheme
bullet

How much time was looking up references in the Red Book?

Top of Page or Top of Section

Process Practitioner Question

bullet

Turn to Section:5 Sample Practitioner questions and try question 9
bullet

Do the question against the clock. Your target is circa 15mins

bullet

Re-read the scenario S:5.1 if you need to (surely not!)
bullet

There is no ‘Additional Information’ for this question

bullet

Answer the question using a blank answer grid from S:5.3 then mark your answer using S:5.4
bullet

Research any questions where you disagree with the marking scheme

bullet

Let us know you have got to here by mailing prince2@LogicalModel.Net

bullet

You may wish to redo all the exam questions again
bullet

You should gain new insights by re-doing questions you are familiar with

bullet

We will do and thus discuss underlying rationale of these and others on the course

Top of Page or Top of Section