When implementing software quality metrics, we need to first understand the purpose of the metric and who will be using it. Will the metric be used for measuring people or the process, for illustrating the level of quality in software products, or for driving toward a specific objective? QA managers typically want to deliver productivity metrics to management while management may want to see only the metrics that support customer or user satisfaction or cost related (ROI) initiatives. Avoid this gap in communication by delivering software quality metrics with actionable objectives toward increasing or improving a business objective. Metrics just for the sake of information, while helpful, often just end up in spreadsheets that no one cares about. Not only do you need to learn how to define and develop metrics that connect with potential actions driving toward improvement, you also understand and avoid one of the main pitfalls of metrics, driving behavior which could be both unintended and negative.

Course Objectives

Join this full-day course to learn how to develop and use metrics within an extensible framework that can be used throughout your development and QA organization. And, more importantly, that answer the key questions of your stakeholders and get them to stand up straight and pay attention.

Attend this course and learn:

  • How to connect your metrics with the most important objectives, those that affect the bottom line and those that are customer oriented.
  • How to develop a measurement framework that measures not only typical test results such as defects, but processes and functions and their alignment with business objectives within your organization.
  • How to include measurements, metrics, objectives, questions and answers for your stakeholders
  • How to use metrics to not only evaluate, but also predict what could go wrong.

Course Outline

Module 1: Back to Basics?

  • What metrics can and cannot show us
  • How metrics help us
  • Measurements
  • Metrics
  • Indicators
  • Questions
  • Answers and objectives

Module 2: Developing a framework-Process versus Function

  • Making a framework driving towards quality
  • Components of your framework
  • Connecting process into the framework
  • Connecting people/organization into the framework

Module 3: Connecting the framework for your stakeholders

  • Identifying stakeholders
  • Connecting questions with answers
  • Relating answers with metrics
  • Developing evaluation, prediction, and action based on indicators

Module 4: Applying metrics within a quality model

  • Defining a quality model within the framework
  • Defining where do metrics fit in quality models
  • Developing a quality model
  • Connecting the metrics with quality and the end customer

Module 5: Executing and Managing the Metric Framework

  • How to get started
  • How to enroll your organization
  • How to maintain and adapt your framework


Philip Lew, XBOSoft

With extensive experience in a variety of management and technical positions in software development and product management, today, Philip Lew leads XBOSoft’s (www.xbosoft.com) direction and strategy as their CEO. His Ph.D. research in software quality and usability resulted in several IEEE and ACM journal publications. Philip has also been published in a number of trade journals. He has presented at numerous trade and academic conferences and in the past 20 years and has worked with hundreds of organizations to assess the quality of their software, examine software quality processes, and set forth measurement plans to improve software quality using systematic methods. He received his Bachelor of Science and Master of Engineering degrees in Operations Research from Cornell University. His post-doctorate research focuses on software quality and usability measurement.