Home | About QAI | QAI Home Page | Federated Chapters
QuEST Chicago
Conference Home Page
Manager's Workshop
QUEST At A Glance
QUEST Magazine
Session Presentations
QUEST Chicago 2008
Last updated: 05/05/2009

Solutions Benchmarking Sessions

*You can jump ahead to any selection by clicking the DATE or the session TITLE



Requirements Based Functional Testing - A Process to Govern Your Testing Project
Bill Ufheil, CDW

Track 1: 1:00 - 2:00

Most people become QA analysts almost by accident, transitioning from development, project management, business analysis, or the business itself.  At one time in our IT careers, we’ve all tested software.  Few of us, however, have had any formal training on the subject.  This presentation is for you if you are new to QA, a newly appointed QA test lead or manager, or simply someone that has been tasked with testing a software application.  If you have no time, no budget, no tools, no staff, and no QA knowledge; no problem, this seminar is for you.  By attending this presentation you will receive an introduction to a practical, proven, repeatable, QA process that will allow you to analyze, plan, design, construct, and control your software testing project.  The only tool you will need is Microsoft Office.

About the speaker...
Bill is currently the Manager of Quality Assurance and Manager of Release Management at CDW.  His teams perform functional testing, automated regression testing, performance testing, and release management across legacy, Web, client/server and 3rd party commercial applications.  He has 30 of experience in Information Technology working in the insurance, banking, finance, mortgage, health care, and retail industries.  He is experienced in all phases of the Software Development Life Cycle; performing as a developer, project leader, application development manager, project manager, business analyst and quality assurance manager.

 Back to top

Defining Goal-Based Project Metrics
Cheryl Saar and Marty Safirstein, Allstate

Track 2: 1:00 - 2:00

Many software development organizations understand the importance of taking measurements, but they do not always understand how best to use them. Often, measurements are taken for the sake of measurement, but do not necessarily lead to changes or improvements. The measurement program kicks-off with enthusiasm, but that enthusiasm wanes over time as the effort of measuring outweighs the value. Measurements should be taken with a well-defined purpose. This presentation will explore how to design a measurement program that focuses on goal-based measurements. It will cover the various uses of metrics, how to identify and create well-defined goals following the S.M.A.R.T. goal definition technique, the goal-question-indicator-metrics approach to defining and reporting on goal-driven metrics, and considerations in implementing an organizational measurement program. These considerations include collecting and storing measurement data, reporting, analysis, improving and automating. Understand the nature of goals such that you can define them with enough specificity to truly measure your success in reaching them.

About the Speakers...
Cheryl Saar is the manager of the Process and Quality Measurements team at Allstate Insurance, where she manages and consults on the implementation and ongoing support of measurement processes throughout the Allstate Technology and Operations organization. Cheryl has over 25 years of IT experience in estimation, metrics, project and people management, software development, testing, education, and technical telephone and onsite support. She has previously presented measurement topics at ICSPI, Software Process Symposium, and IT Financial and Asset Management Summit conferences.

Marty Safirstein has over 30 years experience in information systems including 7 years at Allstate. He is currently participating in the development and deployment of the requirements management process and measurement reporting for his department.

 Back to top

Leveraging Traditional Software Validating Methods with Agile
Mike Gladkowski, Interwoven Corporation

Track 3: 1:00 - 2:00

After years of working in a traditional testing world, your organization decides to embrace the benefits of agile software development. Does this mean that all your existing QA methods, processes, and tools are obsolete? Or, can these techniques be leveraged in an agile world? This session will discuss which methods, processes, and tools can be employed successfully in an agile testing environment. You will learn the key elements required to be successful in working within an agile testing framework. Real life examples of how these elements are implemented for a globally diverse team will be presented. Mike will also discuss how to leverage your traditional software validation methods to be effective within agile based testing.

About the Speaker…
Mike Gladkowski has over 20 years experience in the software quality assurance field. He has managed software quality assurance organizations in the telecommunications, aerospace, insurance, financial, and legal industries. Mike is currently a Director of Quality Assurance at the Interwoven Corporation where he is responsible for the quality of several multi-platform, enterprise software products used by the legal and financial industries. Mike has successfully validated several products using agile methodologies.

 Back to top

Test Case Standards that Exemplify Test Objectives
Lynn Hancock and Brook Klawitter, USG Inc.

Track 4: 1:00 - 2:00

Testing is a given in many organizations and for many quality assurance practitioners, however, we need to examine our test cases and their standards to ensure they are meeting our objectives. This interactive presentation will help you to define and implement standards that are appropriate for your organization based on the benefits you must realize. Examples of existing standards and guidance on creating new standards will be given. Techniques for incremental implementation, training, and continuous improvement of these standards will be also be discussed. The information presented will be applicable to all tools however; the examples presented will be from HP's Quality Center.

About the speakers...
Brook Klawitter is currently the Quality Assurance Manager at USG. As Quality Assurance Manager, Brook manages the onshore and offshore quality teams. She works to implement processes aimed at improving the quality of ERP software, specifically assisting with release coordination, test team management, tool setup and processes, and automated testing implementation. Brook has over ten years experience as a Systems Analyst. Prior to her role with USG, Brook worked in the banking industry where she managed two offshore teams responsible for both the manual and automated testing of commercial banking applications. Brook holds CSQA and CSTE certifications from the QAI Global Institute.

Lynn Hancock is currently working in an enterprise PMO role, improving business processes at USG. She is the former Quality Assurance Manager at USG. In her role, Lynn provides thought leadership, practical guidance, and hands-on involvement in implementing the processes in order to meet business requirements. Lynn has over 20 years of IT experience. She earned her BS in Electrical Engineering Computer Science from Princeton University and her MS in Engineering Management from Northwestern University. Lynn is a CSQA, Certified Software Quality Analyst, from the Quality Assurance Institute (QAI), and served for two years on the Board of Directors for the Chicago Quality Assurance Association (CQAA) as their Program Director.

 Back to top

Testing in a Model-Based Development World
David Cook and Feng Zhu, PhD, Boston Scientific Corporation

Track 5: 1:00 - 2:00

Boston Scientific adopted Model-Based Development (MBD) for its most recent family of medical device firmware. This presented a new challenge to firmware design verification testing (FW DVT) for medical devices, where regulatory needs directly influence the testing process. Over the past five years, the FW DVT group has developed tools, methodologies, and reusable test assets to support MBD. Based on this experience, there are several recommended practices that must be put in place to make FW DVT testing within the MBD environment work efficiently and still meet regulatory scrutiny for testing of high quality, mission-critical firmware. In this case study, Dave will outline some of these recommended best practices, look at what metrics have proven useful in test scheduling and execution, shine a light on the pitfalls, and review the productivity gains that have been made as a direct result of these efforts.

About the speakers...
Dave has 25 years of experience developing and testing embedded software for systems spanning aerospace to appliance control, using a wide variety of design and modeling techniques. With Boston Scientific, he serves as a senior technical leader for the firmware design verification testing team, developing tests, tools, and infrastructure to support the testing of medical device software for implantable medical devices. Over the last five years Dave has worked to solve the issues surrounding the use of model-based development. Dave has Bachelor of Science in Electrical Engineering from the University of Massachusetts at Amherst and is a Certified Software Test Engineer.

For over 20 years Dr. Feng Zhu has devoted most of his time to building testing frameworks that are theoretically sound and practically efficient. His early prototype of a client-server automatic regression system for embedded software evolved into a fully functional testing architecture at Boston Scientific that supports multiple testing objectives. In the past few years, Feng lead a team to establish the model-based verification framework, related tools, and processes for the firmware design verification testing of the latest implantable medical devices. Feng holds a PhD degree in Computer Science from the University of Minnesota and is a Certified Software Test Engineer.

 Back to top


Requirements Verification and Validation on a Global Project
Gary Greenberg, GE Healthcare

Track 1: 11:00 - 12:00

The requirements were complete and the contract was signed. The testing team was then responsible for certifying a software product for use as part of the largest healthcare IT undertaking in the world. In order to achieve this certification, full requirements coverage had to be demonstrated. In this presentation, Gary will describe the processes developed to ensure complete coverage of functional and contractual requirements by utilizing verification and validation techniques. This program is targeted at quality and testing professionals looking for real-world methods to ensure requirements coverage. In this discussion, Gary will include organization and differentiation of functional requirements and contractual requirements, verification and validation definitions, and verification and validation techniques to ensure full requirements coverage.

About the speaker...
Gary Greenberg is a quality systems engineering lead at GE Healthcare where he focuses on verification and validation of diagnostic imaging systems. He has experience in all phases of the software development lifecycle in regulated and non-regulated environments. Gary holds CSTE and CSQA certifications and a bachelor's degree from the University of Illinois at Urbana-Champaign.

 Back to top

When Teams Transform Chaos to Control
Joyce Sattovia and Elizabeth Glaser, The Boeing Company

Track 2: 11:00 - 12:00

This session will help you get smart about how change impacts your team.  Discover how to take productivity to the max during the chaos caused by constant change.  Major change is inevitable within our work environments.  It is usually initiated by an unfamiliar event that forces you and your team members to respond quickly and effectively.  Find out how to be open to transforming ideas when a foreign element disrupts the status quo.  Learn how to understand the predictable stages of change, how to minimize individual resistance, and that improvement is always possible.  This insight will take you and your team away from possible pandemonium and toward higher productivity.  This interactive session will engage participants in activities that will help them identify the impacts individuals and teams may be experiencing during different phases of the change process.  This understanding can lead to quicker navigation through any given change when it is thrust upon us.

About the speaker...
Joyce Sattovia is a Process Specialist and the leader of the Human Resources Systems Quality and Compliance team within Information Technology at The Boeing Company.  Her team is tasked with managing continuous improvement for both people practices and software engineering activities. With a Bachelor’s degree in Computer Science, Joyce has 30 years of experience that include software engineering, project management, software quality assurance, organizational development, process improvement, and quantitative performance measurement. Joyce is an experienced trainer both inside and outside of Boeing. Her effectiveness in training lies in her usage of experiential learning techniques to demonstrate the concepts and involve the participants. She is accomplished at making ideas come alive for her audience.

Elizabeth Glaser is a Process Specialist with The Boeing Company, focusing on improving organizational and individual effectiveness through process improvement. With over 10 years of experience, she has served McDonnell Douglas and Boeing in various capacities, including software and systems engineer, and program manager.  Elizabeth is an experienced trainer who incorporates experiential learning techniques to demonstrate and reinforce concepts for participants both inside and outside of Boeing.  Elizabeth has MS degrees in Computer Science from the University of Missouri-Rolla, and Organization Development from The American University in Washington, DC.  She is currently completing work on a Ph.D. in Industrial and Organizational Psychology.

 Back to top

Object-Oriented Test Automation
George Cerny, SmartSignal Corporation

Track 3: 11:00 - 12:00

In his presentation, George will discuss a method for testing that is focused on developing automated test cases for 100% of the quality assurance testing. First, home grown processes are followed for requirements based testing and software test management. Test cases are then developed using object-oriented automated testing (OOAT). The results of OOAT executions are automatically fed back into the test management process giving the entire organization a dashboard view of the requirements based testing status and test management project tracking. In this session, you will learn how these techniques were put into practice at an actual organization including the technical, data, process, and project tracking considerations necessary to the successful implementation of the methodology.

About the speaker...
George Cerny, QA Manager at SmartSignal Corporation, has over 13 years experience in quality assurance, software development, and test management with a focus on object-oriented automation. He has assembled QA test teams, architected and implemented test automation, and developed software applications at Griffith Laboratories, Interim Technology, American General, Ceridian Corporation, Deloitte & Touche Tax Technologies, LLC, UNext.com, and SmartSignal Corporation. George has certifications in test automation, quality assurance testing, and management from Borland Software Corporation, Software Quality Engineering (SQE), and American Management Association (AMA).

 Back to top

Advanced Test Driven Development
Peter Zimmerer, Siemens AG

Track 4: 11:00 - 12:00

Today, there is plenty of discussion about test-driven development (TDD) and plenty of pressure to perform test-driven development in many software projects.  In this "bandwagon" atmosphere, it cannot be bad to ask the question: What is really behind TDD? Test-driven development is an approach to software construction in which developers write automated unit tests before writing code. These automated tests are then run as the code changes. Proponents of this approach assert that it delivers software that is easier to maintain and of higher quality than traditional development methods. Join Peter as he shares his view of TDD's advantages and limitations and discusses how the TDD concept can be extended to all levels of testing.  Based on real-world experience, Peter will explain how to use TDD practices to support preventive testing throughout the development process resulting in closer cooperation between developers and testers.

About the speaker...
Peter Zimmerer is a Principal Engineer at Siemens AG, Corporate Technology, in Munich, Germany.  He received his M.Sc. degree (Diplominformatiker) in computer science from the University of Stuttgart.  Peter is an ISTQB(TM) Certified Tester Full Advanced Level.  For more than fifteen years, Peter has been working in the field of software testing and quality engineering for object-oriented, distributed, component-based, and embedded software. He was involved in the design and development of various Siemens in-house testing tools for component and integration testing.  At Siemens, he performs consulting on testing strategies, methods, processes, automation, and tools in real-world projects and is responsible for the research activities in this area. He is co-author of several journal and conference contributions and a frequent speaker at international conferences.

Back to top 

Utilizing Defect Management for Process Improvement
Kenneth Brown, Nationwide

Track 5: 11:00 - 12:00

Ever wonder why you track defects throughout projects and production? What happens to that information once the defect is resolved? Is the data forgotten and just left sitting on the shelf? This presentation will provide you with practical advice on how to use that information to help your projects run smoother, improve development practices, and prevent defects from being injected to start with. You will learn how to enter, track, and measure defects so that you can utilize reporting to find weak processes and practices.

About the speaker...
Ken Brown has over 15 years of experience in the quality and testing profession and has been instrumental in developing and implementing best practices, processes, and standards at organizations such as Nationwide, JPMorgan Chase, and Exceptional Innovation. He has been on the Executive Board of the COQAA for the last five years and currently serves as President. He works diligently on educational opportunities and certifications in the Central Ohio Area.

Back to top 


The Quality Assurance Program: Supporting Process Compliance and Improvement
Jane Connor, BMO Financial Group

Track 1: 11:00 - 12:00

When you think about QA, your mind naturally turns to testing. However, testing is a customer of quality assurance just like development, vendor management, or estimation practices. In a successful organization, quality assurance is an umbrella function that helps to provide consistency in process application across the enterprise. This consistency is achieved through an ongoing internal audit program, continuous process review and improvement, clearly defined process owners, and a communication method that gets the word out to the right audience at the right time. Jane's presentation is a journey through the work-life of a QA Specialist in a CMMi Level 4 organization. Join Jane in exploring the techniques used to successfully deliver a QA program that supports practical process application and process improvement to the software development lifecycle.

About the speaker...
Jane Connor is a skilled QA professional with over ten years of experience in software testing and test management.  She began her career as a junior tester and has risen through the ranks at a variety of companies to her current role as Senior Quality Assurance Specialist at BMO Financial Group. In this role, Jane has successfully leveraged her wide-ranging experiences in consulting, coaching, and support of software development projects and ongoing release management.  She recently participated on a SCAMPI A assessment team evaluating BMO CTD CM CMMi Level 4 readiness. She contributes to the creation of CTD IT best practices through managing process improvement initiatives for testing and change management, participates in the local Software Engineering Process Group (SEPG), and conducts internal process audits. Jane possesses a strong knowledge of organizational process fundamentals that has helped her to become a recognized expert among both her peers and senior leadership at BMO Financial Group.

Back to top

Process Improvement: Real Life Cases
Barbara Ainsworth, Process Plus International, LLC

Track 2: 11:00 - 12:00

No matter the end product, the foundation for and focus on implementing process improvement remains consistent.  Using models as the basis for improving processes makes success more likely.  However, no single model has all the right answers.  During this presentation, you will see real life cases from several companies where the goals were to “increase efficiency and quality.”  These real life cases demonstrate various approaches to implementations of process improvement. One organization agreed to use CMMI, PMI, and other models as the foundation for process improvement; another organization required a ‘stealth’ approach; yet another began with one model and determined a different method was more appropriate.  Examples and lessons learned in these instances will be shared to provide greater insight into these varied approaches and which might work the best in your own organization.

About the speaker...
Barbara Ainsworth, PMP, CSQA, CSTE, and ITIL Service Management, is Principal Consultant for Process Plus International, LLC.  She has over twenty years of experience including process engineering management and improvement, program and project Management, PMO, and quality control.  Barbara is a leader as well as an individual contributor.  She is a change agent working with small to global organizations in a cross-functional manner, consulting with all levels from CIO to technologist.  She has a well-rounded understanding of and expertise in industry models and best practices as well as the implications and impact of using them.

Back to top

Data and the Environment: Impacts on Cost and Success
Philip Sampson, AT&T

Track 3: 11:00 - 12:00

When analyzing the cost of quality, the impact of underlying test data and environments often remain hidden. The importance of these two elements, however, is self evident. Without data, one cannot test. Without an environment, one cannot test. Of course, the code base to be tested is job number one. However, the creation and maintenance of test data and test environments follow very closely! This presentation will show how data and environment considerations can help facilitate greater success and enhance improvement initiatives from an overall software quality perspective. Philip will begin with the fundamentals, what is required for testing, what data will trigger areas to be tested, what environments should be used, and when is testing complete. He will then proceed to more advanced notions of accurate data and environment usage within an even more controlled framework including data selection, environment criteria, and test improvement possibilities.   

About the speaker...
Philip Sampson works within the Mobility Group of AT&T focused on establishing a culture for test automation. Philip has 15 years of experience fulfilling various roles within development, client liaison groups, and software quality management. Philip holds a CSQA and CSTE. He has worked as both a consultant and employee in a variety of industries within South Africa and the United States. Philip has experience on projects ranging from process improvement initiatives to quality appraisals to management of multicultural teams. He enjoys working as a change agent and thrives on the challenges and ideas that a mixture of mindsets and opinions provide.

Back to top

Case Study: Open-Source Unit Test Tools in Functional Testing Case Study
Chris Kaufman, Olenick & Associates

Track 4: 11:00 - 12:00

In this case study presentation, Chris will explain how open source unit test tools were used to build an automated functional/regression test suite for an equities clearing system. The resulting tests were low cost, could be run on any developer or tester machine, could be executed as part of the build, and could be delivered to the customer to verify installation of the system. Key differences between unit and functional testing will be discussed, as well as how to accommodate those differences when using unit test tools to perform functional tests. This case study will also illustrate how to leverage unit test tools to perform automated functional testing.

About the speakers...
Chris Kaufman has been practicing in the field of software quality since 1984 with an emphasis on test automation. He has led test automation projects using commercial, proprietary, and open-source testing tools. For the past three years, Chris has been working on projects leveraging open-source unit-testing tools for functional testing. Chris was a presenter at the Chicago Software Process Improvement Network (CSPIN) in 2008.

Back to top

Conference Sessions: Keynote Presentations | Industry Practices Sessions | Solutions Benchmarking Sessions | Best Practices Workshops
Coaching Sessions
| Panel Discussion

Quality Engineered Software & Testing (QUEST) Conference - Copyright © 2009