Clyneice Chaney, Quality Squared

One-Day Class: Identifying and Executing the Most Important Tests

Monday, April 15, 2013: 8:30 AM - 4:30 PM



Today, getting the product to market as quickly as possible with the right features may be more important than the product’s reliably. In this type of environment, testing efforts that just find defects aren’t enough to satisfy what is needed. Testers are challenged to achieve a good balance between helping to get the product out the door and ensuring quality, reliable software. How can they achieve this? How can testers to know if they have devised an adequate testing effort? How can they tell if the most important aspects of the product were actually tested and whether they were tested well? Answers to these questions come from creating a strategy based on the most critical and important tests to run This class, patterned after an approach by Marnie Hutchinson, provides techniques for identifying the areas of the product that are critical to the testing effort Come learn an approach that results in a testing focus targeting risks and product criticality.

Course Objectives

Join this full day course to learn an approach to a testing focus that targets risks and the most critical functions of a product.

Attendees will learn:

  • How to develop a most important test case strategy
  • How to apply risk to identify most important test cases
  • How to use coverage and data and boundary analysis to identify most important test cases

Course Outline

Module 1: Software Testing: Why Most Important Test Focus?

  • Testing today
  • Divergent quality experiences
  • The most important test method

Module 2: Initiating Most Important Test Focus Strategy

  • What do you need for a successful test effort
  • What are the critical components
  • What objectives are we striving for
  • Establishing the strategy foundation

Module 3: Coverage and Most Important Tests Areas

  • Identifying risks
  • Which are the most important areas
  • Calculating coverage requirements

Module 4: Identifying MIT Paths and Data

  • Path analysis principles
  • Testing implications
  • Basic concepts of data and boundary analysis
  • Decision tables
  • Implementation of the test strategy

Module 5: Executing and Managing the Strategy

  • Managing for the most important test focus
  • Measuring and reporting MIT focus

Megan Sumrell, Mosaic ATM

Half-Day Tutorial: Formalizing Requirements into Executable Tests

Tuesday, April 16, 2013: 8:30 AM - 12:00 PM


In a combination of lecture and hands-on exercises you will examine the commonality between requirements and tests and how a requirement can be effectively communicated in the form of a test. By placing the emphasis on the specification of requirements in the form of tests, we are at once increasing the quality of communication among team members and ensuring that testing is not an activity that gets tacked onto the end of a sprint. The tutorial will explore the requirements of a fictitious project and follow the evolution of those requirements as automated FitNesse tests. You will gain experience in new strategies for communicating requirements and learn how to use Fit/Fitnesse and home-grown tools to formalize requirements into executable tests. The concepts covered in this tutorial will be directly applicable to the problem of integrating testing into short iterations or sprints.

  • Learn how to capture requirements as acceptance criteria
  • Explore Fit/FitNesse and discuss different fixture types
  • Discover different strategies for organizing tests to match your team’s needs.

Todd Kuczaj, Accenture

Half-Day Tutorial: Risk Based Testing on Steroids

Tuesday, April 16, 2013: 1:00 PM - 4:30 PM


As organizations strive to speed up software development in order to reduce time-to-market, there is significant probability that the software development processes will be compromised to “make the date.” These compromises always seem to have a negative effect on the test team who has the difficult, if not impossible, task of helping ensure a quality release before shipping. Todd will discuss ways test managers can implement risk-based testing and describe fundamental quality and risk management techniques that can be leveraged throughout the development life cycle. Join Todd and learn the essentials of managing risk: identification, analysis, prioritization, response planning, resolution, and monitoring. Additionally, you’ll learn the basics of risk-based testing, what it is, why it’s relevant to testing, how to implement it in your organization, and how to apply it throughout the software development lifecycle.

  • Explore the problems created by high-speed development
  • Learn the essentials of managing risk
  • Understand the basics of risk-based testing

Ayan Dave, Quick Solutions, Inc.Terry Wiegmann, Quick Solutions, Inc.

Presentation: Automating Testing with gherkinSalad – Our Story

Wednesday, April 17, 2013: 9:45 AM - 10:45 AM

Speakers: ;

A new project at a new client with new team members presented an opportunity for Ayan and Terry to also use a new test automation framework, gherkinSalad. Risky? Perhaps! A learning opportunity? Definitely! Ayan created the test automation framework and wanted to use it on a real project. Terry was looking for an opportunity to blend BA, QA, and testing roles and to be part of a team automating testing in the iteration. Join Terry and Ayan as they share their experience pairing and learning across roles, implementing gherkinSalad, and evolving it into a scalable and sustainable solution. You will learn their techniques, understand their “Whole Team” approach, and be introduced to their implementation philosophy, fail fast, learn, and evolve quickly. Part case study, part retrospective, they will describe practices they innovated, explored, discarded, kept and extended. Come and see what might work for you!

Thien-An Nguyen, Aetna

Presentation: Leveraging Automation beyond Regression Testing

Wednesday, April 17, 2013: 11:00 AM - 12:00 PM


In the year 2012, most businesses leverage automation in their IT departments to conduct regression testing. It is something that has evolved over the years and become a mature slice of the IT world. However, despite the power of automation, many still do not look to harness automation’s capabilities for other areas. Thien-An and Matthew will show how they successfully implemented automation solutions in new arenas at Aetna. For example, automation can be used to screen scrape from various applications generating a document in a few short minutes that would take significantly longer to create manually, saving customer service representatives significant time when speaking to customers. Inside the testing world, automation can be used to create a complete end-to-end test that goes through many systems ensuring they all interact together as expected. By using automation to eliminate mundane manual tasks, you will be able to show significant savings and Thien-An and Matthew would like to show you how.

Lee Barnes, Utopia Solutions

Workshop: Building a Strategy for Test Automation Success

Wednesday, April 17, 2013: 1:00 PM - 2:30 PM

Workshop Leader:

Choosing an appropriate tool and building the right framework are typically thought of as the main challenges in implementing successful test automation. However, long term success requires that other key questions must be answered including: What are our objectives? How should we be organized? Will our processes need to change? Will our test environment support test automation? What skills will we need? How and when should we implement? In this workshop, Lee will discuss how to assess your test automation readiness and build a strategy for long term success. You will interactively walk through the assessment process and build a test automation strategy based on input from the group. Attend this workshop and you will take away a blue print and best practices for building an effective test automation strategy in your organization.

  • Understand the key aspects of a successful test automation function
  • Learn how to assess your test automation readiness
  • Develop a test automation strategy specific to your organization

David Dang, Zenergy

Presentation: Leveraging Open Source Test Automation: A Selenium WebDriver Case Study

Wednesday, April 17, 2013: 3:00 PM - 4:00 PM


Most companies grasp the importance of leveraging test automation including increased test coverage, reduced execution time, and more frequent testing. However, there are significant costs associated with purchased test automation tools such as licensing fees, maintenance/support fees, and vendor dependency for product fixes and enhancements. More than ever, companies are exploring open source test automation tools to reduce these costs. While there are multiple advantages of using these open source test automation tools, there are also disadvantages. Without proper planning and the creation of advanced test automation frameworks, most companies still struggle with test automation. Join David to learn the factors in deciding between open source vs. purchased automation tools, the short-term and long-term advantages of using an open source automation tool, the importance of designing an automation framework that supports organizational testing objectives, and the effort needed to implement a Selenium WebDriver solution.

Lee Barnes, Utopia Solutions

Presentation: Extending Test Automation to Mobile Applications

Thursday, April 18, 2013: 9:45 AM - 10:45 AM


The explosion of multiplatform mobile application development has created an extensive testing burden for quality organizations – and a huge opportunity for test automation ROI. Factoring in the idiosyncrasies of individual device models and carriers magnifies both the challenge and opportunity. Attend this session to learn how to extend test automation to the mobile platform and realize significant ROI. You will come away with best practices for implementing test automation effectively and efficiently across multiple mobile platforms and devices utilizing various types of mobile test automation tools. Specifically, tool independent techniques for creating a single test suite capable of executing across multiple platforms and devices will be discussed.

Eran Kinsbruner, Perfecto Mobile

Presentation: Testing Mobile Apps: 3 Dilemmas Solved

Thursday, April 18, 2013: 11:00 AM - 12:00 PM


The fragmentation and unpredictability of the mobile market present new challenges and risks. Testers must assure application quality across multiple platforms and help deliver new products almost every day. Using his experience implementing automated mobile testing for clients, Eran will analyze three fundamental mobile testing dilemmas encountered when enterprises go mobile. First, learn how and when to use emulators and real mobile devices, when to rely on each, and how many devices you will need in each stage of development. Second, understand the differences between testing on local devices versus remote devices in the cloud and how the differences affect test coverage, scalability, logistics, risk, and security liability. Third, discover how to reduce the learning curve and time-to-market by extending your existing software application lifecycle management environment to mobile, preserving your organization’s tools, processes, and knowledge. Join Eran to increase your ability to quickly identify an efficient, feasible mobile testing strategy for your organization.

Philip Lew, PhD, XBOSoft

Workshop: Understanding, Evaluating, and Improving Mobile App Usability

Thursday, April 18, 2013: 1:00 PM - 2:30 PM

Workshop Leader:

User experience and usability are key ingredients of any successful mobile app. In this workshop, Phil will describe the differences between the two as important elements of software quality from the end user viewpoint. User experience, in particular, is an element that many forget until the end and generally don’t know how to measure since there are no standard definitions. Phil will discuss quality modeling and how usability and user experience should be modeled for the enterprise. This discussion will range from the initial components of quality, to breaking usability and user experience down into measureable characteristics for mobile apps, and then, using these characteristics to derive metrics. These metrics can then be used to benchmark, analyze, and improve the app toward end user satisfaction. Beyond this, Phil will also review a case study where various measurements were implemented to show actual usability improvement.

  • Understand the difference between usability and user experience.
  • Develop a usability model for your organization.
  • Explore key design and evaluation principles in software usability for mobile applications.

Peter Shih, uTest

Presentation: The New Lifecycle for Successful Mobile Apps

Thursday, April 18, 2013: 3:00 PM - 4:00 PM


Once a company decides to go forth and be mobile, where do they begin? This session will highlight the new lifecycle of mobile apps from conception thru launch, providing attendees with an ongoing approach to meet the needs of all constituents, and deploy successful apps that create value and sustain brand loyalty. Session attendees will go through the new lifecycle beginning with market research and mobile metrics that reduce hype, lead to development, ensure quality through testing, and finally, launch the app into the marketplace. Throughout his presentation, Matt will reference free tools, solutions, best practices, and real-world case study examples. You will learn the current state of app development and the inherent challenges that present themselves. You will also receive a full breakdown of the new mobile app development lifecycle complete with suggestions and tips for real-world apps in all stages of the lifecycle.

Kevin Flynn, Olenick & AssociatesMichael Ivy, Olenick & Associates

Presentation: Performance Testing: More than Tools and Scripts

Friday, April 19, 2013: 9:45 AM - 10:45 AM

Speakers: ;

The presentation will show that performance testing is more than purchasing and implementing a performance testing tool. Performance testing also includes a detailed plan, measurable requirements, and customized results that indicate how the requirements and corresponding test conditions passed or failed. Communication of test results to the stakeholders is also paramount to the performance test project success and business product launch or upgrade. Multiple, iterative performance test cycles with hands-on participation by client hardware, server, network, and application owners should be planned and executed. Performance test scripts should be created and maintained throughout the lifecycle of the application by the performance testing team. Learn how to organize and plan the best performance test with full stakeholder approval and understanding. Join Kevin and Michael to understand the key components of the performance test including the detailed plan, measurable requirements, and customized results. Learn to provide the results to stakeholders in an easy to understand format, bridging the gap between canned test tool reports and actionable performance test results.

Vic Soder, Deloitte Consulting, LLPVinkesh Mehta, Deloitte Consulting, LLP

Presentation: Integrated Load Testing of Multi-Channel Composite Applications

Friday, April 19, 2013: 11:00 AM - 12:00 PM

Speakers: ;

Join Vinkesh and Vic for a presentation on composite/multi-channel application load testing and monitoring. That is, applications consisting of multiple systems that are interconnected through web services and other interfaces. These are today’s large systems with multiple channels – mobile, browser, interactive voice response, fax, web services, and others. This presentation will focus on the unique challenges of integrated load testing with all the systems together. What are these challenges? The first is planning and coordination of tests across multiple teams and organizations. The second is monitoring, collection, and analysis of metrics across multiple applications and tools. Learn the various tools that are used in a complex integrated load test environment for load generation and monitoring. Discover the challenges that arise while executing these load tests and the techniques for addressing them. Finally, learn about the techniques for combining data from various monitoring tools into meaningful and actionable information.

Akemi Micallef, TEKSystems

Workshop: Growing QA Skills

Friday, April 19, 2013: 2:15 PM - 3:30 PM

Workshop Leader:

QA has a unique position in IT as the bridge between business and technology. Today, QA is expected to address quality at earlier stages of code construction and use appropriate tools and techniques to tackle each architectural layer effectively. Relying solely on their business expertise is no longer enough. But, how do you grow your QA team’s skills while maintaining the ever-increasing workload? Join Akemi in this interactive workshop that will help consolidate all the learning from this conference into an action plan to grow your team’s QA skills. Explore the skills required from the effectiveness, efficiency, and economy points of view helping to articulate the value of QA to your upper management to gain support for skills development. Learn the common personality traits of QA professionals to understand how they learn and what motivates them. Akemi will discuss key elements such as learning styles, knowledge sharing, creating an environment of learning, turning knowledge into ability, and leveraging newly acquired skills.

  • Learn the skills required for today’s QA
  • Examine the QA learning profile
  • Build a model-based action plan for skills development initiatives