The Ultimate Guide to Choosing WordPress Pros and Cons
HBT Solution - Part 3 of 6
1. BETTER DEFINITION OF QUALITY
LEVELS AND TEST ADEQUACY
M C Nagaraj
Director – Customer Excellence
in.linkedin.com/in/mcnagaraj
2. Hypothesis Based Testing (HBT)
A goal focused methodology to validation
Six-stage evaluation model (S1-S6)
S6 S1
Assess & Understand The central theme of HBT is
ANALYZE EXPECTATIONS “hypothesize potential defects that
can cause loss of expectations
and
S5 Tooling HBT
Understand
S2 prove that they will not exist”
SUPPORT CONTEXT
Devise Formulate The focus is on the goal and
PROOF HYPOTHESIS
how we shall achieve it
rather than the various activities
S3 S3
“goal-centric vs. activity-based”
Copyright STAG Software Private Limited, 2009 2
3. HBT and STEM
“outcome”
‘deliver clean software
S6 S1 GOAL quickly & cost-effectively’
Assess & Understand
ANALYZE EXPECTATIONS
D8 D1
Tooling D7 D2
S5
SUPPORT
STEM Understand
S2 “methodology”
D6 D3 CONTEXT
HBT a system of ways of doing
D5 D4
‘goal centered scientific
approach to validation’
Devise Formulate
PROOF HYPOTHESIS
S3 S3 “method”
STEM
a particular way of doing something
‘defect detection technology
from STAG’
Copyright STAG Software Private Limited, 2009 3
4. HBT - six stages effectiveness guaranteed
• Key focus in each stage
• Empowered by scientific approach using eight
disciplines (D1 to D8) of STEM
• 32 core concepts address factors like effectiveness,
consistency, scalability, efficiency, visibility and
agility of test methodology
• The outcome of each stage are well defined
Copyright 2011. STAG Software Pvt Ltd. All rights reserved. 4
5. HBT Stage 4 (Devise Proof) - Part 1
Key focus: Staged quality, Test assets organization,
STEM discipline D3 (Test strategy and planning)
Problems addressed:
• Defects are uncovered late in life cycle delaying the release
and impacting revenue plan
• Specialization in specific types of test for an individual will
help but focus is missing
• Poor estimation resulted in cost over run in many projects
• Test execution taking more time and money but unable to
show ROI (Return on investment)
Copyright 2011. STAG Software Pvt Ltd. All rights reserved. 5
6. HBT Stage 4 (Devise Proof) – Part 2
Key focus: Test design techniques, Test case
architecture, STEM discipline D4 (Test design)
Problems addressed:
• Test design is evolving and test cases are added continuously till the end
of project resulting in re-planning many times
• Test design phase taking significant time
• Defect escapes are traced to poor design quality
• Unable to demonstrate adequacy of test assets
• There is a feeling that tests are more conformance oriented (+ve only not
robust)
• Test cases attributes captured not helping in prioritizing during execution
and selection for automation focus
Copyright 2011. STAG Software Pvt Ltd. All rights reserved. 6
7. Summary
Using D3 (Strategy & Planning) and D4 (Test design), we were
able to address problems stated in previous slides
• Each of the above discipline has well defined steps
• Key deliverables: Test strategy, Test plan, Test
scenarios/cases, Fault traceability matrix, Requirement
traceability matrix
• STEM core concepts: Orthogonality principle, Tooling needs
assessment, WBS, Quality growth principle, Techniques
landscape, Process landscape, Cycle scoping, Reduction
principle, Input granularity principle, Box model, Behavior
stimuli approach, Complexity assessment, Operational
profiling, Test coverage evaluation
Copyright 2011. STAG Software Pvt Ltd. All rights reserved. 7
8. Thank You
M C Nagaraj
in.linkedin.com/in/mcnagaraj
@mcnagaraj
Copyright STAG Software Pvt. Ltd., 2011