IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
HBT Solution - Part 6 of 6
1. ASSESS, ANALYZE AND MANAGE
STAKEHOLDERS EXPECTATIONS
BETTER
M C Nagaraj
Director – Customer Excellence
in.linkedin.com/in/mcnagaraj
2. Hypothesis Based Testing (HBT)
A goal focused methodology to validation
Six-stage evaluation model (S1-S6)
S6 S1
Assess & Understand The central theme of HBT is
ANALYZE EXPECTATIONS “hypothesize potential defects that
can cause loss of expectations
and
S5 Tooling HBT
Understand
S2 prove that they will not exist”
SUPPORT CONTEXT
Devise Formulate The focus is on the goal and
PROOF HYPOTHESIS
how we shall achieve it
rather than the various activities
S3 S3
“goal-centric vs. activity-based”
Copyright STAG Software Private Limited, 2009 2
3. HBT and STEM
“outcome”
‘deliver clean software
S6 S1 GOAL quickly & cost-effectively’
Assess & Understand
ANALYZE EXPECTATIONS
D8 D1
Tooling D7 D2
S5
SUPPORT
STEM Understand
S2 “methodology”
D6 D3 CONTEXT
HBT a system of ways of doing
D5 D4
‘goal centered scientific
approach to validation’
Devise Formulate
PROOF HYPOTHESIS
S3 S3 “method”
STEM
a particular way of doing something
‘defect detection technology
from STAG’
Copyright STAG Software Private Limited, 2009 3
4. HBT - six stages effectiveness guaranteed
• Key focus in each stage
• Empowered by scientific approach using eight
disciplines (D1 to D8) of STEM
• 32 core concepts address factors like effectiveness,
consistency, scalability, efficiency, visibility and
agility of test methodology
• The outcome of each stage are well defined
Copyright 2011. STAG Software Pvt Ltd. All rights reserved. 4
5. HBT Stage 6 (Assess and Analyze)
Key focus: STEM discipline D7(Execution and defect
reporting), D8(Test Management)
Problems addressed:
• Unable to plan test execution properly resulting in high cost of execution
• Unable to set criteria for quality gates (no ownership for uncovering
different defect types)
• There is no test case attributes defined to choose and prioritize tests
• Significant percentage of defects not traced to test case (no update to
test case from learning from the context)
• Cycle scoping seems not working (more test cycles than planned)
• Our estimation and actual effort show big gaps
• Risk management is weak
Copyright 2011. STAG Software Pvt Ltd. All rights reserved. 5
6. Summary
Using D7 (Execution and defect reporting ), D8(Test
management) we were able to address problems stated in
previous slides
• These discipline has well defined steps
• Key deliverables: Execution status report, Defects, Updated
test scenarios/cases, Key observations/learning, Test plan,
Progress report, Cleanliness status report
• STEM core concepts: Contextual awareness, Defect rating
principle, Defect centered activity breakdown, Gating
principle, Cycle scoping
Copyright 2011. STAG Software Pvt Ltd. All rights reserved. 6