Revolution, Evolution and Lean Experiences on Test Process
Improvement
Tapani Aaltio, Sogeti Finland
[email protected]
June 5, 2012
Revolution
R
a drastic and far-reaching change in ways of thinking and behaving
Source: wordnetweb.princeton.edu
Eugène Delacroix - La liberté guidant le peuple, 1833. ( Liberty Leading the People)
2
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean
Agile Test Process?
TMap Test Process
Ctrl
Plan
Prep
Spec
Infra
Exec
Comp
wish, legislation, policy,
opportunity , problem
V-Model
operation &
management
requirements
acceptance
tests
Scrum Cycles
functional
Design
technical
design
input for
realisation
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean
system
tests
development
tests
The Project
 The system
 Identity management: register, sign-in, sign-out, profile management, sso
 Used by around 50 services with 150 million users
 No downtime, response times under 1 sec
 People
 Pool of 25 people, three scrum teams
 Developer:tester -ratio 1:1
 Testing





”Manual testing is our worst enemy”
3000 automated unit and integration tests
1000 automated black box tests
Test automation framework based on Ruby/Watir, built by the team
Manual integration testing and acceptance testing with customers
 Scrum
 Sprint cycle two weeks, release cycle 4-6 weeks
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean
The Seven Wastes of Lean Management
Overproduction
Waiting
Unnecessary inventory
Transporting
Inappropriate processing
Excess motion
Defects
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean
How to Estimate Effort Without Creating Waste?
Planning poker
 Estimate complexity of
backlog items
 Fast way to create a
common understanding
among the team
 Used to measure the
velocity of the team
 Testers participate on day
one
Overproduction
Inappropriate
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean
processing
Applying Good Practices “Just in Case” Is Waste
 Prioritizing test cases
 Linking requirements
to test cases
 Linking test cases to
defects
Overproduction
Inappropriate
processing
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean
Manual Testing and Manual Reporting Are Waste
 Manual testing is our worst
enemy
 Test levels are concurrent,
not back-to-back
 Instant, continuous
feedback and reporting
 Creating test reports
manually is waste
Inventory
Overproduction
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean
Defect Management is Waste!
Tester
Tester
Nieuw
New
Throw it in
the cloud!
BO
DC
Onderzoek
Analysis
Toegewezen
Assigned
Niet
Not
opgelost
solved
Postponed
Uitgesteld
Afgewezen
Rejected
Andere
Other
oplossing
solution
Oplosser
Solver
Defects
Solved
TM
TM
= Status
In
Inhertest
re test
Hertest
Re test
niet
not ok
ok
Tester
Tester
= Person/ meeting who
adjusts the status
TM = Test manager
Hertest
Re test ok
Instead of this…
Developer
Tester
Inappropriate
processing
Create a test case to demonstrate
Excess motion
a failure, work together!
Overproduction
Waiting
Inventory
Transporting
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean
Evolution
A process in which something passes by degrees to a different
stage (especially a more advanced or mature stage) Source: wordnetweb.princeton.edu
Evolution of species
Evolution of scrum teams
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean
How to Apply Revolution and Evolution?
Have the courage to change, don’t be blown away by the revolution.
Don’t be afraid of bad ideas - you might block fantastic ideas!
Overproduction
Waiting
Unnecessary inventory
Transporting
Inappropriate processing
Excess motion
Defects
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean