Wincor Nixdorf International GmbH
Banking Division Application Software
Solution Quality Assurance
Heinz-Nixdorf Ring 1
D-33106 Paderborn
www.wincor-nixdorf.com
Sascha Koch
Dipl. Inf.
Engineer Test & Quality
Telefon
Fax:
(0 52 51) 693 – 37 15
(0 52 51) 693 – 36 19
E-Mail: [email protected]
Practical QA in a Nutshell
Notions of a testing fellow
Introduction
Table of Contents
Practical QA in a Nutshell
•
•
•
•
Motivation
QA from the Developers Point of View
QA from the Testers Point of View
Conclusion
Introduction
V-Modell
Testers
Practical QA in a Nutshell
System
Test
Validate
Requirements
Validate
Design
Implementation
Integration
Test
Unit Test
Validate
Developers
QA – Developers Point of View
Test Driven Development
Practical QA in a Nutshell
• Set of different techniques (XP)
• Fast feedback, flexibility, clean code
• Result in simple design and tests
Test fails
few minutes
Refactor
Test succeeds
QA – Developers Point of View
Test Driven Development II / JUnit
%
% & '"
(
Practical QA in a Nutshell
*
)
"
!
+
"
"
#
#
$ "
#
%
(
% (
%
(
% (
% (
-%
*
" #
#
#
#
.
/
22
,
01
/
0
01
"
$0
+
"
#
#
)
)
QA – Developers Point of View
Test Driven Development III / JUnit
Practical QA in a Nutshell
3
! !!4
0
0
5 %
6
8
%
)% (
%
6
%
:
9
07 )%
%
(
! ;* !:
%
(
%
3.<=,
07
+>>>
?1
3
01
%
!
QA – Developers Point of View
Continous Integration
Problem: Integration is painful!
Solution: Integrate more often.
Automated project builds
OS projects:
Check Out
Repository
Practical QA in a Nutshell
•
•
•
•
Build
Generate
Report
Run Tests
QA – Developers Point of View
Refactoring
Practical QA in a Nutshell
•
•
•
•
•
Change a design in small steps
Behaviour remains the same (hopefully)
Remove duplicate code
Benefit is a more simple design
More than 90 patterns available
QA – Developers Point of View
Best Practices
Practical QA in a Nutshell
•
•
•
•
•
•
•
Coding Standards
Integrated Development Environment (IDE)
Design Patterns
VCS and/or CMS
UML/Case Tools (when introduced)
Detailed Specification of Requirements
Frameworks and Code Generator
QA – Testers Point of View
Test Planning
• Testplans
Practical QA in a Nutshell
– Prerequisites, expected results, actual result
• Testconcept
– What to test, end of tests
• Quality report
Requirements
Specification
Testplans
Testconcept
Design
Document
Coding
Testing
Quality
Report
QA – Testers Point of View
Test Excecution
Practical QA in a Nutshell
• Bug tracking (e.g. Bugzilla)
• Tests
–
–
–
–
–
Smoke test (Installation, Quick start)
Functional tests (Detailed tests)
Regression tests (Which tests?)
Load tests (Check for leaks, stability)
Performance tests (Requirements)
• ‚Value‘ of a test measured in BPM
QA – Testers Point of View
Test Analysis
Practical QA in a Nutshell
• Check the log files
• Provided tools
• Complete suites like Borland OptimizeIt
(tm) or Quest JProbe(tm)
• Compute metrics
– # of Bugs, Bugs/LOC
– Test coverage, open tests, failed tests
QA – Testers Point of View
Test Analysis II – Borland OptimizeIt (tm)
Practical QA in a Nutshell
Surreptitious advertising!!!
QA – Testers Point of View
Test Automation
Capture
EJB Container
TCP/IP
Web Container
Replay
TCP/IP
EJB Container
Capturing
(Proxy)
Replay
Web Container
Client
Practical QA in a Nutshell
• Concentration on Black Box tests
• Simulators, The Grinder, JMeter
• Test results must be available
QA – Testers Point of View
Test Automation II – JMeter / The Grinder
Practical QA in a Nutshell
QA – Testers Point of View
End of Testcycle
• Defined in the testconcept
Practical QA in a Nutshell
– All defined tests are accomplished
– No more errors exist
– Full code coverage
Risk = Probability * Amount of loss
(Rayleigh Equation)
Found errors
(http://www.globaltester.com/)
Conclusion
Fazit
Practical QA in a Nutshell
• Development and testing move together
• Testautomation becomes more important
• A lot of tools available
„We are what we repeatedly do.
Excellence, then, is not an act, but a
habit.“ -- Aristotle BC 384-322
Conclusion
Links
Practical QA in a Nutshell
General
• http://www.globaltester.com
• http://www.qaforums.com
• http://www.professionaltester.com
Agile Testing
• http://www.junit.org
• http://www.testdriven.com
• http://www.refactoring.com
Test Companies (Publications)
• http://www.oio.de
• http://www.sqs.de
Continous Integration
• http://cruisecontrol.sf.net
• http://gump.apache.org
• http://www.urbancode.com/projects/
anthill/
Code Coverage
• http://hansel.sf.net
• http://www.scoopgmbh.de/scoop/downloads.htm
Test Automation
• http://jakarta.apache.org/jmeter
• http://grinder.sf.net
Conclusion
Thank you
Practical QA in a Nutshell
Thank you very much for your attention!