Professional Documents
Culture Documents
My Background
Career
Co-founder, Code71, Inc. 13+ years of total experience Co-author of Enterprise Java with UML
Expertis e
Iterative incremental development Technology planning and architecture On-shore/Off-shore software development using Agile/Scrum Cultural aspect of self-organizing team Scrum for projects delivered remotely Agile engineering practices
Copyright 2004-2008 Code71, Inc.
2
Interes ts
www.Code71.com
www.ScrumPad.com
Agenda
www.Code71.com
www.ScrumPad.com
What to Expect
Context Teams and organizations are adopting Agile/Scrum Teams struggle with making the transition from waterfall to Agile/Scrum
Focus
Build common base of understanding Develop a set of gudielines- process, roles, and team composition Address typical questions asked
Key Takeaways
www.Code71.com
www.ScrumPad.com
Agenda
www.Code71.com
www.ScrumPad.com
The challenges?
Is QA part of the development team? Can we fit QA in the same iteration as development? Who does QA? Does QA costs more in Agile as product seems to change from sprint to sprint? How can we scale Agile QA? Do we need test plan? Who defines test cases? Are story acceptance tests enough? When do we know testing is done? Do we need to track bugs?
www.Code71.com
Copyright 2004-2008 Code71, Inc.
6
www.ScrumPad.com
How?
www.Code71.com
www.ScrumPad.com
Types of Testing?
White Box
Unit Testing
Integration Testing
Acceptance Testing
Load Testing
Smoke Testing
www.Code71.com
www.ScrumPad.com
Who? Developer Developer Tester Developer/Tester Client/Users Tester/Support Engineer Performance Engineer
Copyright 2004-2008 Code71, Inc.
9
www.ScrumPad.com
System Testing Regression Testing Acceptance Testing Smoke Testing Load Testing
www.Code71.com
www.ScrumPad.com
What is missing?
1. Right Spec Assumptions 2. Right Design 3. Right amount of Tests 4. Right Tests Reality? Assumptions are farther from truth
Team Composition?
region Dev 1 Test Prod region Dev 2 Test Prod iteration 1 1 1 2 2 2 3 3 In-Cycle iteration 1 2 1 3 2 1 3 2 Out-of-Cycle
www.ScrumPad.com
Team Dynamics
Developers
www.ScrumPad.com
Quality Funnel
Backlog Review Design Review Unit & Int. Test, CI Code Review System Test
bugs
QG#1 bugs
QG#2
QG#3
QG#4
QG#5
www.Code71.com
www.ScrumPad.com
Agenda
www.Code71.com
www.ScrumPad.com
Test Coverage
Definition A measure of the proportion of a program exercised by a test suite, usually expressed as a percentage.
Measure
Tests coverage metrics can tell you what code is not tested
Copyright 2004-2008 Code71, Inc.
16
www.Code71.com
www.ScrumPad.com
Report
Build
Regression Test
Test Coverage
www.Code71.com
www.ScrumPad.com
normal
hot
high
low
cold
warm
low
www.Code71.com
www.ScrumPad.com
Quality Metrics Bug count per iteration Bug count per module Bug count per function point
www.Code71.com
www.ScrumPad.com
How to Scale?
www.Code71.com
www.ScrumPad.com
Agenda
www.Code71.com
www.ScrumPad.com
A Case Study
Project A large enterprise system that includes technologies like ASP.Net, BizTalk, Workflow, Scanning, SQL Server, Data Warehouse, and Mainframe 2 product owners, 1 scrum master, 1 architect, 5 developers, 1 QA tester
Team
Sprint
2 weeks
Day 1, 2 Day 3, 4 Day 5-8 Day 9 Day 10
QA Process
www.Code71.com
www.ScrumPad.com
Agenda
www.Code71.com
www.ScrumPad.com
Recap
In-cycle QA is critical to the success of a project
System testing is not the only quality gate, it includes all types of testing and reviews
www.Code71.com
www.ScrumPad.com
Recap contd.
All known bugs should be fixed first
Right size story with well-thought out acceptance tests improves quality
Analyze each bug to understand where (Quality Gate) it should have been caught and improve (Inspect and adapt)
www.Code71.com
www.ScrumPad.com
Q&A
QA is making sure right software works right QA is not an act, but a habit
www.Code71.com
www.ScrumPad.com