DEV337

Software Testing with

Microsoft Test Manager
2012 and Lab
Management
Brian Keller
Sr. Technical Evangelist
Microsoft Corporation

I work here

on this

and this.

http://bit.ly/ThisWeekC9

I blog here:
http://blogs.msdn.com/briankel

http://tinyurl.com/ALM2010Book

http://tinyurl.com/TFSBook

Agenda
Manual Testing
Formal Test Case Management
Exploratory Testing

Lab Management
Standard Environments
Build-Deploy-Test Workflows

Tracking Quality

USS Yorktown, SmartShip

crew member entered 0 in a data
entry field, caused a divide by 0
error that shut down propulsion
dead in the water for 2hrs 45mins

Ariane 5 Flight 501

re-used code from Ariane 4, but
took a different flight path because
of different booster design
conversation from 64bit float to
16bit signed int caused overflow
(exception handler was disabled
for perf reasons)
cost: > $370 million @ 1996 prices

Vasa
sank after sailing less than 1
nautical mile out of Stockholm
specifications were faulty, failing
to take into account enough
ballast to keep the ship upright
test teams revealed that it was
unstable, but launch was rushed,
and QA was ignored

Conditioning

Training

Training Phase

Cost of Failure

Climbing

Test

Development

Software Phase

Cost of Bugs

Release

Tester Segmentation
Generalist
Manual Testing

70% of testing
here

Specialist
Some scripting
Creates scripts
to set up lab,
happens
create data

Strong
scripting skills

Strong coding

Expert
coding skills

Develops
Some
automated
majority
of testtesting
tools target
coding skills
here
procedures

Black Box Testing

White Box Testing
API Testing

What usually happens when a tester

finds a bug?

Graphic by Jeff Atwood (CodingHorror.com)

Visual Studio

demo
Microsoft Test Manager
2012

Manual Testing Improvements

Exploratory Testing
Rich text test steps
HTML5 automation
Metro style application testing
Pass / Fail tests from Test Activity

Environments
SCVMM Environment
Build-Deploy-Test
Snapshot / Restore
Share Bug Snapshots
Network Fencing
3rd Party Virtualization
Physical Machines

Standard Environment

demo
Lab Management

Lord Kelvin, 1824-1907

you cannot manage

what you cannot measure.

 I N T E R N A L O N LY

 I N T E R N A L O N LY

 I N T E R N A L O N LY

 I N T E R N A L O N LY

 I N T E R N A L O N LY

 I N T E R N A L O N LY

Go get started!
Download the RC:
www.microsoft.com/VisualStudio/11
Download the ALM VM: http://aka.ms/VS11ALMVM
Ask the Experts, TLC area

tfspreview.co
m

Related Content
Breakout Sessions
DEV214 Introducing the New Visual Studio 2012 Unit Testing Experience
DEV344 Developer Collaboration with Team Foundation Server 2012
AAP309 Making Agile Estimation Work
DEV337 Software testing with Microsoft Test Manager 2012 and Lab Management
DEV317 Going Beyond F11: Debug Better and Faster with Visual Studio 2012
DEV340 Taking ALM to the Cloud with the Team Foundation Service
AAP313 Scrum Under a Waterfall
DEV362 From Development to Production: Optimizing for Continuous Delivery
DEV363 Dev-Ops Best Practices on the Microsoft Stack
DEV212 Implementing Scrum Using Team Foundation Server 2012

Related Content
Breakout Sessions
DEV346 All Aboard the Team Foundation Server Express
DEV217 Deep Dive into the Team Foundation Server 2012 Agile Planning Tools
DEV365 Advanced IntelliTrace in Production with Visual Studio 2012
DEV316 Application Lifecycle Management Tools for C++ in Visual Studio 2012
DEV343 Implementing Team Foundation Server in the Enterprise
DEV321 Continuous Feedback in Agile Teams
DEV243 Demystifying Team Foundation Server Builds
DEV411 Testing Un-testable Code with Fakes in Visual Studio 2012
DEV410 Deep Dive into Team Foundation Server 2012 Reporting
DEV412 Identify and Fix Performance Problems with Visual Studio 2012 Ultimate
DEV345 The Accidental Team Foundation Server Admin

Related Content
Breakout Sessions
DEV318 Working on an Agile team with Visual Studio 2012 and Team Foundation
Server 2012
DEV339 Metrics That Matter: Improving Lean and Agile, Kanban and Scrum
AAP204 Introduction to Kanban

Hands-on Labs (session codes and titles)

DEV11HOL
DEV12HOL
DEV13HOL
DEV16HOL
DEV17HOL
DEV19-

Agile Project Management in Team Foundation Server 2012

Build the Right Software and Collaborate Effectively Using Storyboarding and Feedback
Tools in Visual Studio 2012
Using IntelliTrace with Production Systems to Quickly Diagnose and Fix Issues
Learn How Microsoft Test Manager 2012 Will Embrace an Exploratory Testing Approach
Explore the New Unit Testing and Code Clone Capabilities of Visual Studio 2012
Discover How the New Features of Team Foundation Server 2012 Can Improve

DEV Track Resources

Visual Studio Home Page :: http
://www.microsoft.com/visualstudio/en-us
Somasegars Blog :: http://blogs.msdn.com/b/somasegar/
Jason Zanders Blog :: http://blogs.msdn.com/b/jasonz/
Facebook :: http://www.facebook.com/visualstudio
Twitter :: http://twitter.com/#!/visualstudio

Resources
Learnin
g
Connect. Share. Discuss.

Microsoft Certification & Training Resources

http://northamerica.msteched.com

www.microsoft.com/learning

TechNe
t
Resources for IT Professionals

http://microsoft.com/technet

Resources for Developers

http://microsoft.com/msdn

Complete an evaluation on CommNet and enter to

win!

MS Tag

Scan the Tag

to evaluate this
session now on
myTechEd
Mobile

 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to
be a commitment on the
part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS
PRESENTATION.