CONFIDENTIAL

Espire Infolabs

Document
Date SILK TEST

This report is solely for the use of client personnel.  No part of it may be 
circulated, quoted, or reproduced for distribution outside the client 
organization without prior written approval from McKinsey &  Prepared By Pooja Sethi
Company. This material was used by McKinsey & Company during an 
oral presentation; it is not a complete record of the discussion.
SilkTest
Unit of measure Architecture

* Footnote
Source:Sources 2/7
 SilkTest QA Methodology
Unit of measure

Plan Phase
•Use SilkTest projects to store information about
your testing process
•Define specific tests and determine testing
strategies
•Create a test plan
- Testplan Overview
- Testplan Detail
* Footnote
Source:Sources 3/7
Capture
Unit of measure Phase

•Learn about the application

•Visit each window
•Build a frame file
•Capture windows
•Create application states

Create Phase
•Create automated testcases
* Footnote
Source:Sources 4/7
Run Phase
Unit of measure

•Select and execute specific tests

•Generate results
Report Phase
•Summarize progress and defects
•Produce a Pass/Fail report

* Footnote
Source:Sources 5/7
Track Phase
Unit of measure

•Track defects
•Perform regression testing

* Footnote
Source:Sources 6/7
SilkTest
Unit of measure File Types

* Footnote
Source:Sources 7/7
SilkTest
Unit of measure Projects

•Can be created through File/New Project

•Organize all the resources associated with a test set, such as testplans,
scripts, data, options sets, .ini files, results and frame/include files
•Store relevant information about your project, including configuration
information, editor settings and data files for attributes and queries at the
project level
•Allow you to add appropriate files to your project

* Footnote
Source:Sources 8/7
Project Explorer
Unit of measure

•Is used to view and access all the resources in a SilkTest project
•Makes it easy to access files that have been added to the project
•Allows you to open a file by double-clicking it
•Presents the resources within each project visually, making them easier
to see, work with and manage
•Contains two tabs: Files and Global

* Footnote
Source:Sources 9/7
Files Tab
Unit of measure

•Lists all of the files included in the project

•Allows you to view, edit, add and remove files from the project
•Provides (via right-click) menu options for each of the file types, such
as Record Testcase and Run Testcase for a file contained in the Script
folder

Note:*You cannot move files within the Project Explorer. For example, you
Footnote
cannot drag a script file to another node 10/7
Source:Sources
Global Tab
Unit of measure

•Displays at a global level all the resources, for the open project, such as
testcases, functions and classes
•Allows you to double-click an object to open the file in which the object
is defined and position the cursor at the beginning of the first line of the
double-clicked object

* Footnote
Source:Sources 11/7
The Basic Workflow Bar
Unit of measure

•Allows you to create a new project or open an existing project

•Helps you to automatically enable and test extension settings
•Assists you in configuring the recovery system
•Leads you through the process of recording a testcase
•Allows you to run a testcase

* Footnote
Source:Sources 12/7
Unit of measure
Enable Extensions
Extensions enable SilkTest to recognize specific objects native to the
environment in which the Application Under Test resides. Extensions
must be set up prior to beginning the test development process

Recovery System
Base State returns the application to its starting point before running a
testcase, during a testcase, if an error occurs; and after testcase
completion

Record Testcase
•Displays the Record Testcase dialog which is used to create a testcase
•Allows you to record the actions that you perform against the
Application Under Test so that these can be played back at a later time
•Stores recorded instructions in the specified
* Footnote script file
Source:Sources 13/7
Unit of measure
Run Testcase
•Displays the Run Testcase dialog
•Is used to run any testcase in the active script file
Note: You may also run all testcases by pressing F9 or the button
located on the tool bar

Stopping a Testcase
To stop a script or testcase from running:

Select Run/Abort or press both shift keys simultaneously

* Footnote
Source:Sources 14/7
The Frame File
Unit of measure

•Is a central, global repository of information pertaining to your

application, including:
- data structures that support your test scripts, including window
declarations, constants, variables
- application states, as well as user-defined methods and functions
•Can be viewed by double-clicking the file listed under the
Include/Frame node in the Project Explorer window
•Provides the means to create logical descriptions (identifiers) for all
objects in an application
•Is written in the 4Test scripting language and can be edited through use
of the 4test Editor
•Uses indentation to indicate relationships between objects
•Assigns distinct colors to the various15/7
* Footnote types of editor items
Source:Sources
Unit of measure

Note:* Only one frame file is needed for an Application Under Test
Footnote
Source:Sources 16/7
A Testcase
Unit of measure

•Is a sequence of commands that simulate a user interacting with an

application
•Resides in a 4Test script (.t) file

* Footnote
Source:Sources 17/7
Testcase
Unit of measure Results File

•Is automatically generated by SilkTest

•Has the same name as the executed script, frame or testplan, but with an
.res extension
•Provides information about the execution of the testcase, script or
testplan:
- Statistics at each level, including number of testcases run, number of
errors and pass/fail ratio
- Performance data, including start, stop and elapsed times
- Clear identification of passed versus failed testcases
- Information about any error(s)
•Is a generation data set containing results history for script, frame or
testplan
- Default history size is 5
- History size can be modified through the Runtime Options
* Footnote
Source:Sources 18/7
Capturing
Unit of measure States in an Application
Base State
•Is the known, stable state that you expect the application to be in before
each testcase is executed
•Is typically the state that the application is in just after being started
•Has two components:
- Default Base State
- User-Defined Base State Method

Note: The Default Base State will look for and automatically execute a
User-Defined Base State Method.
Note: Each application will have only one base state.
* Footnote
Source:Sources 19/7
Default Base State
Unit of measure

•Is established when you create a new test fame to capture your
application
•Ensures that:

•Uses the value of the constant sLocation, as stored in the first (main)
window declaration in the frame file, to determine which application
window should be loaded
* Footnote
Source:Sources 20/7
Unit of measure
User-Defined Base State Method
•Allows you to enhance your application's default base state
•May be useful for:
- Adding specific data to a field on the Default Base State page
- Changing browser options such as memory and file cache to give you a
fresh start at the beginning of each new test
•Is an addition to the Default Base State; not a replacement for the
Default Base State

* Footnote
Source:Sources 21/7
Unit of measure

* Footnote
Source:Sources 22/7
Unit of measure
An Application State
•Is a state that you want your application to be in at the start of a given
testcase
•Is based on either Default Base State or another application state
•Reduces redundant code in your 4Test script and makes the code easier
to maintain
•Makes a testcase easier to record
•Ensures consistency in driving the application to the test state
•Is normally defined in the frame file

Note: It is a good practice to test each application state as it is created.

* Footnote
Source:Sources 23/7
Allows you to reuse existing application states to:
Unit of measure

- Save effort
- Modularize your routines
- Reduce maintenance

* Footnote
Source:Sources 24/7
Unit of measure
Window Declarations
•Describe a window and all of its child objects; recorded window
declarations will capture all child objects
•Separate the physical page (which may change with each new build)
from its logical operation (which will generally remain unchanged)
•Specify logical names for all objects on a page – these names
(identifiers) will be used regardless of platform or browser
•Are added to the active frame file
Note: In general, all Web application pages and their respective objects
should be declared before creating test scripts

* Footnote
Source:Sources 25/7
Creating
Unit of measure
and Running Testcases
Record Testcase
•Displays the Record Testcase dialog which is used to create a testcase
•Allows you to record the actions you perform against the application
under test so that these can be played back at a later time
•Stores recorded instructions in the specified script file

* Footnote
Source:Sources 26/7
A Testcase
Unit of measure

•Is an automated test that tests one objective of a testplan

•Drives an application to the state where the test will be performed
•Verifies whether the application works as expected
•Resides in a 4Test script file
•Performs two fundamental tasks:
- Drive the application to the state to be tested
- Verify that the actual state matches the expected state

Note: Each test description in a testplan will be implemented by one

testcase. Each testcase verifies one test objective
Note: No script or testcase should rely on the successful completion of a
previous script or testcase. Each testcase should be independent of
* Footnote
Source:Sources 27/7
Testcase Structure
Unit of measure

* Footnote
Source:Sources 28/7
Unit of measure
Record Testcase

* Footnote
Source:Sources 29/7
Unit of measure

Note: Selecting Paste testcase and update window declaration(s)

assures that any objects your testcase interacts with will be defined in
the window declaration
* Footnote
Source:Sources 30/7
When a Testcase Fails
Unit of measure

Testcase Failures
Occur when:
- The object you are testing does not meet verification requirements
- The application has changed and the commands in the testcase are no
longer valid for the application
- A window or message box appeared that your testcase was not
expecting

* Footnote
Source:Sources 31/7
SilkTest Recovery System
Unit of measure
•Is designed to automatically restore the application to a known state
after an unexpected error
•Ensures that each testcase begins with the application in its base state
before executing any application states
•Supports automated, unattended tests so that tests can be run after hours
•Makes sure that a failed testcase does not prevent subsequent testcases
from running
•Manages unexpected events in the application and aids in ensuring
reliable results
•Logs warnings and errors

* Footnote
Source:Sources 32/7
Unit of measure
How SilkTest Handles Verification Failures
1. An error is raised by SilkTest
2. SilkTest stops running the testcase and passes control to the recovery
system
3. The recovery system logs the error to the results file
4. SilkTest executes the next testcase

* Footnote
Source:Sources 33/7
The Results File
Unit of measure

* Footnote
Source:Sources 34/7
Unit of measure
Extract Results

- Window displays the results in a SilkTest window - without Special

characters such as and so on
- File opens a Save dialog, allowing you to save the list to an ASCII
(.TXT) file
- Printer opens a Print dialog, allowing you to print the list to an installed
printer
* Footnote
Source:Sources 35/7
Revisiting
Unit of measure
the Workflow Bar

Open Project
- Open an existing project
- Auto Generating a New Project

Enable Extensions

* Footnote
Source:Sources 36/7
Data Driven Testcases
Unit of measure

•Let you store data combinations in a list of items and invoke the
testcase once for each item passing the data to the testcase as a parameter
•Can be associated with an external data source such as a spreadsheet,
file or database
•Can be executed against a specified set of records in a data source
•Are executable either from the script file or from a testplan
•Are also referred to as generalized testcases
•Can be created in one of two ways:

- Standalone technique

- Data Driven Workflow technique

* Footnote
Source:Sources 37/7
Unit of measure
Standalone Technique
•Offers three methods for passing data to a data driven testcase

- Run/Testcase Dialog Method: select Run/Testcase and type the

record data into the Run Testcase dialog

- Testplan Method: in a SilkTest testplan, insert the record data as a

testcase statement

- External File Method: if the data exists in an external file, write a

data function to read the file and use a main function to run the data
function

* Footnote
Source:Sources 38/7
Unit of measure
External File Method
•Uses the same testcase format as any record driven testcase
•Uses data stored in an external file instead of from a testplan
•Needs a data function to parse the data from an external file
Note: Because the data is stored externally, a function may be created to
read the data and run the testcase

* Footnote
Source:Sources 39/7
Unit of measure
A Standard Testcase
•Is limited in its usage as the data is coded directly into 4Test statements
•Can be converted into a data driven testcase because it has data and data
types which can be stored in a record format

A Record

•May contain any number of fields, which may be of different data types
•Must be declared outside a function
* Footnote
Source:Sources 40/7
Unit of measure
Data Driven Testcase

•Is associated with an external data source such as a flat file, spreadsheet
or database
•Can be executed against a specified set of records in a data source
* Footnote
Source:Sources 41/7
Unit of measure
An External Data File

•Holds data that is stored in a record format

•Contains the data to be read during the testing scenario

* Footnote
Source:Sources 42/7
A Data
Unit Function
of measure

•Is created to parse the data

from an external file
•Will be used within a five
step process to:
1) Declare a variable for the
external file
2) Declare a variable to hold
an instance of a record in the
file
3) Open the file
4) Read the file and run the
testcase for each set of data
5) Close the file
Note: FileReadValue returns a TRUE when it reads a record and returns a
FALSE when it encounters end of file 43/7
* Footnote
Source:Sources
Data Driven Workflow Technique
Unit of measure

* Footnote
Source:Sources 44/7
Unit of measure
Error Handling
•The recovery system scripts are located in defaults.inc, which is in the
directory where you installed SilkTest.
•You can write functions that override some of the default behavior of
the recovery system.
•You may want to handle errors locally and log errors and warnings in
the results file under script control.
•When a testcase uses its own error handling logic that does not call the
recovery system, it can pass, even though an error has occurred

* Footnote
Source:Sources 45/7
Unit of measure
4Test statements used to handle or raise exceptions

* Footnote
Source:Sources 46/7
Unit of measure
Options Set
•Is a file that contains settings to run SilkTest
•Must be opened in order to be used in your project
•Can be identified as the one that is currently loaded when its name
appears in the SilkTest title bar
•Can be passed along to other team members to ensure consistency in the
testing process

* Footnote
Source:Sources 47/7
Unit of measure
Set Recovery System
•Is used to identify the starting point (Base-State) of the application you
are testing
•Updates the Use Files field on the Runtime Options dialog with the path
to the executable for the application

Note: The Recovery System will return your application to its BaseState,
before running a testcase, during a testcase if an error occurs and after
a testcase completes.

* Footnote
Source:Sources 48/7
Unit of measure
The Frame File
•Contains the path to the application's executable file for the SilkTest
recovery system to use while running testcases
•Will initially hold a window declaration only for the starting
page/window

* Footnote
Source:Sources 49/7
Unit of measure
Help Topics
•Is used to get more information than the Library Browser provides
•Allows you to copy and paste examples into your testcase

* Footnote
Source:Sources 50/7
Looping Statements
Unit of measure

* Footnote
Source:Sources 51/7
Unit of measure
Branching Statements

* Footnote
Source:Sources 52/7
Unit of measure

* Footnote
Source:Sources 53/7
Unit of measure
How To Handle A Login Window
•Record a window declaration for the login window
•Record an Invoke method to handle the login window
•Modify the Invoke method to include a derived keyword
•Add the login widow's name to the wStartup constant in the Main
Window's window declaration

* Footnote
Source:Sources 54/7
Unit of measure

* Footnote
Source:Sources 55/7