Cognos Test Cases

Purpose: Test that reports, cubes, event studio objects, schedules, emails, and auditing all function correctly. Verify that modifications to the end user experience are minimal and that the changes that developers will see are moderate. Verify that the data, speed and presentation for each report is the same in 8.2 and 8.3 or better and document any differences (good or bad) using the same prompt values to run the report or object in 8.2 and 8.3 to verify the results are the same. If there is a problem in either environment, document it. Test as many different packages as possible. Differences When viewing a report, the various options are available in different drop downs. Keep this version Bookmark do we want to allow this? Can save to unsecured folders if logged in (check Informal) Drill thru from cube if formatted date in cube pass the date so does not work (about 3 -4 cubes) Cube build date is in the properties from Analysis Studio click on cube name and double arrows in information pane Implementation Tasks: Deploy full content store from existing production environment to new environment Disable all schedules Copy Cubes Recreate training users trn001 Payroll Cultural, Human Resources trn002 - Payroll Cultural, Payroll Aviation trn003 City Operator Permit trn004 Police Applications trn005 Developer - Police

Test cases: 1. 2. 3. 4.

5. 6. 7. 8. 9. 10. 11. 12. 13.

14. 15. 16. 17. 18. 19. 20. 21. 22. 23. 24.

Prompted Report Unprompted Report Secured reports (Payroll, tcop, public safety, HR) Anonymous user a. Unsecured reports can they be accessed by anonymous b. Can they save as a view? c. Verify user does not have access to what they shouldnt Cross tab report Complex formatting Complex data manipulation Multiple subreports Drill thru reports Drill thru to applications Run format working correctly(Excel, PDF, CSV) Scheduled report a. Email Cubes drill up and down in the columns and rows, add filters, add to context. a. Drill thru to a report are the expected filter values working, b. Drill thru to a report with a drill thru c. CRM cubes Reports against a cube drill up and down in the columns and rows, add filters, add to context, .. a. Drill thru to a report are the expected filter values working, b. Drill thru to a report with a drill thru Auditing Event Studio objects Schedules running correctly including emails Create a report template working correctly, Create an Analysis Studio object Create Queries Create a report against a cube Create an Event Studio object Framework Manager test making modification, publishing, creating a new model Powerplay Transformer a. create a cube against an existing iqd b. create a cube against a Framework Manager query item c. CRM

25.

Verify Administrative tasks a. Create data sources b. Add/Modify users/groups c.

Report/Cube Warrant Search Police Crime Statistics Incident By Address Job Application Totals by Department - Open Applications Unmatched Invoices - All Unmatched Invoices over 90 days Unmatched Releases - Daily P29 Leave Report

Path
Public Folders > Public Safety > Warrants Public Folders > Public Safety Public Folders > Public Safety > CAD Incident Public Folders > Human Resources > Job Applications

Test cases run 1, 3, 4c 14a 1, 3, 4c 2, 3, 4c, 5

Tester Julie Julie Julie Julie

Test Date 8/1/08 8/1/08 8/1/08 8/1/08

Comments

Results Pass Pass

Logon error, try later Logon error, try later

UDT connection not working Notes software not installed Pass Pass Pass Pass

Public Folders > Financial > MARSG > Unmatched Invoices and Releases Public Folders > Financial > MARSG > Unmatched Invoices and Releases Public Folders > Financial > MARSG > Unmatched Invoices and Releases Public Folders > Financial > Payroll > Leave Reports

1, 4a, 4b, 10 1, 4a, 4b, 7, 10 2, 4a, 4b, 7 1, 3, 6, 8

Julie Julie Julie Judy

8/1/08 8/1/08 8/1/08 07/08/08 Entered my Employ ID and 2008 for the year, report response time was much quicker in newer version of Cognos 07/08/08 Entered 07/04/08 for the Pay Period End Date and 0FAIS for the Payroll Unit, report response time was much quicker in newer version of Cognos 07/08/08 Selected Finance and Admin Serv. Dept., 745 Communications Fund, 6/01/08 to 6/30/08, Slow in both

CTCD Time Card Details

Public Folders > Financial > Payroll > Timecard Reports

1, 3, 6, 7

Judy

Pass

Transactions Historical 1992 through Present (NP)

Public Folders > Financial > General Ledger > General Ledger - Historical

1, 4a, 4b, 6

Judy

Pass

Report/Cube Paid Items Historical PCVO - Position Control Vacancy and Overfill Report PCV - Position Control Vacancy Position Control Detail Report Summarized by Organization/Union Current Paid Items

Path
Public Folders > Financial > MARSG > Paid Invoices Historical Public Folders > Financial > Payroll > Position Control Reports Public Folders > Financial > Payroll > Position Control Reports Public Folders > Financial > Payroll > Position Control Reports Public Folders > Financial > MARSG > Paid Invoices Current Fiscal Year Public Folders > City Operator Permit

Test cases run 1, 4a, 4b, 10 1, 3, 5, 6, 7, 8 1, 3, 5, 6, 7, 8 1, 3, 5, 6, 7, 8

Tester Judy Judy

Judy

Judy

Stepha nie 2, 3, 4c Stepha nie

Test Comments Date 07/08/08 Prompted to download Filenet viewer to retrieve invoice images. 07/08/08 Entered FAIS% for the Organization, report response time was much quicker in newer version of Cognos 07/08/08 Entered FAIS% for the Organization, report response time was much quicker in newer version of Cognos 07/08/08 Entered FAIS% for the Organization, report response time was about the same in both environments. 07/08/08 Cube in Analysis Studio. Need to compare when there is some data in 8.2 07/08/08 Has a saved report, run from run action. Paged down slightly faster in 8.3, Tested PDF, and all excel formats, anonymous could not see, trn003 could run 07/08/08 Slow in both environments (prompts about 2 min., report about 1 min), ran as anonymous, could not save, drill thru worked, save in html worked

Results Pass Pass

Pass

Pass

Pass

Sus or Rev MVD licenses

Pass

CRM - Large Item Pick-up exception

Public Folders > CRM/311 > Solid Waste

1, 13

Stepha nie

Pass

Report/Cube Daily Worklist Report by Quadrant

Path
Public Folders > CRM/311 > DMD

Test cases run 1, 9, 10

Tester Stepha nie

Telecommunications Detail - Current Fiscal Year

Public Folders > Telecommunications

1,4b

Stepha nie

CRM - Large Item Pick-up Exception Report -Afternoon

Public Folders > CRM/311 > Scheduled

2, 12

Stepha nie

Daily Worklist Report with Detail Information

Public Folders > CRM/311 > DMD

1, 4a, 4b, 10

Stepha nie

Test Comments Date 07/08/08 Use stmasm. Slow in both (about 40 50 seconds). Drill throughs all worked, saved in PDF NOTE: no records found at the bottom of the report with 3 records in both env. 07/13/08 Used economic development in 8.2 and 8.3, got the same results, emailed the report to myself and it worked, emailing the link did not. I was not able to save the report to my folders. I was able to add a bookmark, View in excel worked 07/13/08 Ran thru the run action, no records found in both but I do see the previous versions looked like the schedule was running. I disabled all schedules except this one and changed email recipient from Luchetti Deanna M (swddml);CCC Supervisors; to Judy and I and added attach report 07/14/08 Took over 2 minutes in both environments. Slow. Under Add this report, I was able to Add the report to
Public Folders > Departments Informal Reports > Planning,

Results Pass

emailing the link did not work

Pass

Pass

But not My Folders as Anonymous.

Report/Cube Unmatched Invoices - Daily

Path
Public Folders > Financial > MARSG > Unmatched Invoices and Releases

Test cases run 1, 4a, 4b

Tester Stepha nie

CRM Summary By Agent CRM Case Summary Cases by Quickcode Purchase Orders Details (MARSG)

Public Folders > CRM/311 > Contact Center Reports Public Folders > CRM/311 > Analytical Reports

13, 14

David

Test Comments Date 07/14/08 Under Keep this version, I was able to save the report view to Informal/Campaign and ran it from the new location. It looks like I could have added the report view to most of the cube packages. Also, I was able to email the report to myself and both the link and the attached report worked Under Add this report, I was able to add it as a bookmark and it ran fine from there. 07/08/20 All test scenarios worked fine. 08

Results Under Keep this version, it looks like I could have added the report view to most of the cube packages.

13, 14

David

Public Folders > Financial > MARSG > Contracts and Purchase Orders

Judy

07/08/20 Unable to test drill thru to 08 Related Reports. To slow in both environments. Will check again after the 8.3 environment has been updated 08/07/08 Recreated report in 8.2 Error Message in 8.3: environment because of the following error message:

Water Reports Injury Time Fiscal YTD YTD Historical Balances - Overtime

Public Folders > Water Authority > Dashboard Reports Public Folders > Water Authority > Dashboard Reports

2 2

David David

Working in 8.3. No longer present in 8.2 Tested and working as expected

Report/Cube Injury Time

Path
Public Folders > Water Authority > Dashboard Reports

Test cases run 2

Tester David

Test Date

Comments Not tested. This report was not found in the 8.3 environment. Report needs to be deployed in 8.3. Not tested. Report needs to be deployed in 8.3 with current data Not tested. Report needs to be deployed in 8.3 with current data

Results

Postage Detail Report 5D All Exception Reports - AM Reports

Public Folders > Utility Billing > CIS > Daily Reports > Scheduled Public Folders > Water Authority > Payroll > Secured > Payroll Exception Reports

2, 3, 12, 17 2, 3, 12, 17

David David

Testing of Drill Thru from a cube to a report

Drill Through Definition Current Paid Items Cube Name MARSG Current Paid Items Report Name Current Paid Items Path including Analysis Object Name
Public Folders > Financial > MARSG > Paid Invoices Current Fiscal Year

Test cases run 9, 10, 13b, 14b

Tester Judy

Test Date 8/27/08

Comments Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions

Results Pass

General Ledger Current Encumbrances

Current Encumbrances

Current Encumbrance s

Public Folders > Financial > General Ledger > General Ledger - Current Fiscal Year

9, 10, 13b, 14b

Judy

8/27/08

Pass

General Ledger Current Daily Transactions

GL Current Daily Transactions

GL Current Daily Transactions

Public Folders > Financial > General Ledger > Daily Transactions

9, 10, 13b, 14b

Judy

8/27/08

Pass

Drill Through Definition AR Open Items Less Companies 05 and 06

Cube Name AR Open Items - Less Companies 05 and 06

Report Name AR Open Items - Less Companies 05 and 06

Path including Analysis Object Name

Public Folders > Financial > Accounts Receivable

Test cases run 9, 10, 13b, 14b

Tester Judy

Test Date 8/27/08

Comments Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions

Results Pass

AR Open Items Less Companies 05, 06, NT and Future Payments

AR Open Items - Less Companies 05 and 06 and NT and Future Payments

AR Open Items - Less Companies 05 and 06 and NT and Future Payments AR Open Items - Less Companies 05 and 06 and NT and Future Payments and Grants

Public Folders > Financial > Accounts Receivable

9, 10, 13b, 14b

Judy

8/27/08

Pass

AR Open Items Less Companies 05, 06, NT, Future Payments and Grants

AR Open Items - Less Companies 05 and 06 and NT and Future Payments and Grants

Public Folders > Financial > Accounts Receivable

9, 10, 13b, 14b

Judy

8/27/08

Pass

Drill Through Definition General Ledger Current Fiscal Year Transactions (NP)

Cube Name GL Current Balances - No Encumbrances

Report Name Current Fiscal Year Transactions NP

Path including Analysis Object Name

Public Folders > Financial > General Ledger > General Ledger - Current Fiscal Year

Test cases run 9, 10, 13b, 14b

Tester Judy

Test Date 8/27/08

Comments Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions

Results

Labor Distribution by Employee Current Pay Period Drill

Labor Distribution Fiscal with Employees

Labor Distribution Fiscal with Employees

Public Folders > Financial > Payroll > Labor Distribution Secured

9, 10, 13b, 14b

Judy

8/27/08

Labor Distribution by Employee Current Fiscal Year Drill

Labor Distribution Fiscal with Employees

Labor Distribution Fiscal with Employees

Public Folders > Financial > Payroll > Labor Distribution Secured

9, 10, 13b, 14b

Judy

8/27/08

Drill Through Definition Unmatched Invoices

Cube Name MARSG Unmatched Invoices

Report Name Unmatched Invoices

Path including Analysis Object Name

Public Folders > Financial > MARSG > Unmatched Invoices and Releases

Test cases run 9, 10, 13b, 14b

Tester Judy

Test Date 8/27/08

Comments Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions Tested drill down, up, related links, filtering and exporting. Tested drill down, up, related links, filtering and exporting. Tested drill down, up, related links, filtering and exporting.

Results

Unmatched Releases

MARSG Unmatched Releases

Unmatched Releases

Public Folders > Financial > MARSG > Unmatched Invoices and Releases

9, 10, 13b, 14b

Judy

8/27/08

CRM Drill Details

CRM Case Summary

CRM Case Summary Aging Period CRM Field Services Materials Removed CRM Field Services Materials Used

Public Folders > CRM/311 > Open Cases

Melissa Parras

7\15 & again 7\22 7\15 & again 7\22 7\15 & again 7\22

Worked as expected.

CRM Materials Removed Drill Details CRM Materials Used Drill Details

CRM Field Services Materials Removed CRM Field Services Materials Used

Public Folders > CRM/311 > DMD

Melissa Parras

Worked as expected.

Public Folders > CRM/311 > DMD

Melissa Parras

Worked as expected.

Drill Through Definition Telecommunicati ons Detail Report - Current Fiscal Year

Cube Name Telecommunica tions Detail Current Fiscal Year

Report Name Telecommuni cations Detail - Current Fiscal Year

Path including Analysis Object Name

Public Folders > Telecommunicat ions

Test cases run 9, 10, 13b, 14b

Tester Judy

Test Date 8/27/08

Comments Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions

Results

CRM Drill Details

CRM Case Summary

CRM Case Summary by Category

Public Folders > CRM/311 > Analytical Reports

9, 10, 13b, 14b

Judy

8/27/08