Case study for Testing 3rd party rating engine for P

1
Case study for Testing 3rd party rating engine
for PC Insurer Using Onsite / Offshore Model
2
About the client and product tested

• West coast based PC Insurer
• Underwriting in California, Nevada and Arizona
• Multico/ Hawksoft Desktop rating engine to
  quote insurance policies
• Homeowners, Dwelling fire and Umbrella
• Quote only for Arizona and Nevada
• Multico/Hawksoft features to be tested
• Rate Quote
• Application creation
• Application printing

3
QA Testing - Engagement Details

• Knowledge acquisition
• HO Dwelling fire Underwriting manuals
• Rating guidelines
• Product features and usability
• Product specific creation of
• Test Strategy, Test Plan, Test Scenarios Test
  Cases
• Test data preparation
• Creation of Excel rater for comparison
• Functional Test Execution
• Regression Testing

• Functional areas
• Rating algorithm
• New Business Acquisition
• Endorsements
• HO, Dwelling, Umbrella fire rate quote features
• Validation of underwriting rules
• Application generation/print features
• Platforms
• WIN 98 / WIN XP
• Tools
• Test Director

4
Team Organization
Client QA Team
Vendor Team
Cognizant Offshore Team
Product support
Client QA Manager
Client Test lead
Offshore Test/Delivery manager
Business analysts

• Web based Tools for
• Issue Tracking
• Issue Resolution
• Status Calls

Client SMEs
Offshore Test lead
Offshore Test lead
Offshore Testers
Account manager

• TestDirector Defect Tracking
• Test management
• Metrics capture

Onsite Test lead
Internal QA
5
Planning Execution

• Clean handshake with onsite lead and vendor
• QA team delivers ambiguity review reports that
  can be turned over to product vendor
• BAs collaborate with QA in preparation of test
  strategies / plans and test cases
• Test management tools shared across offshore,
  onsite and vendor groups
• Functionality prioritization
• Clear segregation of core functions from nice
  to have for Risk Based Testing
• Test conditions organized by the business
  functions and grouped into test cases within
  MultiCo/HawkSoft product
• Horizontal testing
• Test data flow throughout the entire system
• Ensures environment and code are stable for test
  execution
• Vertical testing
• Test deeper functionality of system
• Ensures all underwriting rules are implemented
• Rater and application writer have all the
  requisite functionality elements

6
Planning Execution (cont)

• Iterative testing
• Iteratively test multiple builds of the
  applications for pass/fail cases
• Perform regression on all new builds
• Comprehensive test coverage
• Prepare test data with specific real life
  business scenarios
• Ensure all alternate flows and exceptions
  scenarios are captured
• Use hand calculations Excel Rater for
  validation
• Use customized templates for data and test
  scenarios preparation
• Defect management
• Test Director used for logging, tracking and
  closure of defects
• Use of 2-step approach before defect escalated to
  vendor for resolution

7
Key test metrics

• General metrics
• Effort variation
• Size variation
• Schedule variation
• Productivity
• Defects captured by functional area
• Test script execution
• Re-testing execution
• Reusable scripts

8
Results delivered to client

• Independent QA Test Team
• Complete assessment of the product for production
  readiness
• Value adds
• Identification of missing requirements and
  functionalities
• Identification of automation opportunities for
  future releases
• Development of Excel rater for cross verification
  of rate quote
• Flexible cost-effective sourcing
• Mix of business analysts and functional testers
  at offshore
• Onsite test lead with experience in Insurance
  domain
• Quick turn around of test iteration using
  onsite-offshore model
• End-to-end test management using Mercury-Test
  Director