Each Test Set can be run as many times as you want, result

1

Applied Testing and Technology

• Management for
• Manual Software Testing
• www.aptest.com/atm2

2
Overview

• Manages and tracks testing status and results
• Provides consistent, repeatable QA process
• WWW based
• Persistent information repository
• Integrated requirements management
• Extensive reporting
• Role-based security
• Highly flexible and customizable

3
QA Testing Challenges

• Process inconsistent and is not repeatable
• Personnel turnover loses knowledge
• Time consuming and difficult to
• monitor progress
• measure productivity
• assess quality
• share information

4
The ApTest Manager Solution

• Consistent, repeatable process
• Permanent information store
• Real time access to tests, results, status
• Geographically distributed users
• QA, customers, development, . . .
• Test method and tool neutral

5
ApTest Manager Benefits

• Higher product quality
• Better tests, better coverage, better process
• Find and fix bugs sooner in the development cycle
• Shorter projects at a lower cost
• Improved, measurable productivity

6
Manage Manual/Automated testing
Requirements Test Cases
Manual Testing
Reporting
Test Results
Automated Testing
7
Requirements Repository

• User defined tree of FoldersAs deep and wide as
  you want
• Folders contain Requirements and Files
• Requirements fields totally configurable. As many
  fields as you want menu fields, text fields,
  date fields, tables, etc.
• Requirement names can be strings or automatically
  assigned numbers

8
Test Repository

• User defined tree of FoldersAs deep and wide as
  you want
• Folders contain Test Cases and Files
• Test Case fields totally configurable. As many
  fields as you want menu fields, text fields,
  date fields, tables, etc.
• Test Case names can be strings or automatically
  assigned numbers

9
Link Requirements and Tests

• Tests can be linked to Requirements in any
  relationshipOne-to-one, many-to-one, and
  one-to-many
• Tests can be automatically created and linked to
  Requirements

10
Execution

• Unlimited number of different groups of tests
  (Test Sets)
• Created by querying test characteristics e.g.
  the tests for a particular version or feature.
• Each Test Set can be run as many times as you
  want, results stored separately for different
  test environments (Test Sessions)

11
Typical Project

• Reqs Tests Sets
  Sessions
• 
  test subsets execution results

. . .
. . .
12
Customization

• Easily customized
• What fields make up a Test Case
• Name, Format, Default Value
• How a Test Case is displayed
• Editing, Executing, Reporting
• Session Variables
• Characterize test environment H/W-S/W
• Design your own gold standard configuration

13
Reports

• On part or all of a project composed of different
  Sets and Sessions
• Status done, results, vs. schedule
• Coverage of test cases
• Productivity of users
• Compare Sessions
• On specific sessions
• Custom queries can be defined and saved

14
Integrates with Existing Tools
15
Test Repository

• Tree of folders of tests
• Create
• Edit
• Copy
• Rename
• Delete
• View

16
Test Editing

• Field Types
• Menus
• Text Areas
• Tables
• Field Styles
• WYSIWYG HTML Editor
• Text

17
Requirements Repository

• Tree of Reqs
• Create
• Edit
• Copy
• Rename
• Delete
• View

18
Repository Reports

• Test Requirements Reports
• Test Specification Reports

19
Test Execution

• Run specificgroups of Tests (Test Sets)
• Run them inspecific TestEnvironments(Test
  Sessions)

20
Test Execution

• Any number of Test Sets (subset of Test Cases for
  different test cycles, product versions, etc.)
• Any number of Test Sessions, each recording the
  execution of a Test Set (in a different H/W-S/W
  environment).
• Test Cases only need be defined once, so easily
  maintained and evolved

21
Test Set

• Group ofTest Cases based onan ad hocquery
  ofTest Casefield values

22
Test Sets

• Queries select different groups of tests

23
Test Session

• Results ofrunningTest Casesfor a Test Set
• SessionVariablesspecify testenvironment

24
Test Sessions

• Session Variables tag the session with info on
  where and how it was run. e.g. O.S., browser,
  hardware, product version, tester, . . .
• You can search for and report on Sessions based
  on a variety of criteria, including session
  variables, e.g. compare the results of all the
  Sessions run on Windows XP with Oracle.

25
Test Execution

• Tester is given
• Requirements
• Procedure
• Tester enters
• Test result
• Time spent (optional)
• Notes

26
Reports

• Are generated for one or moresessions
• Sessions can beselected with ad hoc queries

27
Status Report

• Multiple sessions
• Complete
• Time remaining
• Trends
• Result Details
• Links to persession reports

28
Users Report

• Results
• Productivity
• Schedule analysis

29
Results Report

• Test Case detailsand results

30
Regression Report

• Multiple Sessions
• ComparesResults

31
Coverage Report

• Coverage ofTest Casesby Sessions
• Can createTest Sets of uncoveredTest Cases

32
Configuration

• Specify Test Case Fieldsand their formats

33
Configuration

• Specify TestResults

34
Configuration

• Specify how a Test Case is displayed for
  editing,execution, reports

35
Configuration

• Specify SessionVariables

36
Security

• Password protected accounts
• Access controls per user by Test Suite

37
Security

• Admin functionscontrolled by admin users

38
Email Notifications

• Per User,Per Suite
• Multiple event triggers

39
Other Features

• Integrates with third-party tools
• Bug tracking
• Source control
• Import and Export Test Cases and Requirements via
  CSV files (e.g. from Excel spreadsheets)
• Import of automated test results from test
  harnesses

40
Support Maintenance

• Multiple releases annually
• Bug fixes
• Enhancements
• Updated OS, browser and server compatibility

41
Whats Coming Up

• ApTest Manager Automation Edition
• Adds Test Automation support
• Scripts can be associated with tests and executed
  over your network
• Results stored and reported with manual tests
• Separately priced add-on

42
System Requirements

• Windows, Linux, or MacOS
• Perl
• Web Server, e.g. Apache, IIS
• Server of moderate size (e.g. 2.8GHz P4)
• Server does not have to be dedicated

43
Licensing/Pricing

• Purchase and run on your server
• Per Seat floating licenses. Number of Seats
  limits number of logged in users.
•     seats       /seat       discount    1-5   
         500        n/a    6-10         475     
    5    11-15       450        10    16-20 
       425        15    21-30       400       
  20    31-40       375        25    41-50  
      350        30    51          call factory
  
• Can add more licenses at any time
• Support 100/seat/year

44
Licensing/Pricing

• As a service, hosted on our servers
• For short term projects
• High up time, fast connections
• 45/user/month, 200 set up fee
• Support included

45
Performance

• ApTest QAs the product
• With Test Suites containing 30,000 tests
• With 100 concurrent users

46
What customers say

• We love the use of your software, it's doing a
  lot to streamline our software development cycle.
  This is a great product.
• The support you offered has been magnificent, far
  better than I have seen from your competitors. I
  have been thoroughly impressed.
• AP Test Manager is a good product and I base this
  opinion on my 20 plus years in RD, test
  management and testing.
• I've gotten good responses from the users - they
  really like the tool.