SIP Testing Methodology

1

Elie Cohen ProLab PM 17/01/2003
SIP Testing Methodology
2
Agenda

• SIP Testing Overview
• SIP Test Topology
• SIP Server and SIP User Agent Testing
• Building a Practical SIP Testing Environment
• ProLab TestManagement Suite

3
SIP Testing OverviewRequirement
4
The Importance of Early Bug Detection

• Early detection of software and hardware defects
  is crucial for mainlining development costs low

Test early Test often
Cost of bug fixes
Software Cycle
5
SIP Testing System Challenges

• Minimize testing time improve time-to-market
• Testing throughout the development cycle
• Perform comprehensive testing
• Load and stress
• Protocol compliance
• Error conditions
• Network simulation
• Test both signaling and media

6
SIP Testing System Challenges
(cont.)

• Flexibility to change tests as needed
• Change test parameters quickly
• Change test topology
• Ease-of-use for developers and QA engineers
• Full network simulation
• One or more endpoints SIP User agent
• Simulate Full SIP Server application
• RTP Network Simulation
• Varying network topology

7
SIP Testing System Challenges
(cont.)

• High performance and scalability
• Generate very high rates of calls/transactions
  per second
• Standards compliant
• Based on SIP RFC3261 for User agent

8
SIP Test Topology
9
SIP Test Environment

• Simulates an endpoint capable of handling
  thousands of calls

Scenario
SIP protocol
Test results
IP
System Under Test
Test results
SIP protocol
Scenario
10
SIP Functional Test Topology
IP
11
SIP Stress Test Topology

• Verify that the system performs under extreme
  conditions and test to see that system can handle
  intended load

IP
DUT
12
SIP Server and User Agent Testing
13
SIP Server Functional Test Topics

• Proxy testing
• Request and response forwarding
• State full and Stateless
• Reject responses (Forwarding, registration)
• Server functionality routing with address
  resolution (forking) loose routing
• Redirect Server Functionality Returns Contact
  this address response
• Message Validation and Invalid response handling
• Record route
• Outbound proxy

14
SIP Server Performance Metrics

• SIP servers typically need to handle high
  transaction rates
• Transactions statistics
• Total Transactions per second
• Total Transactions Capacity
• Transactions failed per second
• Percentage Transactions rejected
• Calls statistics
• Calls requested per second
• Calls Connected per second
• Call establishment time (call setup delay)

15
SIP Server Performance Metrics
(cont.)

• Registration statistics
• Total Registrations per second
• Percentage Registrations rejected
• Registrations requested per second
• Registrations confirm per second

16
SIP Server Registrar Test

• Registrar location database
• Different types of expiration
• Different type of TO header
• Registration with other contact
• Unregistration (expires0)
• Update existing registration
• Registration with multiple contact
• Multiple registration

17
SIP Server Registrar Test
(cont.)

• Security
• Authentication header
• Different type of nonce and Realm
• Existing and non existing user
• User expired

18
High Volume of Concurrent Calls

• Capability to send and receive thousands of
  concurrent calls from single or multiple
  endpoints
• Capability to simulate thousands of media calls
  simultaneously
• Capability to send thousands of concurrent
  registrations to an SIP Server
• Capability to simulate different scenarios
  simultaneously

19
SIP Stress Method Testing

• Burst Testing (multiple invite simultaneous)
• Poisson Call distribution
• Poisson Call duration
• Constant Call distribution (X Calls per second)
• Constant call duration
• Load testing
• Stress Test using only signaling
• Stress Test using signaling and media

20
SIP User Agent Testing

• Methods (invite,re-invite, cancel, bye, info,
  notify, subscribe, options, re-invite, refer , )
• Retransmission mechanism
• Provisional response
• Register and authentication
• Add contact to register
• Timer configuration

• Atypical testing
• SIP Parsing coding and decoding headers
• Non standard message
• Call Flow - State Machine
• Reject response handling
• Multipart mime
• Body message
• SIP headers test
• TCP UDP Interface

21
SDP Packet

• Session information
• Session name and purpose.
• Time(s) the session is active.
• Media information
• Type of media, such as video and audio. Transport
  protocol, such as RTP/UDP/IP and H.320. Media
  format, such as H.261 video and MPEG video.
• SDP With different type of Media information
• SDP with Telephone-event
• Different Type of SDP

22
Response Message

• RESPONSE TYPES
• Provisional (1xx class)provisional responses are
  used by the server to indicate progress, but they
  do not terminate SIP transactions
• Final (2xx, 3xx, 4xx, 5xx, 6xx classes)final
  responses terminate SIP transactions.

• CLASSES
• 1xx provisional, searching, ringing, queuing
  etc.
• 2xx success
• 3xx redirection, forwarding
• 4xx request failure (client mistakes)
• 5xx server failures
• 6xx global failure (busy, refusal,not
  available anywhere)

23
Advanced RTP Testing

• RTP Simulation
• Packet loss , Duplicate Packets , Packets
  ordering
• Corrupted packet SSRC Corrupted
• Delay, Jitter
• Stop Sending RTP and resume.
• DTMF in band and RFC 2833, DTMF in band

24
Advanced RTP Testing
(cont.)

• RTP Monitoring and statistics
• Packet loss and Packet distribution (sender
  receiver)
• RTP General information (Payload, low seq ,High
  Seq , SSRC, UDP, )
• Different Codecs G711, g728, G729, G722, G723.1,
  H261, H263,.
• RTCP
• Jitter, Cumulative lost , fractional lost,

25
Building a Practical SIP Testing Environment
26
SIP Testing Environment
User Agent Client 1..X
Test Management
SIP Server
SIP Server
IP
Device Under Test
User Agent Server 1..X
Media Testing
27
Testing Lab Components

• Test Management
• Script and configuration Management (typical and
  Atypical)
• Control Test Execution (Saving result,
  Notification )
• Test Scheduling ( Test Scheduler, Compare test
  result)
• SIP Server
• Full SIP Server Simulation (Proxy, Registrar,
  Location DB, Authentication)
• Positive and negative response
• Multi SIP Server

28
Testing Lab Components
(cont.)

• SIP User Agent Client/Server P Server
• Simulation UAC and UAS
• Media Testing
• Full Media Network simulation and media monitoring

29
ProLab Test Management Suite

• SIP Testing Solutions

30
ProLab Test Management Suite
ProLab Test Manager
ProLab SIP Server Agent
ProLab SIP Test Agent
ProLab Gatekeeper Agent
ProLab H.323 Test Agent
ProLab RTP Analyzer
ProLab Test Scheduler
Voice and Video Over IP Complete Test Solution
31
ProLab Advantage

• Full Network simulation (SIP UAC/UAS, SIP Server
  , Advanced RTP and full automation)
• Closely synchronized with protocol updates
• Distributed Solution
• SIP H.323 Advanced Testing
• Script Driven
• Script Result management
• High performance and volume of calls

32
ProLab Application
33
Summary

• Testing Media Signaling over IP is typically
  complicated and costly if not done thoroughly
• Cost effective for Media over IP
• Script-driven is highly flexible and good
  solution for full automation
• Numerous powerful testing capabilities for both
  SIP UAC/UAS, SIP Server, SDP and RTP.
• Full SIP Network Simulation

34
Thank You
Booth 1 RADVISION www.radvision.com elic_at_radvisio
n.com