SIP Testing Methodology

Elie Cohen

ProLab PM

17/01/2003

AgendaAgenda

SIP Testing Overview

SIP Test Topology

SIP Server and SIP User Agent Testing

Building a Practical SIP Testing Environment

ProLab TestManagement Suite

SIP Testing OverviewRequirement

1 3 8

51

100

0

20

40

60

80

100

Req Design Code Test Main

The Importance of Early Bug DetectionThe Importance of Early Bug Detection

Early detection of software and hardware defects is crucial for mainlining development costs low

Cost of bug fixes%

Software Cycle

Test early & Test often

SIP Testing System ChallengesSIP Testing System Challenges

Minimize testing time & improve time-to-market

Testing throughout the development cycle

Perform comprehensive testing:

Load and stress

Protocol compliance

Error conditions

Network simulation

Test both signaling and media

SIP Testing System ChallengesSIP Testing System Challenges

Flexibility to change tests as needed

Change test parameters quickly

Change test topology

Ease-of-use for developers and QA engineers

Full network simulation

One or more endpoints SIP User agent

Simulate Full SIP Server application

RTP Network Simulation

Varying network topology

(cont.)

SIP Testing System ChallengesSIP Testing System Challenges

High performance and scalability

Generate very high rates of calls/transactions per second

Standards compliant

Based on SIP RFC3261 for User agent

(cont.)

SIP Test Topology

IP

SIP Test EnvironmentSIP Test Environment

Simulates an endpoint capable of handling thousands of calls

SystemUnder Test

Scenario

Test results

SIP protocol

UAC

UAS

SIP protocol

Scenario

Test results

SIP Functional Test TopologySIP Functional Test Topology

DUTUAC/UAS

IP

SIP Stress Test TopologySIP Stress Test Topology

Verify that the system performs under extreme conditions and test to see that system can handle intended load

DUT

UAC

UAC

UAC

UAS

UAS

UAS

IP

SIP Server and User Agent Testing

SIP Server Functional Test TopicsSIP Server Functional Test Topics

Proxy testing

Request and response forwarding

State full and Stateless

Reject responses (Forwarding, registration)

Server functionality routing with address resolution (forking) & loose routing

Redirect Server Functionality: Returns “Contact this address” response

Message Validation and Invalid response handling

Record route

Outbound proxy

SIP Server Performance MetricsSIP Server Performance Metrics

SIP servers typically need to handle high transaction rates

Transactions statistics:

Total Transactions per second

Total Transactions Capacity

Transactions failed per second

Percentage Transactions rejected

Calls statistics:

Calls requested per second

Calls Connected per second

Call establishment time (call setup delay)

SIP Server Performance MetricsSIP Server Performance Metrics

Registration statistics:

Total Registrations per second

Percentage Registrations rejected

Registrations requested per second

Registrations confirm per second

(cont.)

SIP Server Registrar TestSIP Server Registrar Test

Registrar & location database

Different types of expiration

Different type of TO header

Registration with other contact

Unregistration (expires=0)

Update existing registration

Registration with multiple contact

Multiple registration

SIP Server Registrar TestSIP Server Registrar Test

Security

Authentication header

Different type of nonce and Realm

Existing and non existing user

User expired

(cont.)

High Volume of Concurrent CallsHigh Volume of Concurrent Calls

Capability to send and receive thousands of concurrent calls from single or multiple endpoints

Capability to simulate thousands of media calls simultaneously

Capability to send thousands of concurrent registrations to an SIP Server

Capability to simulate different scenarios simultaneously

SIP Stress Method TestingSIP Stress Method Testing

Burst Testing (multiple invite simultaneous)

Poisson Call distribution

Poisson Call duration

Constant Call distribution (X Calls per second)

Constant call duration

Load testing

Stress Test using only signaling

Stress Test using signaling and media

SIP User Agent TestingSIP User Agent Testing

Methods (invite,re-invite,

cancel, bye, info, notify, subscribe, options, re-invite, refer , …)

Retransmission mechanism

Provisional response

Register and authentication

Add contact to register

Timer configuration

Atypical testing

SIP Parsing coding and decoding headers

Non standard message

Call Flow - State Machine

Reject response handling

Multipart mime

Body message

SIP headers test

TCP & UDP Interface

SDP PacketSDP Packet

Session information

Session name and purpose.

Time(s) the session is active.

Media information

Type of media, such as video and audio. Transport protocol, such as RTP/UDP/IP and H.320. Media format, such as H.261 video and MPEG video.

SDP With different type of Media information

SDP with Telephone-event

Different Type of SDP

Response MessageResponse Message

RESPONSE TYPES

Provisional (1xx class)—provisional responses are used by the server to indicate progress, but they do not terminate SIP transactions

Final (2xx, 3xx, 4xx, 5xx, 6xx classes)—final responses terminate SIP transactions.

CLASSES

1xx = provisional, searching, ringing, queuing etc.

2xx = success

3xx = redirection, forwarding

4xx = request failure (client mistakes)

5xx = server failures

6xx = global failure (busy, refusal,not available anywhere)

Advanced RTP TestingAdvanced RTP Testing

RTP Simulation

Packet loss , Duplicate Packets , Packets ordering

Corrupted packet & SSRC Corrupted

Delay, Jitter

Stop Sending RTP and resume.

DTMF in band and RFC 2833, DTMF in band

Advanced RTP TestingAdvanced RTP Testing

RTP Monitoring and statistics

Packet loss and Packet distribution (sender & receiver)

RTP General information (Payload, low seq #,High Seq #, SSRC, UDP, …)

Different Codecs G711, g728, G729, G722, G723.1, H261, H263,.

RTCP

Jitter, Cumulative lost , fractional lost, …

(cont.)

Building a Practical SIP Testing Environment

SIP Testing EnvironmentSIP Testing Environment

User Agent Client 1..X

User Agent Server 1..X

Test ManagementSIP Server

Media TestingDevice Under Test

SIP Server

Run Test

IP

Testing Lab ComponentsTesting Lab Components

Test Management

Script and configuration Management (typical and Atypical)

Control Test Execution (Saving result, Notification )

Test Scheduling ( Test Scheduler, Compare test result)

SIP Server

Full SIP Server Simulation (Proxy, Registrar, Location DB, Authentication)

Positive and negative response

Multi SIP Server

Testing Lab ComponentsTesting Lab Components

SIP User Agent Client/Server P Server

Simulation UAC and UAS

Media Testing

Full Media Network simulation and media monitoring

(cont.)

ProLab Test Management Suite

SIP Testing Solutions

ProLab™ Test Management SuiteProLab™ Test Management Suite

ProLab Gatekeeper Agent

ProLab Test Manager

ProLab SIP Test Agent

ProLab H.323 Test Agent

ProLab RTP Analyzer

ProLab Test Scheduler

ProLab SIP Server Agent

Voice and Video Over IP Complete Test Solution

Controlling ProLab Test Agents and scripts management

Scheduling test scenarios

RTP monitoring and simulation

H.323 advanced endpoint simulation

Full H.323 gatekeeper simulation

SIP advanced User Agent simulation

Full SIP Proxy, Registrar and Redirect Server simulation

ProLab AdvantageProLab Advantage

Full Network simulation (SIP UAC/UAS, SIP Server , Advanced RTP and full automation)

Closely synchronized with protocol updates

Distributed Solution

SIP & H.323 Advanced Testing

Script Driven

Script & Result management

High performance and volume of calls

ProLab ApplicationProLab Application

MessageStatistics

Incoming andOutgoing Messages

MultipleAgents

CallPerformance

RTP- Packets Distribution

RTP –Packets Loss

SummarySummary

Testing Media & Signaling over IP is typically complicated and costly if not done thoroughly

Cost effective for Media over IP

Script-driven is highly flexible and good solution for full automation

Numerous powerful testing capabilities for both SIP UAC/UAS, SIP Server, SDP and RTP.

Full SIP Network Simulation

Thank You

Booth #1 RADVISION

www.radvision.com

elic@radvision.com