Post on 17-Dec-2015
AgendaAgenda
SIP Testing Overview
SIP Test Topology
SIP Server and SIP User Agent Testing
Building a Practical SIP Testing Environment
ProLab TestManagement Suite
1 3 8
51
100
0
20
40
60
80
100
Req Design Code Test Main
The Importance of Early Bug DetectionThe Importance of Early Bug Detection
Early detection of software and hardware defects is crucial for mainlining development costs low
Cost of bug fixes%
Software Cycle
Test early & Test often
SIP Testing System ChallengesSIP Testing System Challenges
Minimize testing time & improve time-to-market
Testing throughout the development cycle
Perform comprehensive testing:
Load and stress
Protocol compliance
Error conditions
Network simulation
Test both signaling and media
SIP Testing System ChallengesSIP Testing System Challenges
Flexibility to change tests as needed
Change test parameters quickly
Change test topology
Ease-of-use for developers and QA engineers
Full network simulation
One or more endpoints SIP User agent
Simulate Full SIP Server application
RTP Network Simulation
Varying network topology
(cont.)
SIP Testing System ChallengesSIP Testing System Challenges
High performance and scalability
Generate very high rates of calls/transactions per second
Standards compliant
Based on SIP RFC3261 for User agent
(cont.)
IP
SIP Test EnvironmentSIP Test Environment
Simulates an endpoint capable of handling thousands of calls
SystemUnder Test
Scenario
Test results
SIP protocol
UAC
UAS
SIP protocol
Scenario
Test results
SIP Stress Test TopologySIP Stress Test Topology
Verify that the system performs under extreme conditions and test to see that system can handle intended load
DUT
UAC
UAC
UAC
UAS
UAS
UAS
IP
SIP Server Functional Test TopicsSIP Server Functional Test Topics
Proxy testing
Request and response forwarding
State full and Stateless
Reject responses (Forwarding, registration)
Server functionality routing with address resolution (forking) & loose routing
Redirect Server Functionality: Returns “Contact this address” response
Message Validation and Invalid response handling
Record route
Outbound proxy
SIP Server Performance MetricsSIP Server Performance Metrics
SIP servers typically need to handle high transaction rates
Transactions statistics:
Total Transactions per second
Total Transactions Capacity
Transactions failed per second
Percentage Transactions rejected
Calls statistics:
Calls requested per second
Calls Connected per second
Call establishment time (call setup delay)
SIP Server Performance MetricsSIP Server Performance Metrics
Registration statistics:
Total Registrations per second
Percentage Registrations rejected
Registrations requested per second
Registrations confirm per second
(cont.)
SIP Server Registrar TestSIP Server Registrar Test
Registrar & location database
Different types of expiration
Different type of TO header
Registration with other contact
Unregistration (expires=0)
Update existing registration
Registration with multiple contact
Multiple registration
SIP Server Registrar TestSIP Server Registrar Test
Security
Authentication header
Different type of nonce and Realm
Existing and non existing user
User expired
(cont.)
High Volume of Concurrent CallsHigh Volume of Concurrent Calls
Capability to send and receive thousands of concurrent calls from single or multiple endpoints
Capability to simulate thousands of media calls simultaneously
Capability to send thousands of concurrent registrations to an SIP Server
Capability to simulate different scenarios simultaneously
SIP Stress Method TestingSIP Stress Method Testing
Burst Testing (multiple invite simultaneous)
Poisson Call distribution
Poisson Call duration
Constant Call distribution (X Calls per second)
Constant call duration
Load testing
Stress Test using only signaling
Stress Test using signaling and media
SIP User Agent TestingSIP User Agent Testing
Methods (invite,re-invite,
cancel, bye, info, notify, subscribe, options, re-invite, refer , …)
Retransmission mechanism
Provisional response
Register and authentication
Add contact to register
Timer configuration
Atypical testing
SIP Parsing coding and decoding headers
Non standard message
Call Flow - State Machine
Reject response handling
Multipart mime
Body message
SIP headers test
TCP & UDP Interface
SDP PacketSDP Packet
Session information
Session name and purpose.
Time(s) the session is active.
Media information
Type of media, such as video and audio. Transport protocol, such as RTP/UDP/IP and H.320. Media format, such as H.261 video and MPEG video.
SDP With different type of Media information
SDP with Telephone-event
Different Type of SDP
Response MessageResponse Message
RESPONSE TYPES
Provisional (1xx class)—provisional responses are used by the server to indicate progress, but they do not terminate SIP transactions
Final (2xx, 3xx, 4xx, 5xx, 6xx classes)—final responses terminate SIP transactions.
CLASSES
1xx = provisional, searching, ringing, queuing etc.
2xx = success
3xx = redirection, forwarding
4xx = request failure (client mistakes)
5xx = server failures
6xx = global failure (busy, refusal,not available anywhere)
Advanced RTP TestingAdvanced RTP Testing
RTP Simulation
Packet loss , Duplicate Packets , Packets ordering
Corrupted packet & SSRC Corrupted
Delay, Jitter
Stop Sending RTP and resume.
DTMF in band and RFC 2833, DTMF in band
Advanced RTP TestingAdvanced RTP Testing
RTP Monitoring and statistics
Packet loss and Packet distribution (sender & receiver)
RTP General information (Payload, low seq #,High Seq #, SSRC, UDP, …)
Different Codecs G711, g728, G729, G722, G723.1, H261, H263,.
RTCP
Jitter, Cumulative lost , fractional lost, …
(cont.)
SIP Testing EnvironmentSIP Testing Environment
User Agent Client 1..X
User Agent Server 1..X
Test ManagementSIP Server
Media TestingDevice Under Test
SIP Server
Run Test
IP
Testing Lab ComponentsTesting Lab Components
Test Management
Script and configuration Management (typical and Atypical)
Control Test Execution (Saving result, Notification )
Test Scheduling ( Test Scheduler, Compare test result)
SIP Server
Full SIP Server Simulation (Proxy, Registrar, Location DB, Authentication)
Positive and negative response
Multi SIP Server
Testing Lab ComponentsTesting Lab Components
SIP User Agent Client/Server P Server
Simulation UAC and UAS
Media Testing
Full Media Network simulation and media monitoring
(cont.)
ProLab™ Test Management SuiteProLab™ Test Management Suite
ProLab Gatekeeper Agent
ProLab Test Manager
ProLab SIP Test Agent
ProLab H.323 Test Agent
ProLab RTP Analyzer
ProLab Test Scheduler
ProLab SIP Server Agent
Voice and Video Over IP Complete Test Solution
Controlling ProLab Test Agents and scripts management
Scheduling test scenarios
RTP monitoring and simulation
H.323 advanced endpoint simulation
Full H.323 gatekeeper simulation
SIP advanced User Agent simulation
Full SIP Proxy, Registrar and Redirect Server simulation
ProLab AdvantageProLab Advantage
Full Network simulation (SIP UAC/UAS, SIP Server , Advanced RTP and full automation)
Closely synchronized with protocol updates
Distributed Solution
SIP & H.323 Advanced Testing
Script Driven
Script & Result management
High performance and volume of calls
ProLab ApplicationProLab Application
MessageStatistics
Incoming andOutgoing Messages
MultipleAgents
CallPerformance
RTP- Packets Distribution
RTP –Packets Loss
SummarySummary
Testing Media & Signaling over IP is typically complicated and costly if not done thoroughly
Cost effective for Media over IP
Script-driven is highly flexible and good solution for full automation
Numerous powerful testing capabilities for both SIP UAC/UAS, SIP Server, SDP and RTP.
Full SIP Network Simulation