Keynote SIGOS Product Guide

PRODUCT GUIDE

All trademarks and registered trademarks are the property of their respective owners.

Various Technologies – ONE Test System: SITEAbbreviations

Keynote SIGOS test interfaces for multiple techniques BSC Base Station ControllerBTS Base Transceiver StationCDR Call Detail RecordCIMD Computer Interface to Message DistributionGGSN Gateway GPRS Support NodeGMSC Gateway MSCGPRS General Packed Radio Service (2.5G)GSM Global System for Mobile Communications (2G)HLR Home Location RegisterIP Internet ProtocolISDN Integrated Service Digital NetworkISUP ISDN User PartLTE Long Term Evolution (4G)MGW Media GatewayMME Mobility Management EntityMMSC MMS CenterMSC Mobile Switching CentrePBX Private Branch ExchangePCF Packet Control FunctionPDSN/FA Packet Data Serving Node / Foreign AgentPoC Push-to-talk over CellularPSTN Public Switched Telephone NetworkRNC Radio Network ControllerSGSN Serving GPRS NodeSGW Serving GatewaySITE SIGOS Integrated Test EnvironmentSMPP Short Message Peer to PeerSMSC Short Message Service CenterUCP Universal Computer ProtocolUMTS Universal Mobile Telecommunications System (3G)UTRAN UMTS Terrestrial Access NetworkVLR Visitor Location Register

Contents

Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

Company . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

Portfolio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

Service Quality Monitoring

Periodic QoS and QoE Testing . . . . . . . . . . . . . . . . . 14

On-Demand Testing . . . . . . . . . . . . . . . . . . . . . . . . . . 15

Network Diagnosis . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

Drive Service Testing . . . . . . . . . . . . . . . . . . . . . . . . . . 17

Content Testing / Handset Simulation . . . . . . . . . 18

Benchmarking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19

Roaming Testing

Inbound Roaming Testing . . . . . . . . . . . . . . . . . . . . 20

Outbound Roaming Testing . . . . . . . . . . . . . . . . . . . 21

SLA Testing according to GSMA (GRQ) . . . . . . . . . 22

Roaming Hubbing Testing . . . . . . . . . . . . . . . . . . . . 23

Roaming Steering Testing . . . . . . . . . . . . . . . . . . . . 24

International Carrier Quality Testing

Dedicated carrier route selection . . . . . . . . . . . . . 25

Revenue Leakage & Fraud Detection

SIM Box Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26

Early Charging Detection . . . . . . . . . . . . . . . . . . . . . 27

Revenue Assurance

Test Call / Event Generation . . . . . . . . . . . . . . . . . . . 28

CDR Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29

Tari� Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30

Prepaid SIM Recharging . . . . . . . . . . . . . . . . . . . . . . 31

Fixed & IP Network Testing

Fixed Network Testing . . . . . . . . . . . . . . . . . . . . . . . . 32

IP Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33

Core Network Testing

Testing without Radio Access . . . . . . . . . . . . . . . . . 34

Regression Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

Nomadic & Indoor Testing . . . . . . . . . . . . . . . . . . 35

GlobalRoamer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38

Worldwide Coverage . . . . . . . . . . . . . . . . . . . . . . . . 39

Use Cases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41

SITE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42

The Unique Test Platform . . . . . . . . . . . . . . . . . . . . . 42

Hardware Components & Interfaces . . . . . . . . . . . 46

Test Tools for SITE and GlobalRoamer . . . . . . 48

Reporting & Alarming . . . . . . . . . . . . . . . . . . . . . . . . 50

Test Creation Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52

Diagnosis Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53

Test Applications for SITE and GlobalRoamer . . 54

Network Registration . . . . . . . . . . . . . . . . . . . . . . . . . 56

Voice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58

Voice Advanced . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60

Messaging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62

Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64

Video . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66

Value Added Services . . . . . . . . . . . . . . . . . . . . . . . . . 68

Handset Oriented Testing . . . . . . . . . . . . . . . . . . . . . 70

Managed Services on SITE . . . . . . . . . . . . . . . . . . 74

Managed Services on GlobalRoamer. . . . . . . 75

Training . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76

Keynote SIGOS

USE CASES 12

TEST SYSTEMS 36

PROFESSIONAL SERVICES 72

INDEX 78

REFERENCES 80

5

...your worldwide partner in telecommunications testing: Keynote SIGOS

With a customer base of more than 270 operators around the world in over 110 countries...

With over 50 representations around the world, covering sales and post sales services...

With expert sta� from more than 30 nationalities...

6

PortfolioSITE – Active end-to-end test system GlobalRoamer – Managed worldwide systemProfessional Services – Consulting and more

CompanyTesting is our Competence

Introduction

7

Introduction > Company

8 www.keynote-sigos.com

Keynote SIGOSThe Company

What we doKeynote SIGOS provides scalable and fullyintegrable telecommunications testingsolutions to service network operators(mobile and � xed line as well as MVNOs)and content providers, carriers andregulators.

Our solutions and services are designedto give our customers the full picture onQuality of Service from an end-userperspective. We o� er the mostcomprehensive range of scalable activeend-to-end testing solutions availableon the market:

First commercial UMTS network

is launched in Norway

HSDPA is introduced

GlobalRoamer goes online

SIGOS provides test and integration support to all German GSM networks

1 Billion of mobile phone

subscribers world-wide

Launch of BlackBerry, PoC, Video Testing

2001 20052002

Keynote SIGOS

Industry

VoIP is now established as

communications platform

HSUPA is introduced

Keynote acquires SIGOS GmbH

SITE provides test environment

for VoIP, ADSL, DSL, HSUPA

2006 2007

Quality of Service testing (speech, data, messaging, VAS)

Quality of Experience testing (real device testing)

Service Quality monitoring

Roaming testing

Revenue Assurance and Billing veri� cation solutions

Diagnosis and Reporting tools

Core network testing solutions

Drive service

Handset simulation

Web Service Testing

1985 1987 1989 1990

First ISDN communication

system is established

The idea for GSM is born

(“Memorandum of Understanding”)

Testing and inte-gration support

for the � rst German GSM network

Foundation of SIGOS System-

integration GmbH

1991

First GSM network islaunched in Finland

(“2G”)

Active participation in standardization

process as full member of ETSI

Keynote SIGOS

Industry

19891989

SMS is introducedWorld Wide Web

(www) is born

1992

Introduction > Company

9www.keynote-sigos.com

3G starts: First CDMA2000commercial system

is launched in South Korea

SITE Testing Environment now includes mobile network End-to-

End testing

HSPA+ rollouts Beginning of LTE era (“4G”)

HSPA+ is introduced

Mobile Connections hit 4 Billions world-wide

Launch of Billing Veri� cation and

Drive Service Test

Introduction of GlobalResource Pool

GlobalRoamer to cover ¾ of the world countries

LTE Test System

Keynote SIGOS celebratesits 20 Years’ Anniversary

2008

Who we areFounded in 1989 under the name of SIGOSSystemintegration GmbH, Keynote SIGOS hasmore than two decades of broad experiencewithin the telecommunications industry, helpingour customers to be even more successful ina competitive environment.

With over 160 employees and more than30 languages spoken, Keynote SIGOS is a trulyinternational company: bringing people frommultiple cultural backgrounds together tooutstandingly serve our global customer basewith what Keynote SIGOS employees all have incommon: a true passion for telecommunications!

Our strong partner network with over 50representations around the globe rounds up ourworldwide presence.

Keynote SIGOS is headquartered in Germany where our solutions are being developedunder highest standards. Representations on multiple continents and our strong partnernetwork distributed all over the world rounds up our world-wide presence.

IPv4 addressesto run out by theend of the year

Keynote SIGOSintroduces IPv6test cases andtest interfaces

Global permanent deployment of

IPv6

Launch of testing solutions for QoE (Device Gateway,

mobiQ) and the core network interface

for LTE, S1

2012201120102009

VoIP in its infancyis used for the

� rst time

GPRS / EDGE (“2.5G”)ADSL allows high-speed

communication over phone lines

SIGOS plans a GSM core

network

SITE End-to-End testing environment for � xed line

networks is born

First commercial website

SITE DECT for type approval

tests introduced

SITE ISUP for conformance test for C7 networks

1995 19961993 1994 1997 2000

20YEARS

Key

note SIGOS

1989 - 2009

Glo

bal

Roam

erPro

fess

ional

Ser

vice

s

Introduction > Portfolio

The Portfolio SIT

E T

EST

SYSTE

M

Clients

SITECentral Unit

Fixed IP Networks Mobile

MLU

WLUCLULULU CLUCLU

LAN / WAN

Fraud Detection

RevenueAssurance

Tool

Drive ServiceTesting

HandsetSpeci�c

QoS Testing

QoS Tools for

Diagnosis & Reporting

Core NetworkTesting

RoamingTesting


GO GLOBAL with GRP

Clients

SITECentral Unit


MLU

WLUCLULULU CLUCLU

LAN / WANWANW

Fraud Detection

RevenueAssurance

Tool


HandsetSpeci�c

QoS Testing

QoS Tools for


Core NetworkTesting

RoamingTesting

GO GLOBAL withG

Fraud Detection forNational & International

Tra�c

InternationalCarrierTesting

Billing Testingfor International

Tra�c

WorldwideHandset Speci�c

QoS Testing

OutboundRoamingTesting

QoS Toolsfor Diagnosis & Reporting

Steering ofRoamingTesting

Managed Services on GlobalRoamer

Managed Serviceson SITE

Training

Your Own Scalable and Highly Flexible Testing Infrastructure

Solution Consulting, Managed Services and More – Flexible and Customizable

The Managed Global Infrastructure and Test System For The Worldwide Telecommunications Industry

With GlobalRoamer, Keynote SIGOS of-fers the most extensive infrastructure for automated telecommunication testing worldwide. We provide our customers with an extensive network of testing facilities around the globe, hosted by Keynote SIGOS. GlobalRoamer customers can use this sophisticated testing infrastructure through a web based user interface.

With the Keynote SIGOS SITE Test System – comprising sophisticated hardware and software solutions – network operators are enabled to host and work with their own testing facilities. The key is the ability to easily integrate into the existing net-work infrastructure realities. Interfaces to complementary solutions, e.g. monitoring systems, are provided so that SITE can be exactly matched to your specific require-ments.

We at Keynote SIGOS are always here for our customers: in each phase of your testing requirements we provide you with well experienced and specifically trained personnel, whether it be for project implementation, maintenance, managed services, training or solution consulting. All our Professional Services can be custom-ized to your specific needs.

All that is required is a web browser and access to the internet. Simply log on with your password and set up your test sched-ules without worrying about a thing. How-ever, Keynote SIGOS can also provide fully managed test services so that all that you really need to do is: look at the results.

The SITE Test System’s architecture is com-pletely modular. Only the modules that are needed for the required tasks need to be purchased.

Your local SITE system can go global by connecting to the worldwide Global-Roamer probes with our „GlobalResource Pool“ feature - all in one go!

For instance, with di� erent levels of Man-aged Services, we can help our customers with the management, operation and administration of tests. Our services are completely customizable and scalable: we handle complete SITE systems for custo-mers as well as manage small occasional testing. Just as you please.

11

The on-demand worldwide test platform hostedby Keynote SIGOS

One platform for all your end-to-end test requirements

Expert sta� provide assistance during all project phases

www.keynote-sigos.com

12

Keynote SIGOSsolutions in action.

Versatility is key!

Service Quality Monitoring> Periodic / On-Demand Testing> Network Diagnosis> Drive Service Testing> Content Testing / Handset Simulation> Benchmarking

Roaming Testing> Inbound Roaming Testing> Outbound Roaming Testing> SLA Testing according to GSMA (GRQ)> Roaming Hubbing Testing> Roaming Steering Testing

International Carrier Quality Testing> Dedicated Carrier Route Selection

Revenue Leakage & Fraud Detection> SIM Box Detection> Early Charging Detection

Revenue Assurance> Test Call/Event Generation> CDR Comparison Testing> Tariff Testing> Prepaid SIM Recharging

Fixed & IP Network Testing> Fixed Network Testing> IP Network Testing

Core Network Testing> Testing without Radio Access> Regression Testing

Nomadic & Indoor Testing> Nomadic Testing> Indoor Testing

The Use Cases

13

Use Cases > Service Quality Monitoring

Service Quality MonitoringPeriodic QoS and QoE testing

Slow setup time, service outages or unsuccessful data downloads are experienced in every network. In order to manage daily operations standardized matrices should be deployed by several divisions, e.g. Service Operations, Service Quality Assurance, Network Operations, International Roaming and Revenue Assurance.

In a highly competitive market, such as the telecommunications industry, provi-ding and maintaining highest quality to end customers is the key to a sustainable competitive advantage.

With customers having multiple options at hand, poor quality – even the occasio-nal drop in quality – can have immediate consequences. Switching between opera-tors never has been easier through mobile number portability.

First class service quality has many in� u-encing factors not all being under the immediate control of the operator. Iden-ti� cation of weak points can be di� cult and some may remain undiscovered even while their e� ects are still evident in the market.

Keynote SIGOS o� ers accurate measure-ments of end-to-end quality for voice and data services by measuring KPIs like call setup success rates, HSDPA, HTTP average throughput or service degradation of BlackBerry services.

Taking around the clock automated measurements at the end user’s interface (rather than in network nodes) operators obtain in-depth insight into end-user’s percep-tion of the network.

Generation of active test calls 24/7 – without the cost of 24/7 sta� - covering all aspects of the network and the upload of KPIs to a centralized alarming system provides excellent real-time feedback on the service levels of the network.

Active testing bene� ts

Testing time Continuous heartbeat tests

End user experience Best re� ection of end user experience: E2E service quality tests Test Quality of Service and Quality of Experience

Time to detect issues Identi� cation and localization of service and network issues can be achieved before actual service degradation and threat of revenue loss

Operating costs Reduced operating costs by automating monitoring, testing, and reporting; increased personnel e� ciency; costs not correlated with network size and growth

Testing scope Pro-active test approach can be realized; in control of testing scope

14

See your network through the eyes of your customers


KPIs to a centralized alarming system provides excellent


On-Demand TestingPerform reproducible ad-hoc testing!

The test call can be replicated repetitively in order to check whether service has been re-established.

GlobalRoamer is deployed to survey speci� c services over roaming partners’ networks managing both post-paid and prepaid SIMs across the di� erent techno-logies. The SIMs are co-located in Keynote SIGOS’ premises in Nuremberg, Germany.

Root causes can be localised easily when used in tandem with Keynote SIGOS’s integrated analysis tools.

Time zone and business hours di� erences often make it di� cult to run tests with the co-operation of roaming partners. GlobalRoamer o� ers an easy and instant solution to this problem.

“If a real time test is needed, and it´s too late to contact a roaming partner, I can re-produce the test scenario identically.”

“There is no time lost as we do not have to get in touch with the roaming partner. We can execute tests via GlobalRoamer in a matter of a few minutes anywhere in the world where SIGOS has cover-age. Before we started to use GlobalRoamer sometimes we had to wait more than 3 months for execution of a roaming test because partners were occupied with other roaming partners’ tests.”

“The SIGOS test system helps us to manage our test SIMs e� ciently as we do not have to send the SIMs to multiple countries for roaming testing. It provides us with a fully controlled test platform. We can perform multiple test cases easily and simultaneously.“

The customer service desk keeps getting complaints about certain service scenarios like ‘BlackBerry e-mail service not reliable’, ‘basic voice calls not possible’ in certain locations, in the home country as well as abroad. Quick action needs to be taken!

15



Worldwide TestingKeynote SIGOS hosts the largest and most comprehensive worldwide test infrastruc-ture, currently covering 4/5 of the world‘s countries. GlobalRoamer users bene� t from the availability and � exibility of the GlobalRoamer test network without the e� ort of running their own system. GlobalRoamer account holders log on and schedule their tests whenever the demand occurs. Being able to perform tests inde-pendently and without the usual hassles connected with doing business globally like time-zones is an invaluable asset!

Home Network TestingSITE enables network operators to test all relevant services in their network with a private test system. All locations covered by the private SITE system can be used for � exible end-to-end testing. Due to their modular structure, SITE test systems can range from a small local system to geogra-phically widely distrubuted areas as well.

The unique feature‚ ‘Global Resource Pool‘ however, enables operators to expand the capability of their SITE system – no matter how small or big it may be – to reach out to worldwide test locations covering 4/5 of the world‘s countries! In fact, they are enabled to utilize the huge network of GlobalRoamer test probes – all in one go!

BSC 12LocationUpdate2G

MSC 4

GPRS backbone

Router

SGSN 2GPRS_Attach2G

GGSNPDP_ContextActivation VPN Tunnel

INTERNE T

InternetDL_DurationHttpAv

Opera serverDL_DurationHttpAv

Opera server

Network DiagnosisModel your network & � nd the root cause of service outages!


SITE proves not only to be a good re� ec-tion of real customer experience but also shows up bottlenecks in the network infrastructure via its solution Service Alarm Map (SAM).

By supervision of all relevant end-custo-mer services and correlation of network events it becomes possible to both anticipate and analyze service a� ecting network problems. A clear and compre-hensive mapping of service problems to the performance of individual network elements and systems can then signi� -

cantly reduce downtime and speed up time back to service.

Service Alarm Map helps to reduce the time for root cause identi� cation and supports the technical service teams with additional information like error-id, trace details & measurement values. This important drill-down functionality from service chain visualization to raw measurement values and trace informa-tion improves reaction times in the event of tra� c congestion and network element failures.

“The number of customer complaints have been reduced signi� cantly due to network issues being identi� ed faster by the Keynote SIGOS test system. Real-time alerts and reports of incidents lead to faster resolution of the network issues identi� ed. Subscribers are “not fast enough” to call our Customer Care to lodge a complaint.”

Once periodic heartbeat testing for the services has been set up, very often Service Operations is the � rst team to detect service outages through the results of this activetesting. But what network entity has caused the fault?

16


Example: The Service Alarm Map (SAM) indicates a problem on BSC12



Drive Service TestingTest mobile subscriber experience on the move!

SITE is a powerful tool for the delivery of Service Assurance and generation of leading Key Performance Indicators (KPIs) for operator networks, not only for static testing but also for mobility, simulating end user experience.

Equivalent to the behavior of static Local Units, the SITE System collects a variety of network measurements from moving subscriber probes, known simply as Mobi-le Local Units (MLUs). These mobility tests are geared for vehicles like taxis, trucks or trains. Consequently they are called SITE ‘Drive Service Tests’. The raw information is processed into KPIs and displayed in a Google Maps view or on a color coded geographic map.

Drive Service Testing provides you with Service QoS KPIs (Voice Quality etc.) as well as many speci� c measurments (RxLevel, Handover, Call ID, MAIO...)

Unattended SystemSITE Drive Service Test is a completely autonomous system after installation. No engineer needs to be present in the vehicle for test setup, modi� cation or analysis.

Easy Installation and RemovalMLU is shipped fully pre-con� gured and only needs to be connected to the electronic on-board system. No further human interaction, not even switch-on is required.

Geographic ViewSITE system delivers graphical views on your network quality. A comprehensive set of KPIs enriched with further infor-mation like speed of moving vehicle, al-titude and position can be displayed on a map. Google Maps or WMS maps, e.g. operator’s own coverage map, display KPIs customizable by operator.

Investment ProtectionDrive Service Tests are fully SITE com-patible and can be performed as an extension to existing SITE systems securing current investment into Keynote SIGOS service assurance products.

SITE has already been widely deployed for periodic QoS testing and KPI generation. Quality of subscriber experience however is not only driven by static service use but also by service rollout on the move. Testing during moving is an important complementary approach in addition to stationary testing.

17



Content Testing / Handset SimulationDo all handsets work perfectly in your mobile network?


Data Services like Web and WAP browsing, streaming, MMS or video telephony are ARPU driving services.

Premium content download is another huge revenue driver. Subscribers‘ ex-pectations on quality of service are legiti-mately high.

At the same time, handset speci� c behavi-or plays an important role in the delivery of this content and services.

Delivered content not displayed in the ex-pected format causes a de� nite negative impact on customers‘ Quality of Experi-ence (QoE).

How can new devices and services be properly tested in a cost-e� ective way that ultimately leads to customer satisfac-tion and increased revenue?

The answer is automated testing while taking handset speci� cs into account – handset simulation.

Keynote SIGOS provides a powerful hand-set simulation tool, integrated into the SITE and GlobalRoamer test systems.

More than 1,000 virtual handsets are available from a ready-to-use and ex-pandable library. Simulate the large varie-ty of handsets without the e� ort of labor intensive manual testing.

Handset Simulation Test Concept Features:

Simulation of real subscriber behavior, taking handset speci� cs into account Automated testing of services like Web and WAP browsing, MMS, streaming, video

telephony, content download Interfaces: GSM/GPRS Um, GSM Gb, UMTS Uu, HSDPA, HSUPA, EDGE, Iu PS Real End-to-End mobile content testing of various handsets Validation of received content with mobile pro� les Database with more than 1,000 mobile device pro� les and their relevant parameters New customer or country speci� c handsets can easily be integrated

Mobile operators and advertisers are � ercely competing to sell exciting new mobile content. However, the variety of available services like MMS, Video Strea-ming and Web Browsing may cause problems when using di� erent handsets, since the service platforms of the network react individually to each mobile phone type!

Picture and text in wrong position

18



Static Test ApproachNetwork benchmark assessment is executed using an active end-to-end test scenario to observe the performance of your network from a subscriber point of view.

Typical static benchmarking tests are performed at airports, city centres, mega sports or social event venues and hot-spots where masses of people congregate.

“On-the-Move” Test ApproachDrive Service tests have the ability to co-ver di� erent geographical areas of locally competing networks rather than being focused on static locations.

This simulates subscriber behavior moving from one cell to another and provides a comprehensive performance overview of the complete network.


BenchmarkingWho is the best performer?

In the competitive mobile environment, consistently high QoS is crucial. Bench-marking is an important dimension to make sure your services are competitive.

National ApproachMost measurement projects start o� with a national performance investigation and comparison after national network rollout has been completed. Operators have to � nd innovative ways to outperform their competition on network and service quality.

With the SITE test system, network services can be benchmarked against the compe-tition, measuring internationally approved and recognized Key Performance Indica-tors (KPIs) in a fast and easy way.

International ApproachIn order to get a comprehensive overview of multinational or group-wide bench-marks, GlobalRoamer’s extensive global footprint can perform international ben-chmark tests and ensure improved cost e� ciencies.

Benchmarking of international carriers is an important step in ensuring high quality of service for the international tra� c impacting your revenue.

Service performance is benchmarked with national competitors as well as international operators: Static testing Drive service testing Outbound roaming testing (e.g. GRQ)

KPIs for own network are regularly reported to senior management. But how does your network perform compared to the competitors? Who has the best performance? Who o� ers the highest quality of service (QoS)? What is the quality situation for your international tra� c?



Inbound RoamingProvide best service to visitors in your network!

Use Cases > Roaming Testing

Features for inbound roaming testing:

SITE o� ers the right concept for inbound roaming testing: Core network test interfaces (A, Gb, IUCS, IUPS) for testing roaming, independently of radio speci� c problems Air interface testing for measuring real end-to-end behavior and experience SIM Multiplexer: SIM cards can be managed centrally and securely for all roaming

partners (as many as 2,000 SIM cards) Detailed KPI test reports according to GSMA standards Test sets according to IREG 24, 26, 27, 29, 32, 35, 50, 60 from GSM MoU

Testing according to GSMA IREG stan-dards is required whenever a new roaming partner is added. It can be a very time-consuming and exhaustive task. It may absorb your most expert sta� and repetitive testing can be just as expensi-ve as the initial test setup – if performed manually!

Therefore, test automation is key for cost e� ectiveness and operational e� ciency. With the SITE system your sta� will per-form IREG speci� c tests in much shorter times with less e� ort – and the results will be easily reproducible!

Implementation of testing for new ro-aming partners could not be easier: the SIM card is implemented into SITE‘s SIM Multiplexer which can be expanded to a capacity of more than 2,000 SIM cards.

As soon as the SIM card has been imple-mented, sta� can run the necessary tests.

Ready-to-use test cases are available for the execution of tests, according to IR 24, 26, 27, 29,32, 35, 50, 60. These tests can be repeated at any given time!

The test results are automatically pro-cessed into GSMA conformant reports ready for evaluation.

Today, subscribers expect all frequently used mobile services to work reliably everywhere in the world. Thus, the quality and availability of services inside and outside the home network becomes increasingly important in the battle for customers!

Inbound roaming has a big impact on your revenue and a long list of international roaming agreements may be desireable. It comes at a cost: each and every roaming agreement with a new roaming partner requires intense testing according to GSMA standards. In addition, periodic roaming tests with the most important roaming part-ners need to be performed. How can e� orts be reduced?


Get the full picture of your roaming services


Outbound Roaming TestingAssure QoS abroad to optimize and develop outbound roaming revenue

Nowadays it is quite easy to travel the world. Traveling subscribers take availability and proper operation of all mobile services for granted. Outbound roaming contributes considerable revenue and therefore requires QoS assurance.

Operators require information on service quality beyond their own network. To subscribers, perceived mobile quality when traveling abroad is vital, especially for corporate customers.

Mobile operators need to ensure subscri-bers are able to log onto preferred ro-aming partners’ networks when traveling, whilst preserving consistently high levels of QoS to maintain long term business sustainability.

When your subscribers arrive at a foreign destination, they expect their mobile service to work at all times.

All relevant services need to be tested with at least each top roaming partner. If you depend on these partners to execute these required tests, it will be a huge task, considering availability of sta� , time zone di� erences and the like.

The solution is the world‘s largest auto-mated on-demand test network: Global-Roamer. Tests can be executed in more than 500 networks in three quarters of the world‘s countries. GlobalRoamer is hosted by Keynote SIGOS and can be accessed from anywhere in the world by logging on through a web interface.

Why risk losing subscribers and roaming revenue, when the ability to test the per-formance of all your roaming partners isat your � ngertips?

Standard services as well as complex technologies and services like Video Tele-phony, MMS and UMTS/HSDPA networks can be tested without the need for co-operation with your roaming partners and independently of time zone.

Use GlobalRoamer, the most extensive global infrastructure for automated active End-to-End testing hosted by Keynote SIGOS. With GlobalRoamer you can access an ever increasing number of worldwide networks through a web interface.

LUP-avail. GPRS-avail. Speech SMS

21



“Thanks to GlobalRoamer we were able to increase our outbound roaming capability dramatically in very short time.“

SLA Testing according to GSMA GRQConsistency & comparability of roaming QoS testing


Since the tra� c in outbound roaming has a big value for operator revenue, it is impor-tant to monitor the most frequently visited roaming operators. The GSM Association has designed the right concept: GRQ.

Roaming tra� c may be a low percentage of the entire network tra� c, but remains a signi� cant pro� t contributor.

How to gain a global perspective on roaming quality with consistent measu-rements and thus comparability between home network and visited networks?

And how to achieve this goal in a cost e� cient manner?

The Global Roaming Quality (IR.81) standards – developed by the GSMA in cooperation with selected partners like Keynote SIGOS – provide an answer to this question regardless of the monitoring and testing methods used.

GRQ is a comprehensive framework for pro-active testing and assurance of end-to-end roaming services quality.With SITE and GlobalRoamer you have a unique tool to monitor your SLA agree-ments with numerous roaming partners.

Keynote SIGOS is a self-certi� ed vendor of the GSMA GRQ compliant test systems.

Key Bene� ts: Cost-e� cient co-operation with

roaming partners by adherence to a shared set of QoS KPIs Improve operational cost e� ectiveness,

by automated testing and realtime reporting Increased Roaming revenue through fast

resolution of home and visited networks’ SLA violations

27 Active QoS parameters on voice, data and SMS tra� c KPIs for � ve di� erent categories:

Network access Service Accessibility Connection Establishment Connection Substainability Connection Quality

Why GRQ?

Common understanding about the criteria for measuring Quality of Service in outbound situations Developed and de� ned by GSMA Focus on periodic testing of service

quality Applied for monitoring of top roaming

partners

22



GRQ Parameters, de� ned by GSMA# GRQ Parameter

nameCategory Description Major

targetMinor target

KPI alarm

Trend report

1 CS LU SR Voice Circuit Switched Location Update Success RateNetwork Accessibility Circuit Switched

95% 98% yes X

2 CS LU Delay Voice Circuit Switched Location Update Delay 50s 10s

10 CLI Voice CLI Transparency 95% 98% x

11 SpQ Voice Speech Quality 2.5 3 x

12 SA-MO SMS Service Accessibility SMS MO 95% 98% yes X

13 SA-MT SMS Service Accessibility SMS MT 95% 98% yes X

14 AD-MO SMS Access Delay SMS MO 10s 4s

15 AD-MT SMS Access Delay SMS MT 10s 4s

24 Throughput Data Throughput (kbit/s) X

25 Goodput Data Goodput (kbit/s) X

26 Roundtrip Time Data Roundtrip Time

27 Packet Loss Data Packet Loss 2% 1%

...

...


Roaming Hubbing TestingConnecting the world with a single roaming relationship

Roaming hubs safeguard multi-lateral roaming and interworking relationships. How can a roaming hub concentrate on managing the key roaming priorities?

Open Connectivity (OC) is replacing multiple bilateral roaming relationships between operators with a more e� cient hub-based approach. Open Connectivity enables multi-lateral roaming and inter-working relationships via SMS hubbing and roaming hubbing.

Keynote SIGOS’ worldwide, on-demand test platform caters for roaming hubs. It enables them to perform tests of Out-bound Roaming services, IREG testing for Inbound Roaming, and QoS Monitoring, as well as GRQ testing.

It improves operational and cost e� ci-encies because of the automated test

approach and real time reporting feature.Roaming hubbing providers are often tasked to actively monitor service avai-lability and service quality on all their multilateral relations.

GlobalRoamer allows the activation and testing of Roaming Hubbing customers’ SIMs. It helps them to work more e� ci-ently to improve the quality of voice, data and SMS services for their customers.

Keynote SIGOS’ GlobalRoamer can add value to many aspects of the Roaming Hub business model. GlobalRoamer is an ideal enhancement to hubs.

PMN B PMN A

Signalling

RoamingCoordination

Data Services

CAMEL

SMS-IW& MMS-IW

One agreement

Reduced complexity Increased availability

One relation

PMN C

Clearing

PMNPMN PMNPMN PMNPMN PMNPMN PMNPMN PMNPMN

PMN B PMN A PMN C

23



Roaming Steering TestingAre subscribers roaming with preferred roaming partners abroad?


Steering of Roaming (SoR) solutions have been implemented by mobile operators in order to direct their outbound roamers to preferred VPMNs in each country. In some cases just one preferred VPMN in a country is chosen, in other cases SoR is about managing the proportion of revenue and tra� c shares between two or more VPMNs.

SoR is the logical result of roaming/IOT agreements which are linked to volumes and percentages for one or more prefer-red VPMNs. On one hand it is a signi� cant commercial matter to detect short- or long-term deviations from these target distributions, on the other hand it is worthwhile to test potential deterioration of customer experience caused by SoR.

Detection of Anti-Steering of Roaming is essential as operators may lose subscri-bers to non-preferred networks resulting in margin losses. Anti-steering is not only a breach to roaming agreements but may also lead to a bad roaming experience as the subscribers could be left without any coverage. Subscribers will not blame

the VPMN but their subscribed home network. Subscribers will also not be able to bene� t from the special roaming retail tari� s that have been o� ered to them. By detecting anti-steering activities, high-er roaming costs can be avoided.Operators’ primary business goal is to streamline roaming steering mechanisms such that outbound roaming revenues are optimized while maintaining high levels of end user satisfaction.

KPIs (examples): Location Update Duration also delive-

ring indication of deterioration of end user experience Number of PMNs rejected number of

quad attempts or roaming not allowed rejects List of rejected PMNs non-preferred

PMNs tried PMN after successful steering also

indicating successful SoR at all LUP mode (automatic/manual) testing

correct behavior of SoR Server for manual selection Reject Causes (i.e. Network Failure,

PLMN)

Steering of Roaming (SoR) has been rolled out by Operators in order to direct their out-bound roamers to preferred VPMNs in the roaming destinations. Does it work?

Preferred!Preferred!

OutboundRoaming

OutboundRoaming

OutboundRoaming

VPMN B HPMN

VPMN A

VPMN C

Location Updating Request

MSC/VLRSoR node HLR/

AuC

Location Updating Request

Location Updating Reject

Location Updating Reject4x

Location Updating Accept

Non-Preferred VPMN 1

HPMN

Preferred VPMN 1

1

2

3

4

9

Update Location

Update Location

UpdateLocation.error

UpdateLocation.error

4x

InsertSubscriberData

UpdateLocation.ack

InsertSubscriberData.ack

Update Location

MAP messages

5th attempt is on next VPMN;in this case the preferred PMN

24



Use Cases > International Carrier Quality Testing

International Carrier Quality TestingWho is the best international carrier of choice?

There is a need for both mobile and � xed operators to get a global perspective on interconnection service quality in order to maintain high levels of QoS to subscribers. The international interconnection quality experience is heavily in� uenced by the choice of the international carrier at the national boundary.

Example of international CLI quality testing

By testing international carriers with an active monitoring system, you can not only monitor if the right calling number is displayed abroad but also the voice quality and call setup time, which can be e� ectively measured and reported.

In addition, international carrier quality testing can be coupled with False Answer and SIM Box Detection.

Testing with pre� xed called numbers re-quires knowledge about the current setup at the international gateway exchange. The deployment of an SS7 LU directly at the international gateway Exchange ensures dedicated interconnection carrier testing.

Poor CLI and voice quality would inevitab-ly decrease revenue and market share.

For example, if no CLI is received, there would be no possibility to call back and poor voice quality would result in short and frustrating conversations.

Maximising revenue is essential in an en-vironment of falling wholesale prices. This objective can only be achieved if you have consistently high quality on your network and on your international interconnection.

KPIs (examples): Received CLI on destination side CLI Indicator distinguishing the follo-

wing cases: CLI from CgPN (“OK”) No CLI (“N”) Wrong CLI (“W”) Mean Opinion Score (PESQ MOS) for

Voice Quality (ITU-T P.862.1) Call Setup Time

Setting up a call to a subscriber in a foreign country involves the choice of the relevant international interconnection carrier. How much impact has the interconnection carrier on QoS? Who is the best interconnection carrier partner?

Global Resource Pool

InternationalGateway

Dedicated carrierroute selection

KPI / SLA monitoringPrivate SITESystem

Global Resource Pool

InterconnectionCarriers

25

Stay in control of com-munication beyond your network


Revenue Leakage & Fraud DetectionMake sure your roaming revenues are not being detoured

Use Cases > Revenue Leakage & Fraud Detection

SIM Box Detection

SIM boxes have multiple negative e� ects on operators, roaming hub providers andcustomers alike, e.g.:

revenue loss due to call redirection - roaming calls are intercepted, redirected and terminated via fraudulent SIM Box equipment.

unnecessary investment due to service inaccessibility as a result of SIM Boxes creating false network congestion issues.

revenue loss through CLI Quality Problems; immediate impact is the in-ability to „call back“.

image loss through bad QoS as SIM Boxes often redirect calls over inade- quate, highly compressed IP connections, resulting in poor voice quality. Call setup time is extended which leads to the impression of bad call quality from the home network operator.

“Fraud“ - the word sounds quite exciting when it appears on a cinema billboard or a TV programme schedule but when it hits you personally, professionally, or in a corporate environment, it is much less enticing. Fraud will never be completely eliminated but, unless fraud management countermeasures are undertaken, it is unlikely that it will be reduced to a manageable level.

The business goal is to gradually “clean” incoming tra� c terminating through SIM boxes by disconnecting all SIM Box numbers detected and to protect the network from any potential fraudulent upsurge in their use.

Fraud Bypass Detection Features: Reliable detection of SIM boxes Safeguard your revenues Cost-e� ective concept for fraud

bypass detection Ensure � rst-class end user experience

through quick elimination of SIM boxes High test density possible while

avoiding network congestion

SIMSIM Box

Operators

Local SIMs are used to terminateinternational incoming tra�c BTS

Air interface

Local Retail rate(B) 0,10€

(D) 0,13€International Interconnect

Termination rate

RegularTransit

(C) 0,15€

Originating Networks:> PSTN> Mobile> VoIP> Carrier Select (CS)> Calling Cards> Carrier Pre Select (CPS)

Terminating network operator loses0,03€ per minute, i.e. (B) - (D)

(A) 0,14€

Originating Network Terminating Network

GMSC

26

Identify leaks in your revenue stream


Keynote SIGOS SIM Box Detection is BABT certif ied.

Use Cases > Revenue Leakage & Fraud Detection

Early Charging DetectionGet it right for your customers

A common phenomenon is the scenario of Early or False Answer during voice call setup procedures. How do you detect and � ght these cases?

Calls are being charged as if connected, without ever reaching the called party. The lack of Active End-to-End monitoring has led to millions of minutes being inaccurately billed to the originating calling parties worldwide. These fraudu-lent billings sometimes go unnoticed because the incremental billed call duration per user may be in the fraction of seconds.

Prepaid SIMs used in GSM Gateways (SIM Boxes) could lead to false answers when the fraudulent SIM Box SIM credit has been consumed resulting in an announce-ment being played. In this instance the caller has to pay for the call connection leading to customer complaints and dis-satisfaction with the service rendered.

Fight fraudulent charges to your custo-mers’ accounts with GlobalRoamer, the worldwide distributed test infrastructure for end-to-end testing.

Bene� ts: Reduce revenue leakage caused by

early charging / false answers Ensure billing accuracy and � ght

interconnect fraud Improve quality of calls leading to a

reduction in customer complaints and dissatisfaction Active end-to-end monitoring ensures

consistency in billing

Internationalcarrier(s)

Answer

Fraudulent early return of Answer message resultingin charging record for non-delivered service

International carrier(s) releases answer message even though call(s) are not setup

Unexpected answer on A-side detected and NO incoming setup on B-side

Setup is not even sent to B-PartyCall is not established

SetupSetup

Originating Network(CUSTOMER) Terminating NetworkTerminating NetworkTerminating NetworkTerminating Network

Internationalcarrier(s)

Answer

Setup is not even sent to B-PartyCall is not establised

International carrier(s) releases answer message even though call(s) are not setup

Unexpected answer on A-side detected and NO incoming setup on B-side

Fraudulent early return of Answer messageresulting in charging recod for non-deliveredservice

SetupSetup

Terminating Network(CUSTOMER)

CUSTOMER´s SIMson Roaming(CUSTOMER)

Fraudulent early return of Answer message resultingFraudulent early return of Answer message resulting

(CUSTOMER)

Fraudulent early return of Answer message resultingFraudulent early return of Answer message resulting

on Roaming

Fraudulent early return of Answer message

on Roamingon Roaming

27

Identify leaks in your revenue stream


Revenue AssuranceMoney makes the world go round – what happens if your network rating and billing are not correct?

Test Call/Event Generation

Use Cases > Revenue Assurance

For all network operators validation of billing is of major importance. Operators must provide fair and accurate billing to the customer and also avoid revenue leakage or overcharges caused by services being incorrectly rated and invoiced. In most countries accuracy of metering and billing is mandatory to comply with legal regulations.

As markets have become increasingly competitive, operators have used innova-tive tari� s, product and service bundles and discounts to di� erentiate themselves. Complex and fast changing tari� s inevita-bly create challenges in ensuring correct billing.

Test call and event generation can be as basic as creating network events by gene-rating calls to test the correct function of a network or its subsystems.

SITE is ideally suited as a Test Call/Event Generator for Revenue Assurance projects generating its CDRs to be referenced with the network’s ‘live ‘CDRs.

Operators need to recognize the value of more than just test call generation; you need to be able to store CDRs to perform veri� cation and detection for errors AUTOMATICALLY.

Testing that is both end-to-end and inde-pendent can provide the assurance that the customers are being correctly billed as well as satisfying compliance require-ments.

Today, manual tests not only provide in-accurate, untrustworthy but in most cases cost ine� cient testing. To ensure correct billing, a precise and reliable Revenue Assurance system is essential. With a SITE test system, continuous testing of all services provides maximum assurance that all calls are being correctly billed as each network element can be tested and veri� ed.

How to guarantee correct billing? Three Revenue Assurance concepts are highlighted: Test Call/Event Generation CDR Testing Tari� Testing

New product pre-launch testing – can we bill accurately and reliably for the product?

Testing of correct function after product updates – does the mediation system still summarize all CDRs correctly?

Testing of software patching on switches and other infrastructure – are we still producing correct CDRs for all call classes?

Testing new infrastructure during and after roll out, e.g. new base stations.

Testing of roaming tari� updates – are roamers, still being billed?

28

Ensure correct billing, for you and yourcustomers


The reliable Revenue Assurance solution comprising CDR generation, CDR comparison and tari� modeling is BABT certi� ed.


CDR TestingTimely detection of revenue leakages

You want a solution which compares CDRs generated by network nodes like the MSC or SGSN in a highly automated way and sends alarms mismatches.

SITE acts as a Test Call/Event Generator, it is capable of importing ‘live’ CDRs from the network and comparing them with the reference CDRs generated by SITE.

The ‘live’ CDRs of the generated test calls are extracted at a chosen point in post-processing for automated comparison by the test system.

CDRs can be veri� ed and erroneous CDR � elds such as faulty time stamps and call duration can be detected.

CDR Structure

Record Type: e.g. TimeBased, VolumeBased, EventBased

Service Type: e.g. SPEECH, FAX, GPRS Begin of event: timestamp in milli-

seconds A Number B Number Call Duration (Time based calls) Data Volume (Volume based calls) Event Count (Event based calls)

Live NetworkLive Network

SITE CDRs(unrated) Operator CDRs(rated or unrated)

Test CallGeneration

SITE System

Automated E2E Call Processing

Virtual SIM Transfer

CDRPost-processing

unrated CDR ComparisonReferenceCDRs

Virtual SIM TransferVirtual SIM TransferSITE System

Live CDRs

CDR Import CDR Import*

Reference CDRs derived from SITE test results Live CDRs imported via e.g. csv-�les

Rated CDRsUnrated CDRs

* Customization required

Filter*

Billing

CDRsMediation

System

Are Core Network nodes like MSC or SGSN generating the right CDR data? Deploy a test event generator which generates CDRs that you can compare with your network CDRs.

29

Ensure correct billing, for you and your customers


Tari� TestingProactively monitor tari� plans against various test cases


You want a solution which not only compares CDRs but also detects billing errors befo-re they turn into customer complaints or revenue losses.

BillingOnce a CDR has been rated it is applied to the customer‘s account, where discounts can be applied and from which a bill is created. Operators usually produce bills in cycles, spreading the load over a month or quarter and also evening out cash � ow.

Within SITE your tari� model can be repli-cated. Thus, not only the raw data of CDRs can be compared but in addition also the correct billing of a service can be veri� ed. Thanks to SITE, fast regression testing of new pricing plans against a variety of test cases can be performed, detecting potential � aws in the billing process at a very early stage.

RatingAt the heart of the billing system is the rating engine. This takes the CDRs (call detail records) or IPDRs (internet protocol detail records) from the network, and then applies the appropriate rating plans to turn this information into rated CDRs ready to be associated with the customer.

Invoice comparison Resource allocation for di� erent users

or groups Detailed test reports Revenue stream audit Covering billing aspects of outbound

roaming

Rating

Billing Veri�cation

Live NetworkLive Network

SITE CDRs(unrated) Operator CDRs(rated)

Test CallGeneration

SITE System

Automated E2E Call Processing

Virtual SIM Transfer

CDRPost-processing

unrated CDR ComparisonReference

CDRs

Virtual SIM TransferVirtual SIM TransferSITE System

Live CDRs

CDR Import CDR Import*

Rated CDRsUnrated CDRs

* Customization required

Filter*

Billing

CDRsMediation

System

Tari� Model

Tari� Model*

30




Prepaid SIM RechargingWith prepaid subscribers you make substantial pro� ts

Prepaid subscribers expect correct voucher recharging.

Keynote SIGOS provides a tool to verify Prepaid SIM Card Recharging.

SITE or GlobalRoamer have the ability to check if recharging procedures of prepaid cards has been performed successfully.

Test Cases collect information about the current account balance and establish a call in the same way a subscriber does. That means entering vouchers using DTMF tones for navigating IVR menus or using USSD commands where supported. After a SIM card recharging attempt the account balance of a dedicated prepaid SIM card is re-checked and compared to balance before recharging attempt.

Besides using single vouchers (e.g. from scratch cards) for a single test, Keynote SIGOS Test Systems support compre-hensive voucher repository functionality managing numerous numbers.

Further customer speci� c account veri-� cation methods (e.g. via SMS) are also supported on request.

Sample KPIs Initial account balance

Account balance after recharge

Used Voucher for recharge

Received USSD response string

USSD process duration

Sample Features Detection of revenue leaks due to SIM card

recharging errors

Increase of customer satisfaction and spending due to error free SIM card recharging

Simpli� ed prepaid SIM card handling in the central SIM Multiplexer

31



Use Cases > Fixed & IP Network Testing

With the explosive growth in the mobility arena, one could almost believe that the future of � xed networks was doomed. However, � xed networks continue to maintain their relevance, with technological evolution requiring new test approaches.

Fixed Network TestingNGN evolution calls for multi-technology testing

Technological advances and the complex changeover from established technologies to new ones triggers the need for ensuring consistency of service quality over all underlying technologies.

Poor service quality inevitably leads to loss of pro� t – if, for example, the line is bad the conversation will be short.

With the SITE test system, Keynote SIGOS provides ONE platform for testing all technologies – � xed, mobile and IP-based, either within one technology or across technologies.

Fixed network operators bene� t from SITE through:

Periodic service quality testing Ad-hoc service quality testing

SITE supports all interfaces required for � xed network testing:

PSTN ISDN

DSL IP (VoIP)

KPIs for � xed network testing (examples):

Delay Echo Delay

MOS Value

32

Beyond mobile – the other kind of telecommunications


Testing in all network technologies, mobile, � xed and IP

Use Cases > Fixed & IP Network Testing

IP Network TestingOptimize your data network performance

Slow access, error pages and unsuccessful orders? Just started VoIP services? Are you re-lying on your customers to � nd out about incidents, availability, speed and load issues?

Mobile has made its impact on connec-ting the ‘last mile‘, particularly for voice communications, but has yet to make its impact on higher speed links and at least one mobile company has admitted that it cannot deliver the speeds contained in the 3G speci� cations.

So where do � xed networks with IP con-nections beat radio-mobile? When capa-cities and speeds are high, where Internet access is required or where there are large � les to be downloaded, then the optical � bre link remains supreme, whether it is a link to a corporate client, a national backbone network or an international submarine cable system.

SITE measures the user perception of your services

SITE checks the quality of your calls in real time

Use SITE for proactive supervision! Secure your IT with SITE End-to-End

monitoring!

SITE measures and alerts you in real time!

Web Browsing (HTTP)KPIs (examples): Duration between the �rst and last http data packet HTTP Data Size Duration of web browsing session HTTP Valid Page Content

Ping (ICMP)KPIs (examples): Round-trip time (min, mean, max) Packet loss Size of Ping packet

DNSKPIs (examples): DNS Query Duration (min, average, max) DNS Host Name Resolution Time DNS Host Name Resolution Failure Ratio

FTPKPIs (examples): Network Non-Accessibility File Size Download Duration Upload Duration IP Service Failure Ratio

TCP/IP CommandKPIs (examples): TCP/IP command Duration of TCPIP command

SOAPKPIs (examples): Response Time of SOAP server in seconds

33

Beyond mobile – the other kind of telecommunications


Use Cases > Core Network Testing

Core Network TestingService Testing independent from Radio Problems

Testing without Radio AccessIn some cases the active test approach of using test mobiles on an air interface can be counterproductive because radio speci� c problems can disturb results with-out adding any value. A typical example is roaming testing, where the problems come from the core network. For such cases there is bene� t in testing the ser-vices by means of simulating the radio access part, connecting directly to the core components such as the MSC, SGSN etc. without involving the radio access components.

Regression TestingAnother instance where connection direct to core network components is required is where tests need to be executed in a very short time. This is typically the case when network components like the MSC or SGSN have been updated or where the in-� uence of a high number of concurrently connected subscribers has to be checked immediately and automatically. Such kinds of regression testing can usually be executed in less than 20 minutes whilst still covering all services and subscriber pro� les.

Typical use cases for testing without radio access part:

Interactive Voice Response incl. interactive announcement tests Testing of Supplementary Services Testing of IN Services Inbound Roaming tests Load Tests on Core Network

components Billing Testing via CDR tests Data Content Testing Handset Simulation etc.

Typical advantages of core network testing:

Not in� uenced by radio speci� c problems Fast execution of mass tests

(e.g. thousands of tests in an hour) Quick results Detailed trace analyses with

protocol stack information

Typical use cases for regression testing without radio access part:Automated regression testing after upgrade/updates on:

MSC (via GSM A) MSC and � xed network switches

(via ISUP) SGSN (2.5G) via Gb MSC-Server via IuCS SGSN via IuPS SMSC, MMSC WAP-, Web-, Mail-Server SCP testing including IN services

and prepaid services etc.

34

Inside out – core net-work testing can save money


Mobile Core

Network Interfaces

Mobile Core Network

see page 2

Use Cases > Nomadic & Indoor Testing

Nomadic & Indoor TestingPortable local unit for � exible deployment and mass testing

Rural Areas: Where there are people there should be communication.

Sports and Social Events: Testing campaign of short time frame and short notice.

Indoor: Shopping and Exibition Centers or Airports – places of communication.But do mobile services work properly everywhere?

Especially in remote areas it is often im-possible to install local units, as no � xed IP connection is available. In this case the nomadic local unit is capable of estab-lishing a permanent IP connection via GPRS/EDGE/HSPA modem. The connec-tion is upheld via IPSec tunneling. By this means, test probes can be quickly ins-talled in rural areas where you cannot rely on wired IP connections. The Nomadic local unit is the ideal solution for � exible deployment in the � eld.

The Nomadic local unit is also ideally suited for short-term campaigns like sport events. A lot of sports fans gather at top level events like Formula 1 or soccer championships and expect high levels of service quality. Due to its fast instal-lation the nomadic units can be quickly rolled out even at short notice. After easy deployment at temporary locations this autonomous system sends network infor-mation back via its air interfaces.

There are a lot of interesting and revenue generating use cases for indoor testing. Especially in international airports where testing of inbound roaming characteris-tics is crucial to secure lucrative business. Also exhibition centers and shopping centers are typical buildings where subcribers very often experience lack of service. Furthermore it is worthwhile to mass-deploy the cost-e� cient nomadic units in o� ce towers with a lot of business customers. For indoor testing either the air interfaces or direct LAN connection can be recommended.

35

Reach out to remote and temporary locations


36

Keynote SIGOStest systems adapt to your demands.

Invest in the future!

The Test Systems

Clients

SITECentral Unit


WLULULULU CLUCLU

LAN /

Fraud Detection

RevenueAssurance

Tool


HandsetSpeci�c

QoS Testing

QoS Tools for


Core NetworkTesting

RoamingTesting


Tra�c



Tra�c


QoS Testing




GlobalRoamerThe Reference System for worldwide testing Largest footprint of test probes around all around the world Managed and serviced by Keynote SIGOS Extensive set of test case applications

SITEThe Unique Test Platform for various technologies Mobile / Fixed / IP testing Core Network testing Globalize with GRP

37

Clients

SITECentral Unit


WLULULULU CLUCLU

LAN /

Fraud Detection

RevenueAssurance

Tool


HandsetSpeci�c

QoS Testing

QoS Tools for


Core NetworkTesting

RoamingTesting

GO GLOBAL with GRP

Test Systems > GlobalRoamer

GlobalRoamerThe On-Demand worldwide test platform!

ChallengeEnd users demand and expect a high quality, reliable service from their chosen network operator and a similar experience regardless of where in the world they are.

Therefore, permanent surveillance of the roaming network is indispensable but extremely di� cult due to a lack of opera-tional visibility of the roaming partners’ networks.

How does it work?For testing in mobile networks, by means of Keynote SIGOS SIM Multiplexing technology, your SIMs are capable of being virtually transmitted to any of GlobalRoamer’s extensive network of remote test stations in more than 230 locations, where tests simulating end customer experience are performed. Complete, real time visibility of the resulting network messaging allows rapid fault resolution. GlobalRoamer also allows you to perform tests across technologies, e.g. Fixed and IP networks as Fixed Mobile Convergence (FMC) beco-mes more prevalent!

SolutionGlobalRoamer allows you to verify that all services are available to your customers who are traveling worldwide. With test probes in 180+ countries you have your world wide testing platform without investing in infrastructure. Just buy your testing package and run your tests world-wide.

38

Automated active End-to-End Testing and Monitoring Get the full picture on what your

customers experience worldwide Initiate reproducible test cases which

cannot be done with passive monitoring solutions

Unique SIM Multiplexing Technology SIM cards are hosted centrally from

where they are virtually transmitted to any of GlobalRoamer’s remote test stations where the actual test is performed

Global Testing Network GlobalRoamer’s extensive global

network of test stations allows access to three quarters of the world’s countries and is continuously being expanded


Managed Services are on o� er to all Operators looking for an e� cient solution!



All you need to do

Order your account at Keynote SIGOS For testing in mobile networks:

send your test SIM cards to Keynote SIGOS! Access the worldwide test network

via the internet! De� ne and set your tests running! Collect the results!

GlobalRoamer Login

GlobalRoamer is growing continuously. Please contact us for the current footprint and more details.

Q4 2012

The World at Your FingertipsEnter the most extensive global network test system from your desk and gain access to:

NETWORKS

677677

675675

677677677677677677677677677

675675675675675675675675675675675675

676

COUNTRIES

187187

185185

187187187187187187187187187

185185185185185185185185185185185185

186

LOCATIONS

251251

249249

251251251251251251251251251

249249249249249249249249249249249249

250

How to access GlobalRoamer?

GlobalRoamer country

GlobalRoamer location


40

The Time-Saving and Customizable Tool-BoxEnjoy the Convenience of Prede� ned Tests and Reports – Whilst Keeping the Option to Customize

The Cost-e� ective Testing SolutionTake Advantage of Deploying GlobalRoamer – Without Having to Think About Labor Intensive Operations

Comprehensive libraries of test cases and report templates – save valuable time Customer-speci� c test cases and

reports allow for full � exibility User-friendly web-based graphical

user interface

Simply start using GlobalRoamer – no maintenance, no CAPEX No setup or exit fees for

GlobalRoamer use Flexible packages available (‘prepaid’

for ad-hoc testing / ‘� at-rate’ for periodic testing) Pay-as-you-use concept

The High Performance Global Test InfrastructureOn-Demand End-to-End Test System for Roaming Situations and More…

Get access to test 600+ networks in more than 90% of the world’s countries Continuous growth of telco networks

accessible through GlobalRoamer Fully hosted and continuously

expanded by Keynote SIGOS 2G, 2.5G, 3G and LTE network probes Fixed network probes available

The Independent Round-the-Clock Event GeneratorBene� t from Availability and Accessibility to the Whole World –Anytime, Anywhere

Easy web access allows 24/7 availability, irrespective of time-zones Independence and convenience

through pre-scheduled automated test execution Massive worldwide test capacity,

your SIMs can be used almost anywhere at any time

The Reliable Sentinel – Always on DutyKeep Track of Your Network – On-time and Relevant Information Delivery at your Fingertips

Extensive alarming, performance noti� cation and reporting functionality Customizable alarms to alert you to

any network issues Adjustable information-depth (from

high-level overview to deepest-deep details) Continuous network surveillance with

reports (several styles, from graphical to plain text)

What isGlobalRoamer?




Service Quality in outbound roaming(on-demand testing / periodic testing) Full range of QoS applications

(Voice / SMS / Data) (page 14)

Outbound Roaming Testing GRQ GSMA compliant testing (page 22)

Steering of Roaming (SoR) Testing Evaluation of proper application of

Steering of Roaming and detection of Anti-Steering activities (page 24)

Fraud Detection for International Tra� c SIM Box Detection, False Answer

Detection (page 26)

International Carrier Quality Testing Full range of QoS applications

(Voice / SMS / Data) (page 25)

Revenue Assurance in an international context CDR Comparison, Roaming Tari�

Model Testing (page 28)

International Interconnect Management CLI Veri� cation, Voice Quality (MOS),

Call Setup Time, Call Attempt Success rate…etc. (page 25)

Benchmark Testing in operator groups See how your network performs

within one operator group (page 19)

Service Level Agreement (SLA) Veri� cation Verify the ful� lment of Service Level

Agreements (page 22)

Handset speci� c Testing in outbound roaming Automated content testing with a

broad selection of simulated handsets (page 18)

Mobile Network Operators Fixed Network Operators Mobile Virtual Network Operators

(MVNO) Carriers Content Providers Regulators

Departments (Examples):

Service Quality Management Operation and Maintenance Roaming Billing Fraud Management Marketing Interconnect International Business Revenue Assurance

Clients from all over the world rely on GlobalRoamer

Use Cases forGlobalRoamer

Who bene� ts fromGlobalRoamer?

Use Cases


Tra�c



Tra�c


QoS Testing




SITEOne platform for all your End-to-End test requirements

Test Systems > SITE

ChallengeToday, network operators are confronted with an extremely dynamic market and the challenges of keeping up with new technology, permanent surveillance of Service Level Agreements (SLA) and redu-cing cost – whilst also maintaining custo-mer satisfaction. Since these tests can be both, labor-intensive and costly they are too often neglected. To meet these chal-lenges preventive and permanent Service Quality Assurance by means of End-to-End testing is essential.

SolutionKeynote SIGOS has developed the most advanced automated test system available on the market. SITE is the proven and � exi-ble test platform for cost- and time-saving automated Active End-to-End testing. With SITE, telecommunication operators all around the world bene� t from its unique versatility. SITE’s modular structure and scalability ensure it can always be matched exactly to your requirements. In addition, your local SITE system can go global by connecting to the worldwide GlobalRoamer probes with our ‘Global Resource Pool’ feature – all in one go!

Get the full picture of your end users’ experience (QoE) and act, instead of reacting to customer complaints Continuously monitor service availability, test and measure quality (KQI) and performance (KPI) Upfront testing ensures a smooth roll-out for new services and new technologies Initiate reproducible test cases which cannot be done with passive monitoring solutions Comprehensive network diagnosis, reporting and alarming Services can be tested before commercial release

Why Automated Active Testing and Monitoring with SITE?

Identi� cation and localization of service and network can be achieved before actual service degradation and threat of revenue losses Reduced time and risks to install or modify network infrastructure by providing extensive recursive testing capability Reduced operating costs by automating monitoring, testing, and reporting; increased personnel e� ciency; costs not correlated with network size and growth Number of test cycles is � exible

42

Why SITE?

SITE Solution Tests ALLNetwork Services Network Interfaces

SPEECH DATA

DATA IP (CS/PS)

E-mail

Streaming

Video Quality

Digital Rights Mgmt.Echo

Video Telephony

Web/Wap Browsing

IuCS / IuPS

GSM A

ISUP

IN / CAMEL

MAP (HLR/VLR)

SS7

GSM Gb

LTE Uu

UMTS Uu

EDGE

CDMA 2000

GSM-R

GSM Um

HSPA+ / DC

WLAN

Ethernet

MM7

SMTP / IMAP

SMPP, UCP, CIMP

DSL

Voice

Suppl. Services

IVR

VoIP

Push-to-Talk

Voice Quality

SMS

Mobile IM

iPhone

BlackBerry

MMS

ISDN S0

PSTN a/b

ISDN PRI S2m

MESSAGING FIXED RADIO IP CORE

POP3

S1


Test Systems > SITE

Open, Modular and Customizable – Just the Right System, Always SITE is an open system and can be easily integrated into existing test environments

Existing equipment can be directly linked to SITE and controlled and monitored through the SITE system

Software updates, con� guration modi� cations and problem resolution are quickly and reliably performed by Keynote SIGOS

SITE’s modular structure – software and hardware – guarantees maximum � exibility in service and protocol testing

From portable and Stand-Alone Systems in test laboratories to distributed systems covering the geography of an entire live network, everything is possible

ONE Test System, ENDLESS Testing Options SITE uniquely combines Quality of Service (QoS) testing with the ability to deliver Core Network Testing – all in ONE test system Mobile, Fixed, VoIP testing Protocol test interfaces

SITE enables both, single technology testing as well as cross technology testing Mobile / Fixed / IP-based - all kind of combinations can be tested 2G, 2.5G, 3G and beyond – all mobile network technologies can be tested

SITE enables thorough testing of all relevant mobile and BlackBerry services, even taking handset speci� c characteristics into account if desired Voice Messaging Data Video Value Added Services

SITE provides test solutions for billing veri� cation and other revenue assurance related applications

43

What is SITE?


Clients

SIMMultiplexer

SITECentral Unit


MLU

WLUCLULULULU CLUCLU

LAN / WAN

Fraud Detection

RevenueAssurance

Tool


HandsetSpeci�c

QoS Testing

QoS Tools for


Core NetworkTesting

RoamingTesting

Test Systems > SITE

The SITE Architecture – Ensuring High-Performance, Security and Stability

SITE runs on a stable, Linux based server solution o� ering highest standards of redundancy.

SITE client workstations can be either Windows or Linux based.

To ensure maximum performance, the SITE System uses an open SQL database.

All con� guration information, test results, measurements and KPIs are stored logically, to provide clear measurement and reporting capabilities.

Using powerful � lter functionality any database listing can be easily modi� ed and a multi-format export function allows the sharing of data with other network support tools.

Behind the Scenes – SITE’s Unique Test Management

SITE can execute tests at any time desired. Via the scheduler window a single or group of tests can be de� ned once or periodically, based on very � exible selection criteria of date, day, time, frequency and number of repetitions.

To avoid any resource con� ict, an intelligent resource management system controls access to interfaces and SIM cards, assuring smooth operation and maximum test parallelism.

The self-management checks system components regularly and generates an alarm (SNMP-Trap) in the event of any failure.

User role-based GUI always gives the right level of information to the user

Central SIM Multiplexing Technology – an Unparalleled ‘Teleporter’ for SIM Cards

SIM cards are centrally hosted and virtually transmitted to any of the system’s remote test stations where the actual test is performed.

SITE can handle thousands of SIM, USIM or Micro-SIM cards in cascade-style boards.

Subscriber information from a SIM card is read out by the system and transmitted via a LAN/WAN network to any test location required.

The SIM authentication procedure is handled virtually between the wireless interface in any location and the real SIM stored in the central SIM Multiplexer unit.

Intuitive Workbench – Tailored to Users’ Speci� c Demands

Comprehensive set of tools are available for Test Creation, Diagnosis as well as Alarming and Reporting to adapt SITE exactly to user demands. (see page 50)

Con� gurable user access rights

User-friendly and intuitive Graphical User Interface which can be accessed from Windows and Linux platforms alike through the Inter- or Intranet.

Role-based GUI views provide the right level of information and tools depending on the user’s role (Test / Report / GIS / Admin).

44

How does it work?

NetworkExpert

TestManager

Test CaseDesigner

TestAnalysis

TestAdmin

TestDesign

Test/Report

GIS

GIS

SystemAdministrator

SystemHealth

DataBases

Admin


Test Systems > SITE

Globalize your SITE system and take o� with GRP!With Global Resource Pool your SITE system gets access to test probes all over the world

Most SITE solutions are deployed for testing networks within national bounda-ries. Some existing SITE installations cover international testing by deploying SITE Local Units in neighboring countries for purposes of outbound roaming testing and fraud detection.

The unique ‘Global Resource Pool’ (GRP) feature now allows users to connect pri-vate SITE systems with the worldwide net-work of GlobalRoamer test probes. By this, it means your local SITE system can get access to Keynote SIGOS hosted probes in more than 580 networks worldwide!

As GRP connects to GlobalRoamer, which comes as a scalable pre-deployed infrastructure owned and managed by Keynote SIGOS, Operators are liberated from cumbersome manual implementati-on, operations and maintenance of these Remote Test Interfaces.

GRP currently contains GSM Um and UMTS Uu interfaces which are all available for testing.

45

Connect your local SITE system to the worldwide GlobalRoamer probes with the unique „Global Resource Pool“ feature!

GO GLOBAL with GRP


Hardware Components & InterfacesScalable and highly � exible infrastructure!

Central UnitThis is the base of the whole Keynote SIGOS Test System SITE. Everything impor-tant is integrated: O&M Manager, Schedu-ler, Resource Manager and Test Execution Manager.

Central Unit Extensions (CUX) are impor-tant to give the possibility to increase the number of parallel running test cases.

SIM MultiplexerThe SITE SIM Multiplexer has the capacity to handle up to 225 SIM cards at a time. There is no limit to the number of SIM Multiplexers connected to the SITE System, resulting in an unlimited capacity to mana-ge thousands of SIM cards.

Any SIM authentication procedure is handeled between the real SIM stored in the Multiplexer and the relevant interfaces (wireless / core).

19” (rack mount) 100 V - 240 V, max 8A – 4A, approx. 450 W

SIM Server 100-240 V 1A, 50/60 Hz Low power consumption Compact design, only 3HU Compatible for SIM, Micro SIM, USIM,

R-UIM Automated voltage negotiation for

each SIM card positionSIM Card Board

19” (rack mount)

SIM Server 100-240 V 1A, 50/60 Hz

Main HardwareComponents


Test Systems > SITE > Hardware Components & Interfaces

46

Test InterfacesKeynote SIGOS’ SITE Test System supports the whole range of today’s telecommuni-cation networks. Testing them needs multiple interfaces which are integratedin the SITE systems.

Sample Interfaces

47

All Components:Developed by Keynote SIGOS, made in Germany.


Device GatewayAs extension to an existing SITE System the Device Gateway enables the connection of real devices (USB data sticks and Smart Phones) for QoE testing.

Remote Components

Remote ComponentsThe remote units, also called local units, are installed wherever they are needed for 2G, 2.5G, 3G and LTE or core network tests.

1) stationary: to be used in a static location2) portable: can be moved from one location toanother3) mobile: can be used along the way

Test Systems > SITE > Hardware Components & Interfaces

CLU5 / WLU5

Nomadic

MLULocal Unit

48

Keynote SIGOS provides you with the optimal tools.

Deliver high performance!

Reporting & Alarming> Dashboard> Matrix Report> GIS

Test Creation Tools> Test Case Editor> SITE Recorder> Test Sequence > Control Structure

Diagnosis Tools> Service Alarm Map> 3G Layer 3 Tracing

49

The Test ToolsOn SITE and GlobalRoamer

Test Systems > Test Tools > Reporting & Alarming

Reporting & AlarmingFully integrated in GlobalRoamer and SITE

SITE and GlobalRoamer Reporting enables users to create, view and forward multiple reports. These reports are generated from measurements collected in the KPI data-base. These reports can either be based on Keynote SIGOS standard Key Perfor-mance Indicators (KPIs), customized KPIs or KPIs according to ETSI standards.

Report creation is done by means of an easy drag-and-drop arrangement. SITE and GlobalRoamer Reporting o� ers the possibility to visualize test results using various graphical tools, serving even very speci� c presentation and monitoring needs.

Measurement processing: from test execution to test reports

Flexible standard charts and diagrams as well as enhanced functionalities like “histograms”, “percentile”, “ad hoc repor-ting” and “derive to” can be immediately generated from recorded KPI data.

Real time alarming is also embedded: resulting alarm noti� cations are automa-tically distributed via SMS, e-mail, SNMP, etc. to de� ned recipients. Users can de� ne threshold-settings, counters, severity triggering points, etc. which control when alarms should be generated or cleared. Reports can be illustrated in di� erent ways, either charts in various formats; markers, bars, lines etc, or by matrix tables to provide a fast color coded overview of vital services or speci� c KPIs.

Who bene� ts from reporting functionality? Telco Service Manager, who read service performance reports Network Experts, who analyze test results and trace information Report Designer, who set up reports

All solutions of SITE and GlobalRoamer Reporting allow the users to observe KPI perfor-mance in an optimal way: analysis of trends / analysis of incidents based on locations or based on service problems.

50

Test Execution on di�erent locations

OnlineReporting

Test Executions

Raw-Measurements(Input and Output)

MeasurementsStrategy / KPI design

KPI Database

real timereporting

alarming

PostReporting

ReportDe�nition


Reporting Alarming

Test Systems > Test Tools > Reporting & Alarming

DashboardThis Graphical User Interface (GUI) system tool provides a simpli� ed intelligent interface to SITE and GlobalRoamer repor-ting. It is of special interest to the people responsible for the service, who want to work intuitively without any training e� ort. KPIs can easily be � ltered and indi-vidually stored in a few clicks. Individual con� gurations allow additional, more customer-oriented, data analysis. Fast and easy drill down to individual traces is possible directly from the Dashboard.

Matrix ReportThe Matrix Report environment allows the user to view Key Performance Indicator (KPI) data as a numerical value, which can be easily color coded to provide a quick, easy to understand overview of network performance. Service KPIs can therefore be displayed in a format which is espe-cially useful for Network Management and Operations personnel.

GISFor service testing “on the move”, a Google Maps based Geographical Information System (GIS) is integrated into SITE.

Each drive test case collects position data from a GPS receiver during ”visibility“ of GPS satellites. These are displayed in a GIS. This means that after service testing a rich set of KPIs according to GPS data locally analysed, displayed on operator´s individual geographic maps or on Google Maps.


Dashboard Matrix

GIS

Test Creation ToolsEasy and time saving con� guration!

Test Systems > Test Tools > Test Creation Tools

Test Case EditorSITE provides large libraries of Test Cases for main network services in various formats with detailed parameter options. It is also possible to create customized test cases by means of the assembly of various test steps via a user-friendly drag-and-drop mecha-nism that SITE provides in its Test Case Editor environment. Complex scenarioscan be quickly built to enable the testing of new network services.

SITE RecorderThis Tool allows intuitive automated recor-ding of browsing actions taking handset characteristics into account.

Mobile and provider speci� c web and WAP pages are retrieved from the net-work via the test probes during recording sessions to get a feel for real download behavior and latency. Traces are shown live while the developer is browsing.

The test case can be evaluated before saving the entire browsing session for re-play. Full feature support by the Test Case Editor makes later adaptation of recorded browsing sessions easy. It is like having full and instant remote control access to a speci� c handset or browser in a remote location – with no need to travel anywhe-re to use it.

Control StructureThe Control Structure enables test users to easily create tests at various locations and with di� erent SIM cards. It uses the logical operators:

list based ”FOR EACH“ condition based “REPEAT” time based ”WAIT“

Test SequenceThe goal of the test sequence concept is to save execution time by avoiding the resource consuming location update pro-cess being repeated for each subsequent test case.

Usually a test case starts with a switched o� mobile terminal. The side-e� ect of this approach is that each test case has the following procedure:

location update make a call (service test 1) switch o�

Each of these steps often require more than one minute each to complete.For saving test execution time, an arbitrary number of service tests can be combined in one test sequence, which requires only a single location update.

This e� ectively simulates typical mobile user behavior e.g.:

switch on a mobile (location update) make a call (service test 1) send an SMS (service test 2) web browsing (service test 3) make a call (service test 4) switch o�

Test Case Editor

SITE Recorder

Test Sequence

Control Structure


Test Systems > Test Tools > Diagnosis Tools

Diagnosis ToolsKeep the overview or go into details!

Service Alarm MapThe Service Alarm Map is used to visua-lize mobile network services that target a speci� c service area. Alarms that are generated by the failure or degraded performance of services can be linked to a speci� c network element within the operator’s infrastructure.

This function is implemented by careful correlation between the speci� c elements used within a test case execution and the overall network topology which has sup-ported the test scenario that generated the alarms.

Keynote SIGOS o� ers SIGOS o� ers Layer 3 tracing for 2G, 3G and LTE which is very important for telecommunication net-work testing. The primary goal is to get a deeper insight into the message � ow and the protocol data exchanged between mobile station and network.

On Qualcomm-based mobile probes Keynote SIGOS records traces of the Layer 3 Non-Access Stratum (NAS) signalling messages sent and received by the mobile.The information contained in these traces is vital for monitoring and trouble-

An example could be a WAP test initiated from a wireless interface located at latitude (x), longitude (y). The topology for this sce-nario would use speci� c BTS/node B, BSC/RNC infrastructure, assigned to an MSC/SGSN � nally reaching a speci� c content portal.

Each piece of network information and trace is processed to provide signi� cant data on the actual network performance and functionality, � nally the data is combi-ned to give a total service area view.

SERVICE ViewWith Service view you get an easy high level overview about the status of the whole network.

DETAILS ViewThe Details view is accessed via single network elements of theService view. It shows exactly which test case leads when to which failures.

shooting the communication between mobile station and core network. Optionally, the NAS traces are supple-mented with traces of Radio Resource Control (RRC) signalling messages exchanged between the mobile and the radio access network. These RRC traces provide valuable additional information, facilitating monitoring and troubleshooting of the Access Stratum (AS) as well.

For 2G and LTE, Non-Access Stratum (NAS) Layer 3 tracing is supported.

Layer 3 TracingDeeper insight into message � ow with Layer 3 tracing

Service Alarm Map

3G Layer 3 Tracing


54

Keynote SIGOS allows you to test the full range of services.

Always at your service!

Network Registration> Location Update> GPRS Attach

Voice / Voice Advanced> Voice> Interactive Voice Response> Push-to-Talk> Supplementary Services> Voice Quality

Messaging> SMS> MMS> Mobile IM

Data> Data IP> E-mail> WAP / Web Browsing

Video> Video Telephony> Video Quality> Streaming

Value Added Services> Ring Back Tone> Digital Rights Management

Handset oriented testing> BlackBerry> iPhone> Handset Simulation

The Test Applications

55

Test Systems > Applications > Network Registration

Each mobile subscriber wants to be able to communicate in the cellular telecom-munications network without having to consider whether the network technology is 2G, 2.5G or 3G.

This requires a successful mobile device registration on the base station subsys-tem (BSS). This is always the � rst step for further communication.

Even if a call is not set up, the network needs to be able to communicate with the mobile handset to pinpoint where it is. Hence, a mobile network is divided into multiple cells (Base Transceiver Stations - BTS). And a group of cells is considered a location area.

A mobile device in motion keeps the network informed about changes in di� e-rent location areas. If the handset moves from a cell in one location area to a cell in another location area, the mobile device should perform a location area update to inform the network about the new locati-on of the mobile device.

Each Keynote SIGOS test case requires this successful network registration.

Network RegistrationFundamental for all mobile services!

Network Registration

Location Update

GPRS Attach

Sample KPIs Location Update Duration

Received Signal Code Power

RX Level

Service Type

GPRS Attach Duration

PDP Context Activation Duration

Location Update procedure is performed:

when the mobile device has been switched o� and wants to become active, or

when it is active but not involved in a call, and it moves from one location area to another, or

after a regular time interval because of signal fade

Some aspects of the registration procedure:

make contact with the base station

the mobile device registers to the network for access

to start a voice and/or data session

Network location registration is not only necessary for each call, but also for location based services like “friends-� nder”!

56

multiple cells (Base Transceiver Stations - BTS). And a group of cells is considered a location area.

A mobile device in motion keeps the network informed about changes in di� e-rent location areas. If the handset moves from a cell in one location area to a cell in another location area, the mobile device should perform a location area update to inform the network about the new locati-


PDP ContextActivation

PDP Context

GPRS AttachRequest

GPRS Attach

Ciphering Mode-ActivationCiphering Mode-Activation

AuthenticationAuthentication

Identi� cationIdenti� cation

GPRS AttachRequest

GPRS Attach

Location UpdateRequest

Ready for circuit

switched services (Voice...)

Ready for packed

switched services (Data...)

Test Systems > Applications > Network Registration

Location Update for CS / PS Domain RegistrationWhenever a mobile device wants to ob-tain service from a cell, it must make sure beforehand that its subscriber’s SIM can be registered for that cell.

By switching on the mobile device, it directly requests to update its current lo-cation information in the network. If this is performed successfully, the network ack-nowledges this with a message “Location Update Accept”. During this process, the network can ask for the mobile device’s identity and check it against reference data (Identi� cation and Authentication).

When the service “con� dential subscriber identity” has been activated, a new Tem-porary Mobile Subscriber Identity (TMSI) assignment becomes a component of the location update. In this case enciphering of user data is activated and the new TMSI is transmitted together with the message “Location Update Accept”.

The TMSI is used for security purposes, so that the International Mobile Subscriber Identity (IMSI) does not have to be trans-mitted over the air interface. The TMSI is a randomly assigned identity, which is updated each time the mobile device is in motion.

GPRS Attach for mobile data connectionGPRS Attach is the process during which the mobile device informs the packet core network about its presence in the network. The device usually initiates the GPRS attach after power on. The message sent to the new Serving GPRS Support Node (SGSN) contains the last assigned TMSI, location area information, etc.

After the GPRS Attach, procedure when the mobile device is attached to SGSN and has been authorized, the mobile de-vice is prepared for data communication. So when the mobile starts communicati-on, it initiates establishing of Packet Data Protocol Context (PDP context activation).

Location Update

Ciphering Mode-ActivationCiphering Mode-Activation

AuthenticationAuthentication

Identi� cationIdenti� cation

Location UpdateRequest

Location Update

Mobile switch on


Network Registration

Location Update

GPRS Attach

VoiceDo not ignore your core services!

Voice services are fundamental to tele-communications companies. It is vital that the user experience of these services is measured continuously by active test-ing. Only this can assure the quality of this core service.

Veri� cation of various KPIs are performed on basic voice parameters, such as check-ing B-channel availability, measuring call establish duration and call success rate alerts, to name a few.

Voice ServicesThe basic elements for telecommunication!

Test Systems > Applications > Voice

Sample Features CLI Check

Call establishment to external party

Call establishment between two parties

Call establishment without answer on external side (no connective costs)

B-Channel check

Check of all available PLMNs

Sample KPIs Call Duration

Received CLI

Establish Duration

Alert Duration

Voice

Push-to-Talk

Interactive Voice Response

Suppl. Services

Push-to-TalkBack to the Future with Push-to-Talk!

The “push-to-talk” services turn mobile phones into walkie-talkies with unlimited range.

The bene� t of radio-style communication, especially broadcasting to multiple users, makes it much more convenient than making many phone calls or even call conferencing.

Sample Features

Test 1-to-1 or 1-to-many communication

Play and record speech data

Emulating PTT mobiles

Real End-to-End Testing of real-time-always-on voice service

Check SIP (Session Initiated Protocol) Control Plane

Check RTP (Real-time Transfer Protocol) User Plane

Sample KPIs Stop-Talking Timer Failure Ratio

Stop-Talking Time

Session Cut-o� Ratio

Session Setup Time

Voice Delay (in session)

Voice Delay (� rst)

58 www.keynote-sigos.com Phot

o ©

T-M

obile

AG

Test Systems > Applications > Voice

IVR services are deployed during Voice-mail access and are a common feature of everyday life such as phone banking, ticketing and customer hotline services.

Testing these systems is essential for network operators (and their customers) to assure the quality of their services. IVR systems are sophisticated and extremely

Interactive Voice Response (IVR)Do your voice response services work correctly?

di� cult to test on an active and reliable basis.

Keynote SIGOS innovation has created atool that can wholly automate this task. The IVR tester is designed so that even the most sophisticated speech menus may be recorded and recognized based on a library of voice prompts.

Sample Features Testing IVR trees Voice mailbox tests Resource allocation for di� erent users

or groups Announcement comparison based on

new voice prompts Easy integration of new voice prompts DTMF and voice stimulation Customer speci� c extension Several languages available

Sample KPIs Call Duration

Duration of played audio � le

Length of recognized reference prompt

Duration of recognition process

Recognition con� dence of best recognized

Reference prompt

Recorded audio � le location

Real duration of recording

Supplementary services like call forwar-ding, call waiting, call barring, call hold, CLIP/CLIR are multi-switched services which require complex interaction within the network and its elements.

Other supplementary services, like pre-paid customers checking their current ac-count balance, involves the GSM protocol USSD (Unstructured Supplementary Ser-vice Data). At the same time, seamless and instant operation of all supplementary

Supplementary ServicesAre your customers satis� ed with your supplementary services?

services, including noti� cations and coding of all relevant information are vital for a satisfying end-user experience.

Keynote SIGOS Test Systems provide you with a comprehensive range of test cases for all relevant KPIs and the ability to test USSD protocol commands as well as operator speci� c extensions, so that your customers will pay you compliments on your supplementary services!

Sample Features Supplementary Service tests e.g.

‘Call Forwarding’ ‘Call Hold’ ‘Call Barring’ ‘CLIP’ / ‘CLIR’ ‘Call Waiting’ ‘Multi Party Call’

DTMF and voice stimulation testing

USSD testing

Sample KPIs Forward Erase Duration

Forward Register Duration

Received CLI

Barring Activation Duration

Call Hold Duration

USSD Received Response


Voice

Push-to-Talk

Interactive Voice Response

Suppl. Services

Voice AdvancedDo you o� er excellent Voice Quality?

Test Systems > Applications > Voice Advanced

Voice Quality

Referenced VQ (PESQ/POLQA)

Unreferenced VQ (3 SQM)

Echo Testing

Voice over IP Quality Testing

Voice QualityDo you o� er excellent Voice Quality?

Voice Quality is, and will remain, the major key performance indicator for each operator’s network quality. This is recog-nized by subscribers and operators alike.

Bad voice quality represents noise, echo, degraded tele-conversations and immedi-ately sets a poor level of user satisfaction.

International Carrier Voice Quality tests can reveal crucial quality information of di� erent network carriers and if it has been impacted by the usage of IP routing or SIM boxes. Therefore, veri� cation of voice quality is essential.

Automated test methods with the inten-tion to mimic subjective tests, allow for a cost e� ective and consistent alternative to subjective testing, either on a referenced or an unreferenced algorithm.

Echo TestingIn the course of the migration of 2G/3G Core Network (CN) and Radio Access Network (RAN) towards IP based transport solutions the importance of Echo measu-rements raises considerably.

In SITE, the echo itself is generated arti� cially and its characteristics can be con� gured by the user. This allows for the simulation of well de� ned (acoustic) echoes that enables users to check whe-ther the echo cancellers are con� gured correctly.

Referenced Voice Quality Testing (PESQ and POLQA)Referenced Voice Quality testing is based on the ITU-T P.862 standard via the PESQ algorithm (Perceptual Evaluation of Spe-ech Quality) and the ITU-T P.863 standard via the POLQA algorithm (Perceptual Objective Listening Quality Analysis).

Both form the state-of-the-art techniques and international standards for automa-ted advanced perceptual voice quality analysis, comparing actual test results with audio references. Referenced voice Quality Testing provides a very high level of accuracy.

Sample KPIs POLQA MOS value (P.863)

PESQ MOS-LQO value (P.862.1)

Background noise

Average delay

Attenuation

Signal to noise ratio

Sample Features Reference speech quality

assessment model

Accurate full-reference model

Customer speci� c audio reference � les are easy to integrate

Objective Mean Option Score / Perceptual Evaluation of Speech Quality (MOS-LQO / PESQ)

MOS Voice Quality result values from 1-5

Support of super-wide-band signals up to 14kHz

Sample KPIs Echo Return Loss (ERL) in dB

Echo Delay in ms

Echo Classi� cation (acceptable, unacceptable, side tone)


Test Systems > Applications > Voice Advanced

Keynote SIGOS Test Systems also support the Single Sided Speech Quality Measure 3SQM™ (ITU-T P.563) for advanced non-intrusive voice quality testing. The tech-nology behind 3SQM™ is based on a generic perceptual approach and so is independent from any original reference signal.

In comparison to intrusive measurement techniques, such as PESQ, 3SQM™ is based on single ended measurements. In con-sequence, accuracy may not be as high but measurements can be worked on an analysis of the digital bit stream on an IP packet level. The measurement is limited to the transport stream analysis.

Voice over IP Quality TestingVoice Quality is vitally important for any type of network that routes voice tra� c. With the shift from dedicated circuits to the e� ciency of IP based tra� c, it brings its inherent issues with regard to the end customer’s satisfaction with quality performance.

Additional PESQ KPIs such as Real-time Transport Protocol (RTP), Jitter and Packet Loss are actively monitored.

Performing checks on a comprehensive set of voice quality metrics ensures that IP networks run smoothly and problems are detected before they cause major disturbances leading to customer dissatis-faction.

Sample KPIs 3SQM MOS value

Noise level

Background noise

Beeps

Signal to noise ratio

Additional KPIs RTP Jitter

RTP Packet Loss

Sample Features Perceptual analysis of degradations in

voice signals

Non-intrusive, single ended analysis method

Output score correlates well with subjective MOS

Available as DLL/Library or Source

Unreferenced Voice Quality Testing (3SQM™)


Voice Quality

Referenced VQ (PESQ/POLQA)

Unreferenced VQ (3 SQM)

Echo Testing

Voice over IP Quality Testing

MessagingAre your Messaging Services delivered reliably and on time?

Test Systems > Applications > Messaging

SMS

MMS

Mobile IM

Short Message Service (SMS)One of the favored message services!

This simple network application results in large percentages of revenue for every mobile network operator. Therefore, this critical revenue stream would require con-stant active monitoring so as to achieve consistently high quality of service.

SMS often su� ers from long delivery durations, modi� cation of content or missing text with multiple SMS messages.

Due to roaming complexities, SMS messa-ges may be “lost” resulting in non-delivery of the service paid for by the subscribers.

Sample KPIs SMS send duration

SMS deliver duration

SMS end-to-end duration

SMS Success ratio

Sample Features Check functionality of SMSC

Check SM Service functionality at peak times

Check SMS transmission time


Test Systems > Applications > Messaging

MMS are vital to the network operators’ younger and higher ARPU (Average Revenue Per User) customers. With its complex functional combination of SMS and GPRS, it is easy for the service to become unavailable in a complex mobile network that is often being upgraded or optimized.

In order to gain acceptance as a reliable service frequently used by the subscri-bers, network errors must be avoided and uncovered by performing active conti-nuous tests.

This will safeguard the reputational health of the operators and ensure high quality standards.

The real time text based communication between two or more participants is po-pular on PC devices, e.g. Skype, ICQ, MSN, Yahoo, Google… etc. This instant mes-saging platform has made the leap from the PC to the mobile device, connecting friends, peers and colleagues while they are on the go.

To get connected to either � xed or mobile IM users, Java applets are installed on mobile devices delivering branded IM user interfaces. A single device client may provide access to multiple IM systems which transmit and receive presence information.

The device clients have to be compliant to the Open Mobile Alliance (OMA) Instant Messaging and Presence Service (IMPS).

Sample KPIs MMS send duration

MMS fetch duration

MMS push arrival to receive MMS Duration

MMS connection to send duration

MMS send to push arrival duration

MMS end-to-end duration

MMS Success ratio

Sample Features No MM storage limitations

MM to legacy handset tests

User de� nable test messages

MO/MT transmission of multipart MMs

Segmentation and reassembly supported

Expandable library of MMS test messages

Logging

Sample KPIs Time of OMA IM Login Request

Session ID given from IM server

Time when a party sends the message

Time of OMA IM Logout Request

Sample Features Registration at the IM server

Successful login

“Get presence”-information of other users and whether two parties can “see” each other

Text message receipt from IM server

Successful logout from the IM server

Multimedia Messaging Service (MMS)When words are not enough!

Mobile IMCan your customers chat via Mobile Instant Messaging?


SMS

MMS

Mobile IM

Test Systems > Applications > Data

DataBoost your trusted data communication!

Handset Agent

Data IP

E-Mail

Web / WAP Browsing

Mobile IP data services o� er subscribers a highly e� ective way to connect to a dynamically rich world � lled with internet based services such as Email, Instant Messaging, websites, VoIP and much more.

GPRS represents the � rst step towards faster access provided via EDGE, UMTS, HSPA+ (HSDPA / HSUPA). To maintain this � exibility in speed, network operators have to deal with the operation and maintenance of multiple technologies. This complexity drives up costs.

To increase revenue and service quality, SITE and GlobalRoamer o� er data tests to access all available technologies via dedicated interfaces to discover service performance and functionality problems.

Sample KPIs PS: GPRS Attach Duration

GPRS access point PDP context activation Duration PDP setup Connect Duration PDP IP UP Duration

CS: CSD Dialin Duration CSD connect assign IP Duration

HTTP Download: Duration Throughput

FTP: Downloading Duration Uploading Duration Mean Download Rate TCP Handshake (Duration)

Sample Features DNS request

Download URL

HTTP browsing

FTP upload / download

Ping a host

TCP/IP command

Transfer rates measuring

Data IPDo you meet your subscribers’ demands with GPRS, EDGE, UMTS and HSPA Data Services?

The SITE mobiQ speed measures the connection speed straightaway from your mobile device, right from where you are.Complementary to Keynote SIGOS QoE solutions, the Handset Agent delivers KPIs measured from any location.

These results are pushed to the SITE system for further analysis and compa-rison to other data collected in SITE. In the SITE GIS, visualization in Google Maps or WMS maps is possible.

Handset Agent (mobiQ speed)The f irst Keynote SIGOS App!

Sample KPIs Data Amount Download

Data Amount Upload

GPS

Mean Download Rate

Mean Upload Rate

Network Type

SIM Network Name

64

Test Systems > Applications > Data

Subscribers not only need voice commu-nication, they also want be in contact with friends and colleagues via mobile E-mail. In order to gain acceptance as a reliable service frequently used by the subscri-bers, network errors must be avoided and uncovered by performing active conti-nuous tests.

The question is, whether mobile E-mails are delivered on time to the receivers’ designated email addresses.

Keynote SIGOS Test Systems provide E-mail testing via multiple interfaces, like GSM Um, GSM Gb, 3G UMTS Uu or Iu PS.

It can be checked whether a mobile E-Mail can be sent and received via a POP3 / IMAP / SMTP server. The mobile E-Mail would be sent via Simple Mail Transfer Protocol (SMTP) to an E-Mail server and fetched via Post O� ce Protocol version 3 (POP3) or Internet Message Access Protocol (IMAP).

WAP / Web BrowsingWhat about mobile Internet browsing?

The combination of high throughput protocols such as WLAN, EDGE and HSPA along with the variety of today’s multi-functional, big screen handsets have greatly enhanced the mobile internet browsing experience. The network operators need to ensure access to the internet directly via HTTP, HTTPS and FTP via a mobile device.

Response, accessibility and data through-put are the major performance indicators for monitoring the quality of service. In addition, Web Browsing tests can access websites, � ll in forms, receive cookies, initiate secure transactions, download contents and much more!

Sample KPIs Mobile E-mail address

Mobile E-mail size

Mobile E-mail fetch duration

Mobile E-mail send duration

Mobile E-Mail End-to-End Transaction Time with Noti� cation

Mobile E-mail success ratio

Sample Features Mobile E-mail upload and download from

an E-mail server

Interfaces: GSM Um, GSM Gb, 3G UMTS Uu or Iu PS

SMTP server

POP3/IMAP server

Sample KPIs HTTP data packet duration

HTTP data size

Web Browsing duration

GPRS access point

PDP context activation duration

PDP setup connect duration

PDP IP UP duration

Sample Features Chains of user interaction on a web

application, e.g. a full ecommerce session

HTTP post/get request methods

HTTPS (SSL) for secure transactions

Cookie handling

Follow links both by name or URL

E-MailModern life is unthinkable without E-Mail!


Data IP

E-Mail

Web / WAP Browsing

Video ServicesProvide your customers more than moving color pixels!

Test Systems > Applications > Video

High quality for Video Telephony using 3G UMTS is an absolute must, without which it is used perhaps once, and then never again by your subscribers!

The premium cost paid for the use of UMTS service will most often increase customer‘s expectations regarding quality of service rendered.

Due to competitive pressure, it is man-datory for wireless service providers to increase their subscribers’ average reve-nue quickly by successfully launching new services such as video telephony.

At the same time, they must maintain the consistent high quality their customers have come to expect.

The implementation of this technology often involves complex interaction bet-ween network nodes supplied by di� e-rent manufacturers and therefore cons-tant automated testing should be applied to check initial con� gurations, and then provide active continuous monitoring of the service.

Sample KPIs Video send duration

Video call duration

Video � le size

Audio send duration

CS Bearer establish duration

Sample Features Real End-to-End (mobile-to-mobile)

Video Telephony

Usage of standard 3G UMTS interfaces – no special hardware required

Usage of standardized or customer speci� c video/audio sequences

Usage of a market leading protocol stack

Video Telephony

Video Quality

Streaming

Video TelephonyDo you provide reliable video telephony in 3G UMTS?


Test Systems > Applications > Video

3G UMTS opened a world of possibilities with multimedia applications. Customized infotainment like streaming video, video messaging, mobile TV and video telepho-ny o� er a unique opportunity to create a market for highly personalized and truly inimitable mobility services. For mobile customers the quality of services is decis-ive for acceptance; especially for motion picture based services, quality is the key factor of success.

Keynote SIGOS Test Systems deliver perceptual quality measurements to reproduce subscribers’ quality impressi-on mapped to the mean opinion score (MOS), similarly to other quality tests.

Be sure that your network’s new multi-media applications are more than just moving color pixels.

StreamingWhat about your Streaming service?

Today, almost every major event, e.g. sport, news or society events can be accessed via real-time multimedia streams on a mobile phone. These multimedia applications become more and more important in the wireless and mobile community.

To make sure that customers can enjoy these exciting premium services, it is most important to guarantee an impeccable streaming service. Using the industry standard protocols RTP and RTSP, the Key-note SIGOS Test Systems are up-to-date with the latest technology. Scheduled and continuous active testing ensure that multimedia streams deliver the desired contents and the required quality even to the largest possible groups.

Sample KPIs MOS value

Delays

Brightness

Contrast

Distortion indicators

Sample Features Real End-to-End Testing of real-time

video services (video telephony, video streaming, video messaging)

Objective MOS Video Quality result values from 1 - 5 (1-bad, 2-poor, 3-fair, 4-good, 5-excellent)

PEVQ analysis is based on human model of visual perception

Sample KPIs RTSP packets loss percent video

RTSP packets loss percent audio

RTSP packets received video

RTSP packets received audio

Sample Features Parallel subsessions per stream,

e.g. video and audio

Send streamed multimedia over IP

TCP or UDP transport protocols

Measurement interval in multiple of 100 milliseconds

Used industry standard RTP/RTSP

Video QualityIs your network Video Quality excellent?


Video Telephony

Video Quality

Streaming

Value Added ServicesToday’s driver of ARPU!

Test Systems > Applications > Value Added Services

Value Added Services (VAS)Is your ARPU driver up and running?

Value Added Services (VAS) are conside-red today’s driver of ARPU. Operators or third-party value-added service providers (VASP), also known as content providers, add value to standard service o� erings, encouraging subscribers to optimise their mobile phone usage. With subscribers spending money on VAS, they naturally expect highest quality.

Therefore, successful new VAS launch is mandatory while maintaining the con-sistently high quality customers have come to expect. The implementation of new VAS often involves complex interac-tion between network elements supplied by di� erent application content provi-ders and, therefore, constant automated testing should be applied to check initial con� gurations, and then provide active continous monitoring of service quality.

VAS Examples and Features Ring tone download by sending

request SMS to external number

Logo download by sending request SMS to external number

Ring back tone, which enables users to select a melody or to record a short greeting that the caller will hear. These activations are done per SMS, per IVR or per Web Browsing

Customized new value added services

Value Added Services

Digital Rights Management


Test Systems > Applications > Value Added Services

Digital Rights Management (DRM) is an important enabler for billing of premium priced content, e.g. ring tones. To cater for fast and � exible service creation the Open Mobile Alliance (OMA) de� ned applicati-on-level protocols and behaviors needed to provide powerful as well as reliable content download functionality.

The scheme is implemented on most multi-media phones and is intended to be used by mobile content providers to control access to their products.

The whole Digital Rights Management process is relatively complex and could introduce multiple risks of malfunction. At the same time, the e� ect of a possible error can be disastrous: unhappy custo-mers if a fault occurs during the download and billing process of the premium priced content.

Sample KPIs Media Download Purchase Time

Download Session Time

Download Media Object Access Time

Sample Features The purpose of DRM is to enable

controlled purchase and usage of digital media objects

The Open Mobile Alliance (OMA) has de� ned Digital Rights Management speci� cations for the mobile world:

Forward Lock (prevents the user from unlawful forwarding of protected content)

Combined Delivery (combined rights object / media object)

Separate Delivery (separated rights object + encrypted media object)

Digital Rights ManagementMake Premium Content download a premium customer experience and test your DRM!


Value Added Services

Digital Rights Management

BlackBerryYour network`s sweetest fruit

BlackBerry is one of today‘s leading wireless connectivity solutions for a large number of mobile business professionals found in enterprise and governmental organizations worldwide.

It allows users to stay connected with secured wireless access to e-mail, cor-porate data, calendar and web, to easily manage all their communication and information from a single BlackBerry device whenever and wherever requi-red. BlackBerry eliminates the hassles of dialup by moving mobile data to a “push” architecture.

Especially for mobile professionals, it is vital that the network operator provides the highest levels of quality and reliability.

iPhoneUp with the hype on iPhone tests

For many users, the iPhone and the 3G iPhone represents a new era of mobile phone interaction and services.

The unique combination of multimedia content, intuitive multi-touch display controls, accelerometer and much more created strong demand for new opera-tor services dedicated only for a unique group of users.

Operators around the world specify this group of iPhone users as high-tech – high potential customers with distinctive tech-nology and quality demands.

Handset oriented testing So many features for each new device!

BlackBerry

iPhone

Handset Simulation

Test Systems > Applications > Handset Oriented Testing

Sample Features

Real End-to-End testing of BlackBerry ‘push’ service

Testing carried out using a commercial BlackBerry device

Check sending and receiving e-mails

Check the BlackBerry device integrated email features

Check BlackBerry Messenger service

Using BlackBerry devices with a java application for re� ector code – for sending emails

Management noti� cation and reporting

Sample KPIs Send time

Receive time

Round trip time

Battery level of the device

Battery temperature of the device


The unique services o� ered for this iPhone customer base like the Visual Voice Mailbox create additional quality process demands at each network operator.

Keynote SIGOS Test Systems o� er dedica-ted iPhone tests to � t simply into all QoS test procedures performed via SITE or GlobalRoamer without any additional ef-fort. At the same time, measurements and KPIs provide clear evidence of the service availability and performance focussed on this group of high-tech – high potential customers.

SITE tests speci� c handset characteristics against network services and device speci� c monitoring of pages with � xed content/ URLs. The following important content questions are validated:

Color Support: Check if device is capable of displaying colored imagesImage Size: Comparison of all downloa-ded images with maximum height and width of the deviceContent Support: Check (based on HTTP/WTP accept header) if device can decode downloaded contentData Format: Check if the downloaded content is valid

Test Systems > Applications > Handset Oriented Testing

Sample KPIs Duration

Failure Rates

Sample Features Intuitive Recording of browsing actions

No drag ‘n’ drop anymore

Support of HTML forms

Easy creation and adaptation of browsing sessions

Received page content at a glance

KPIs for each browsing action

User de� ned measurements / KPIs can be added with ‘Test Case Editor’

Whole session can be ‘Replayed’ during development to evaluate the test case

The opportunity for mobile operators to sell exciting new mobile content and handsets is enormous, but the variety of available services like MMS, Video Streaming and Web Browsing may cause problems when using di� erent handsets.

How can these new devices and services be properly tested in a cost-e� ective way that ultimately leads to increased revenue and customer satisfaction?

We can help you with a powerful tool to test all your services, simulating the large variety of handsets in your network. No labor intensive and high-cost manual testing!

Handset SimulationDo handsets work perfectly in your mobile network?

71

Visual voice

Mailbox

SMS noti�cation: new message

Call the Mailbox

Download message from Mailbox


BlackBerry

iPhone

Handset Simulation

72

Keynote SIGOS provides adaptable and customizable services.

We take the load off your shoulders!

Professional Services Telecommunications

73

Managed Services on GlobalRoamer> Roaming Steering /Anti-Steering Tests

> GRQ Tests

> International Carrier Quality Tests

> SIM Box Detection

> Billing Testing for Roaming

> Testing Campaigns for Special Events

Managed Services on SITE> SITE Administration Services

> SITE Operational Services

> SITE QoS/QoE Master Expert Services

Training> GlobalRoamer User Training

> SITE User Training

Professional Services > Managed Services

74

Managed Services We take the load o� your shoulders!

Managed Services on SITE

Quality Indicators (KQIs). We manage reports for troubleshooting and provide test results in an easy to read format. SITE Tools like Dashboard and Service Alarm Map then provide signi� cant data on the actual network performance and functionality.

SITE QoS/QoE Master Expert Services – Reduce the time back to service and impro-ve the service quality step by step

By booking this elite package, you can fast-track the ‘Time to back Service’! The SITE System is automatically moni-toring all crucial services and is alerting the relevant teams as soon as a service problem occurs. Keynote SIGOS experts will then analyse and � x the problem by using cutting-edge SITE on-board analysis tools.

This package takes the full Quality of Ser-vice perspective in account and typically starts from a 3-month duration period. All tasks can be executed on-site or remote-ly. A dedicated senior consultant will be your single point of contact, managing all related tasks and resources in order to guarantee a smooth process � ow.

Managed Services on SITEIf you are looking for the bene� ts of the most comprehensive active end-to-end test system but don’t want to look after the administration of the infrastructure, let us do the job for you. We o� er various levels of SITE System Hosting, Administra-tion and Maintenance, while you can fully concentrate on your business.

SITE Administration Services– Ensure that the SITE platform is always available for all internal users

With this classic Managed Service Packa-ge, the customer owns a SITE system and all the relevant administrational tasks are carried out by Keynote SIGOS. Typically, a mix of remote and on-site administration support is recommended.

SITE Operational Services– Guarantee continous service monitoring, reporting and alarming

Performance TestsEnsure end-to-end Quality of Servicethrough delivery of Key PerformanceIndicators (KPIs) prepared for you byKeynote SIGOS. By running a large number of tests over a short period of time (a few days or weeks), we provide you with performance reports invaluable for your benchmarking.

QoS MonitoringEnsure long-term monitoring of your Quality of Service! For example, many customers constantly monitor their 50 to 100 most important roaming partners. Keynote SIGOS prepares automated tests and reports on your individual Key

SITE QoS / QoE Master Expert Services

SITE Operational Services

SITE Administration Service

InitialSetup

& Confi g

Task

Com

plexit

y

t

Bene� ts of Managed Services We have the know-how and most experienced engineers in the testing

area to tackle dedicated projects. Low or no resources from customer side required. Our customers can focus their energy on using the results to perform network

troubleshooting and other crucial tasks. Save costs! A Managed Services contract can take upfront CAPEX

out of the budget as well as cut OPEX in the long run.

Professional Services > Managed Services

75


Keynote SIGOS hosts and maintains a variety of GlobalRoamer testing campaigns for several demands.

Roaming Steering / Anti-Steering TestsTest the functionality of steering programs! A number of location update tests in steered countries/networks are perfor-med and examined by Keynote SIGOS experts. From the distribution of tests over di� erent networks it is determined whether the planned steering ratios between di� erent networks are ful� lled.

(page 24)

GRQ TestsBased on general experience of the roa-ming market, 80% of outbound roaming revenue comes from the top 20 roaming partners. For this reason the GSM Asso-ciation recommends close monitoring of service quality during outbound roaming with these top roaming partners. With our worldwide test system you can regularly measure, monitor, report and receive a-larm on all aspects of service quality among your top roaming partner net-works by using the SIM cards of the inte-rested operators throughout our system. Keynote SIGOS supported several operators during the GRQ trial phase and has successfully proven to be fully compliant to the GRQ framework.

(page 22)

International Carrier Quality TestsBy constantly monitoring the transmissi-on quality of all connected carriers, tra� c can be routed intelligently to the best available. Carriers are interested to ma-nage their SLAs with the Operators and to maximise the volume of tra� c coming from each operator. To route tra� c away from any carrier delivering poor quality transmission, work with Keynote SIGOS to understand and monitor the tra� c quality to more than 600 operator networks worldwide!

(page 25)

SIM Box DetectionFraudulent usage of SIM boxes remains a major issue for many network operators. Often, the revenue leakage caused stays unnoticed, with no actions taken. Keynote SIGOS SIM Box Detection solution is the leading tool for VoIP anti-fraud systems or VoIP bypass. Make use of our managed services to detect grey routes and real time alerts of SIMs which are being used in SIM Box equipments to stop your inter-connect revenue losses!

(page 26)

Billing Testing for RoamingOperators need to implement e� ective solution to manage and control revenue assurance for their roaming agreements, including all aspects of accurate billing.SITE o� ers a precise and reliable tool for rating veri� cation and CDR comparison in outbound roaming services. With Keynote SIGOS Managed Services you can ensure correct billing for you and your customers and respond to current and future needs quickly!

(page 28)

Testing Campaigns for Special EventsMega events like Olympics, World Cup, religious gatherings and other, lead to a signi� cant increase of outbound roaming subscribers and pressure on network operators to provide high quality service. We o� er multi-staged testing campaigns to measure and monitor your QoS, adap-ted to your speci� c requirements.

Take advantage of our managed service and optimize your earnings for the full duration of special events!


Professional Services > Training


TrainingOn-site at your locations or at our training center!

Keynote SIGOS o� ers a comprehensive range of training to users of SITE and GlobalRoamer. Training can be scheduled on demand on your own site or at the Keynote SIGOS training center in Nurem-berg, Germany. Keynote SIGOS training is designed for maximum e� ciency. That’s why we limit the seats for each session.

Training Wherever you want, with specially trained experts!

Users Strategic Users Administrator Test Case Developer

Scheduling tests(ad hoc)

Scheduling testsScheduling reportsDefi ning alarms

Administrator ofinfrastructure, access rights management

Developer of testcases

Reporting & Diagnosis - Base

User Training - Base

Reporting &Diagnosis- Advanced

User Training- Advanced

AdministratorTraining

Test Case EditorTraining Training


Som

e of

our

wor

ldw

ide custo

mers

Saudi Telecom Company

Telstra Australia

Group

77


Index

3 G Layer 3 Tracing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53

3SQM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61

Administration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74

Alarming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50

Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55

Benchmarking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19

Billing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28

BlackBerry . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70

Carrier Quality Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25

Carriers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75

CDR Comparison Testing . . . . . . . . . . . . . . . . . . . . . . . . . 29

Central Unit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46

Compact Local Unit (CLU) . . . . . . . . . . . . . . . . . . . . . . . . 46

Content Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

Control Structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52

Core Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

Dashboard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51

Data IP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64

Device Gateway . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47

Diagnosis Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53

Digital Rights Management . . . . . . . . . . . . . . . . . . . . . . 69

Drive Service Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

Early Charging Detection . . . . . . . . . . . . . . . . . . . . . . . . . 27

Echo . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60

Email Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65

Engineering Consulting . . . . . . . . . . . . . . . . . . . . . . . . . . 76

Fixed Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32

Fraud Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26

Gb Local Unit (Gb LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46

GIS (Geographical Information System) . . . . . . . . . . . 51

Global Ressource Pool (GRP) . . . . . . . . . . . . . . . . . . . . . . 45

GlobalRoamer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38

GPRS Attached . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57

GPS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51

GRQ Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

GSMA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

GUI (Graphical User Interface) . . . . . . . . . . . . . . . . . . . . 51

Handset Agent . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . . . . 64

Handset Oriented Testing . . . . . . . . . . . . . . . . . . . . . . . . 70

Handset Simulation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46

Hotline . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76

Inbound Roaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

Indoor Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35

Interactive Voice Response (IVR) . . . . . . . . . . . . . . . . . . 59

Interconnection Carriers . . . . . . . . . . . . . . . . . . . . . . . . . 39

Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42

International Carrier Quality Testing . . . . . . . . . . . . . . 25

International Gateway . . . . . . . . . . . . . . . . . . . . . . . . . . . 25

IP Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33

iPhone . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70

IREG 24, 26, 27, 29, 32, 35, 50, 60 . . . . . . . . . . . . . . . . . . 20

ISDN PRI Local Unit (ISDN PRI LU) . . . . . . . . . . . . . . . . . 46

Local Unit (LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46

Location Update . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57

lu Local Unit (lu LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46

LTE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42

Managed Services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74

Matrix Reporting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51

Messaging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62

MMS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63

Mobile Instant Messaging (Mobile IM) . . . . . . . . . . . . 63

Mobile Local Unit (MLU) . . . . . . . . . . . . . . . . . . . . . . . . . . 46

Mobile Network Operators . . . . . . . . . . . . . . . . . . . . . . . 39

Mobile Virtual Network Operators (MVNO) . . . . . . . . 39

mobiQ speed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64

Network Diagnosis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

Network Registration . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56

Network Structure (of SITE) . . . . . . . . . . . . . . . . . . . . . . . 2

Nomadic Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35

On-Demand Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

Open Connectivity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23

Keyword KeywordPage Page

Index

Index


Outbound Roaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

Performance Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74

Periodic QoS Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

PESQ/POLQA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60

PEVQ . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67

Portfolio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

Prepaid SIM Recharging . . . . . . . . . . . . . . . . . . . . . . . . . . 31

Professional Services Telecommunications . . . . . . . . 72

Push-to-Talk . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58

QoE Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

QoS Monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74

Regression Test . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

Regulators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39

Reporting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50

Revenue Assurance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28

Revenue Leakage & Fraud Detection . . . . . . . . . . . . . 26

Ring back tone . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68

Ring tone download . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68

Roaming Hubbing Testing . . . . . . . . . . . . . . . . . . . . . . . . 23

Roaming Steering Testing . . . . . . . . . . . . . . . . . . . . . . . . 24

Roaming Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

Senior Consulting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76

Service Alarm Map . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53

Service Quality Monitoring . . . . . . . . . . . . . . . . . . . . . . . 14

SIM Box Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26

SIM Multiplexer (Hardware) . . . . . . . . . . . . . . . . . . . . . . 46

SIM Multiplexing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44

SITE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42

SITE Recorder . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52

SLA Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

SMS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62

Speech . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58

SS7 Local Unit (SS7 LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . 46

Strategic Consulting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76

Streaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67

Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59

System Hosting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74

Tari� Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30

Test Call / Event Generation . . . . . . . . . . . . . . . . . . . . . . 28

Test Case Editor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52

Test Creation Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52

Test Infrastucture Management (TIM) . . . . . . . . . . . . . 74

Test Operations Management (TOM). . . . . . . . . . . . . . 74

Test Sequence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52

Test Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49

Training . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78

Value Added Services (VAS) . . . . . . . . . . . . . . . . . . . . . . 68

Video . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66

Video Quality . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67

Video Telephony . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66

Voice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58

Voice over IP Quality Testing . . . . . . . . . . . . . . . . . . . . . . 61

Voice Quality . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60

WAP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65

Warranty. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76

Web Browsing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65

Wireless Local Unit (WLU) . . . . . . . . . . . . . . . . . . . . . . . . 46

Keyword KeywordPage Page

Keynote SIGOS Product Guide

Documents

Transcript of Keynote SIGOS Product Guide