Surf Proprietary Information 1
Building an IMS MRFP using SurfStreamTM
Framework
Building an IMS MRFP using SurfStreamTM
Framework
www.surf-com.com
Surf Proprietary Information 2
www.surf-com.comPresentation HighlightsPresentation Highlights
Multimedia Resource Function Processor (MRFP) Development Challenges
SurfStream Framework Overview
Building an MRFP using SurfStream Framework
SurfStream Feature Support
SurfStream Hardware Integration
Surf’s Value Propositions
Surf Proprietary Information 3
MRFP Development Challenges
MRFP Development Challenges
Surf Proprietary Information 4
www.surf-com.comIMS Service Provider NeedsIMS Service Provider Needs
Deliver highest quality media processing to support mobile and IP services
Audio/video mail
Video portal
Video conferencing
Multimedia servers
Recording servers
Support multiple formats for multiple devices
Combine traditional TDM-based applications with next-generation IP Audio/Video services
Simple migration path for supporting future formats
Surf Proprietary Information 5
www.surf-com.comIMS Service Provider NeedsIMS Service Provider Needs
A single solution for all media types
Flexible channel media type assignment is required to reach entire audience
Price and ROI
Smooth and flexible migration from ‘audio’ systems to ‘audio and video’ systems
Fast integration into current infrastructure
Surf Proprietary Information 6
www.surf-com.comMRFP Development ChallengesMRFP Development Challenges
Growing number of codecs
Interoperability
Each media type has its own interoperability issues
New media formats are introduced – i.e., iLBC, H.264, WMA9, WMV9
Quality issues due to environmental changes
DSP code optimization
Application type optimization
System bottlenecks
New hardware standards
Surf Proprietary Information 7
www.surf-com.comMRFP Services and ArchitectureMRFP Services and Architecture
Video
Audio
Application Server Layer
Audio codecs &
Transcoding
Tones-Gen/Detect TDM/IP
VAD/CNG/PLC
Play & Record
Fax detect & process
N-Way Conf M- dominant
speaker detect
Video codecs & Transcoding
Frame rate / resolution change
Background / Forground
manipulation
Different format per conf destination
Video mixing/conf
Streaming & recording
Application Server
S-CSCF
MRFC
SIP
SIP
MRFP
Megaco/H.248 or SIP with MSML+MOML / MSCML+NETANN
UDP/RTP
Session Control Layer
Media Processing
Layer
Surf Proprietary Information 8
www.surf-com.comBuying Boards or ChipsBuying Boards or Chips
Why Boards?
Pre-requisite: Standard form factor or
Standard mezzanine-card connector
Lowest risk
Lowest initial investment
Cheapest solution in the long run Negotiation
Change vendor
Easiest migration path to next generation DSPs
Why Chips?
Proprietary form factor
Single-DSP solutions
Very high volumes (10K+)
Prediction:
By 2008 all new Tier-I infrastructure solutions will be based on standard boards and modules that are made by third parties.
Surf Proprietary Information 9
www.surf-com.comNew Hardware StandardsNew Hardware Standards
PTMC AMC
PCI PCI Express
MII GB Ethernet
TDM Rapid I/O
Non hot swap Hot swap
Up to 15 Watt Up to 30 Watt
No defined control mechanism Well defined control mechanism in spec
Megs of traffic
10s of Megs in back plane
Gigs of traffic
10 Gig per AMC in back plane
Not Ready for next generation DSPs
Ready for more powerful DSPs
Surf Proprietary Information 10
www.surf-com.comWhy Put Audio & Video on the Same Chip/Module?Why Put Audio & Video on the Same Chip/Module?
Easy migration path from 0% video / 100% audio to 100% video / 0% audio and anything in-between
Minimal system delay -> higher overall quality No need to separate audio from video and send each to a separate
chip/module
Easier to establish lip-sync between audio and video when packets are lost or delayed
Lower operational expenses Only need to support one chip/board
Lower integration efforts Single API for audio and video
No need for an aggregation device to combine/split audio and video
Surf Proprietary Information 11
www.surf-com.comMRFP Development ChallengesMRFP Development Challenges
A typical MRFP is composed of four components:
1. Media processing DSP code
2. Host-based state machines and APIs
3. Hardware platform
4. MRFP application
Generic
Generic
Generic
All generic components are provided by Surf, allowing our customers to focus their resources on the
application specific part.
All generic components are provided by Surf, allowing our customers to focus their resources on the
application specific part.
Application-Specific
Surf Proprietary Information 12
SurfStream Framework Overview
SurfStream Framework Overview
Surf Proprietary Information 13
www.surf-com.comSurfStream Framework PrinciplesSurfStream Framework Principles
All application development needs in one SW package
Host-based library for DSP control and monitoring
OS-specific drivers for all boards
Windows-based diagnostic tool for easy debugging
Short development cycle
Feature rich for maximal flexibility
User-friendly APIs & sample applications
Comprehensive documentation
Technical support
Surf Proprietary Information 14
www.surf-com.comSurfStream Framework Principles (cont’d)SurfStream Framework Principles (cont’d)
Best of Breed
High capacity
Efficient implementation
Optimized for all type of telecom/IMS media processing needs
Field-proven
Standards compliant
Intensively tested
Flexible
Surf Proprietary Information 16
www.surf-com.com
Legacy Phone
IP
Mobile PSTN
MRFC
MRFP
SIP Phone
Fax
3G-324M Video Phone H.324 Video Phone
SIP Video Phone
Application 1: Audio & Video MailApplication 1: Audio & Video Mail
Video :MPEG4 -> H.263CIF QCIF30FPS -> 10FPSAudio: WB-AMRNB-AMRTransport: H.223
Audio, Video & Control multiplexed in 3G-324M using H.223
Audio/Video message stored as .MP4 file parsed and sent to media board
MGW MGW
Surf Proprietary Information 17
www.surf-com.com
Legacy Phone
IP
Mobile PSTN
MRFC
MRFP
SIP Phone
Fax
3G-324M Video Phone H.324 Video Phone
SIP Video Phone
Application 2: MRFPApplication 2: MRFP
Audio/Video 3G-324M
Audio/Video Over RTP Audio Over RTP
Voice Over PSTN
Audio/VideoOver H.324 (V.34 modem)
Prompt for file transfer
MGWMGW
Surf Proprietary Information 18
Building a Cross-platform MRFP
with the SurfStream Framework
Building a Cross-platform MRFP
with the SurfStream Framework
Surf Proprietary Information 19
www.surf-com.com
Packet-switched Peripherals
Layer IV Switch
Layer II Switch
DSP Elements
DSP
DSP Framework
Channel
SurfUP System ElementsUser Application
SurfStream System Elements
SurfStream Host API
FEP - File End Point
POTS Interfaces
H.100 Matrix
Sample Application
Step 1: Initializing HW DevicesStep 1: Initializing HW Devices
API concept:
Controls = C-callable functions
Monitors = Callback functions
Steps:
Reset DSP
Download DSP software
Activate DSP
Reset layer-2 switch
Set layer-2 switch to default mode
Set DSP and channel callback functions
Establish logical Host-DSP connection
Surf Proprietary Information 20
www.surf-com.comStep 2: Initialize Channels and Routing of Audio and VideoStep 2: Initialize Channels and Routing of Audio and Video
Packet Interface
Layer II switch
FEP
Video channel
•MPEG4->H.263•QCIF->CIF•RTP•JB
Audio channel
•AMR<->G729•RTP•JB
Host APIFile system
SurfStream API
Step 2.1: Create & Configure
Video channel
Audio channel
Audio & video mixing channels
Channels can be located on the same DSP or on separate DSPs
mixing channels
•Audio mixing•Video mixing
SIP Video Phones
Surf Proprietary Information 21
www.surf-com.comStep 2: Initialize Channels and Routing for Media Streaming and ConferencingStep 2: Initialize Channels and Routing for Media Streaming and Conferencing
Packet Interface
Layer II switch
FEP
Video channel
•MPEG4->H.263•QCIF->CIF•RTP•JB
Voice channel
•AMR<->G729•RTP•JB
Host APIFile system
SurfStream API
Step 2.2: Configure packet routing
Video channel
Audio channel
Mixing channel
Routing is identical whether or notchannels are on the same DSP
mixing channels
•Audio mixing•Video mixing
SIP Video Phones
Surf Proprietary Information 22
www.surf-com.comStep 3: Play Video & Audio .3gp or .mp4 Streams in the ConferenceStep 3: Play Video & Audio .3gp or .mp4 Streams in the Conference
Circuit Switch Interface
Packet Interface
Layer II switch
FEP
Video channel
•MPEG4->H.263•QCIF->CIF•RTP•JB
Voice channel
•AMR<->G729•RTP•JB
Host APIFile system
SurfStream API
Associate Video channel with a FEP
Associate Voice channel with a FEP
Associate a file with a FEP
Command for FEP to start streaming
FEP = File End Point
mixing channels
•Audio mixing•Video mixing
SIP Video Phones
Surf Proprietary Information 23
SurfStream Framework Feature Support
SurfStream Framework Feature Support
Surf Proprietary Information 24
www.surf-com.comGeneral FeaturesGeneral Features
Dynamic port assignment for Audio/Video/Fax/Modem
Direct DSPnetwork interface, resulting in lowest possible delay DSPs connected to Ethernet eliminate the need for an
aggregation unit that causes excessive delay
Inter DSP communication for running algorithms across multiple DSPs (i.e. large conference)
Open Framework Vendors can build a user-defined channel to create a
competitive advantage or re-use in-house algorithms
Diagnostics included in release version allow easy bug analysis and resolution
Surf Proprietary Information 25
www.surf-com.comPlay/Record FeaturesPlay/Record Features
Enables playing/recording of audio and video streams from Host file system to IP, TDM, or 3G networks
Supports real-time video streaming of proprietary optimized SRF file format
Standard and proprietary file formats MP4 3GP SRF
Reliable Host-DSP communication over UDP
Supports .WAV audio file format with G.711 A-law/µ-law encoding
Surf Proprietary Information 26
www.surf-com.comAudio FeaturesAudio Features
Audio Codecs
G.711, G.729, G.723.1, G.729AB, GSM FR, GSM EFR, GSM NB-AMR, EVRC
Up to 32 TDM or IP Audio conferencing participants
Block size
5-30ms (5ms resolution)
Echo cancellation
G.168 2002
Echo tail up to 128ms
VAD, CNG, Packet Loss Concealment
RTP/RTCP
RFC 3550, 3551, 3389
Fixed/Adaptive Jitter Buffer
Up to 300 ms
Caller ID Detection & Generation
Tone and Events Monitoring, Relay and Generation
Surf Proprietary Information 27
www.surf-com.comVideo FeaturesVideo Features
Video Codecs
Current: MPEG-4 and H.263
Roadmap: H.264, H.263+, H.263++, H.261
Resolution
CIF
QCIF
Frame Rate
1-30FPS
Video Toolbox (advanced features)
Configurable frame rate
Bit rate change
Any resolution resize
Video codec change Logo insertion
Surf Proprietary Information 28
www.surf-com.comVideo Features (cont’d)Video Features (cont’d)
Bit rate
CBR (Constant Bit Rate): 10–768Kbps
VBR (Variable Bit Rate): Minimum – Maximum Quality (automatic bit rate adjustment)
Configurable deblocking levels
RTP Encapsulation
Multiple destination support
Jitter Buffer - Supporting packet rearranging and packet loss handling
Surf Proprietary Information 29
www.surf-com.comVideo Conferencing FeaturesVideo Conferencing Features
Video conferencing Up to 16 participants on a single DSP Up to 96 participants when using inter DSP communication
Dynamic participants display Addition/removal of participants during video conference User-defined screen layout defining size and location for each
picture component Pre-defined layouts (roadmap feature)
Dynamic configuration of layout Background and foreground setting in run-time Transparency alpha blending per picture (roadmap)
Picture overlap support Raw video interface
YUV format
Surf Proprietary Information 30
SurfStream Framework Hardware Integration
SurfStream Framework Hardware Integration
Surf Proprietary Information 31
www.surf-com.comChip-LevelChip-Level
SurfSTP-10/12/14/15/55 (based on TI C64xx) Supports audio/video/fax/modem
Ideal for various applications: Gateway Conferencing Streaming
Supports simultaneous TDMIP interfaces for VOIP gateway
SurfDetect for real-time streaming diagnostics from DSP
Open Framework for integration of customer technology
Solution is also available on other TI C64x-based DSPs
Chip-Level Solution C64x-based
Surf Proprietary Information 32
www.surf-com.comBoard-Level - PCIBoard-Level - PCI
SurfAce-112 Form Factor: PCI
Number of STP-12 DSPs: 1 on board/2,4 or 8 with daughter card
Interfaces: Ethernet E1/T1 (optional) PCI H.100
Software features: same as SurfSTP-xx
Modes of operation: Control through PCI Stand-alone mode: Control through Ethernet
Board-Level Solutions
PCI, PTMC & AMC
Surf Proprietary Information 33
www.surf-com.comBoard-Level - PTMCBoard-Level - PTMC
SurfRider-812/PTMC Form Factor: PTMC (cPCI mezzanine)
Number of 6412 DSPs: 2,4,or 8
Interfaces: Ethernet PCI H.100
Software features: same as SurfSTP-xx
Modes of operation: Control through PCI, Media through Ethernet Stand-alone mode: Control & Media through Ethernet
Board-Level Solutions
PCI, PTMC & AMC
Surf Proprietary Information 34
www.surf-com.comBoard-Level - AMCBoard-Level - AMC
SurfRider/AMC Fully compliant, half-height, single-size AMC form factor
2,4,6,8 DSPs of C64xx or any other processor/logic type
Supports all next-generation TI DSPs
High capacity of audio/video
Very high throughputs Up to 10Gb between external interface and any DSP, and between
the DSPs
Supports ALL types of external interfaces: GbEthernet, PCI_Express, Advanced switching, Rapid IO, Fiber channel,
Infiniband and others Mounted on ATCA (up to 8 boards) or MicroTCA
Board-Level Solutions
PCI, PTMC & AMC
Surf Proprietary Information 35
www.surf-com.com
SurfRider-812/PTMC Integrated with cPCISurfRider-812/PTMC Integrated with cPCI
Carrier board provided by Surf Partners
Surf Proprietary Information 36
www.surf-com.comSurfRider-812/PTMC Integrated with ATCASurfRider-812/PTMC Integrated with ATCA
Carrier board provided by Surf Partners
Surf Proprietary Information 37
www.surf-com.comRoadmap: Version 4.2Roadmap: Version 4.2
Release date
Q2/06
Contents: TMS320C6455, AMC & Video Enhancements
AMC DSP farm board
TI TMS320C6455TM support
H.264 encoding/decoding/transcoding
Audio/video sync enhancements
More…
Surf Proprietary Information 38
Surf’s Value PropositionsSurf’s Value Propositions
Surf Proprietary Information 39
www.surf-com.comSurf’s Value PropositionsSurf’s Value Propositions
Unique approach: integrated audio/video platform (instead of separate systems)
Next Generation DSPs
Open Framework
Seamless integration of video into audio infrastructures
Easy integration of third-party technology
Optimized architecture and APIs for a wide range of applications
Surf Proprietary Information 40
www.surf-com.comSurf’s Value Propositions, cont’dSurf’s Value Propositions, cont’d
Strategic partnership with TI
Market presence
Established customer base
Field-hardened solutions
Credibility
Market-proven since 1996
Well-known and reputable provider of Universal Port solutions
Field-hardened
Patents
26 pending
4 approved
Top Related