Webinar Feb 23, 2016Going Beyond UDP

Acceleration

John Tkaczewski, President of FileCatalystBlog: http://filecatalyst.com/blog/Past Webinars: http://filecatalyst.com/resources/webinars/

© Copyright FileCatalyst, 2015

?• FileCatalyst transfers files at full link speed:

• UDP with proprietary retransmission and congestion control

• Patented algorithm built from the ground up in-house

• Transfer rates up to 10 Gbps (with encryption) using commodity hardware

• Not affected by latency and speed degrades, linearly with packet loss

• Ability to fully leverage multi-core CPU architecture•

Integration with leading Cloud Storage like Amazon S3

© Copyright FileCatalyst, 2015

Issues with TCP• Flow control limits transmission window, causes dead air with high latency

• Very aggressive in response to network congestion, cannot tune in application layer

• Result is less than ideal performance on wireless, satellite, or long haul links

• Can be tuned but still not ideal for many-one, one-many

TCP is a very serial process. Each packet of data must be received before a new packet is sent = Decreased transfer speed

Source File Destination File

Acknowledgments

Data Packet

© Copyright FileCatalyst, 2015

Why Faster?

• Ideal for bulk file transfer• Predictable - Can send at a perfect rate• Not affected by latency or packet loss• Congestion Control implemented in application layer• Tunable congestion control aggression• Instantly detect link capacity

Source File Destination File

Acknowledgments

FileCatalyst completely saturates the pipe by sending multiple blocks of data = Increased transfer speed

© Copyright FileCatalyst, 2015

Demo

Method TimeFTP-Filezilla (no checksum) ~ 6 minutesPlain UDP (with checksum) ~ 24 sec

Single File: compressed video - 600 MBSample Link speed: 400Mbps, 160ms delay

Method TimeZIP, IZArc 4.1.6 ~ 45 secRAR, WinRar 4.01 64 bit ~ 25 sec

Dealing with multiple files.

Benchmark Compression Speed: 137MB, 71 files in 10 folders

Compression requires disk space and takes time.

Method TimeFTP-Filezilla (no checksum) ~ 2min 10 secPlain UDP (no checksum) ~ 1min 20 secPlain UDP (with checksum) ~ 1min 40 secMulti-Client (with checksum) ~42 secSingle Archive (with checksum, ) ~18 sec.Multi-Client (with checksum and zip compression)

~ 18 sec.

Sample Data set: 47 files, 261 MB, file sizes 1MB-50MB (compressed)Sample Link speed: 400Mbps, 160ms delay

Features Unique to FileCatalyst.No additional disk space required

Other Options:

• Transferring File Deltas (rsync) Moving only changes detected in the file• Save bandwidth (Savings for cloud and Satellite links)• Increased Processing time

• Directory Streaming (transferring n-files)

• File System Events, no need to scan complex folders

Questions?