VideoA/B Testing

& how it's different from Web A/Btesting

1. What is A/B Testing?2. Usage of A/B Testing3. Video A/B Testing metrics4. Video A/B Testing ideas

comparing two versions of a web page byshowing the two variants to similarvisitors at the same time. A/B test allowsyou  to see which variant performs better. 

(noun)

A/B Testing

1. WEBSITE 2. E‐COMMERCE

3. E‐MAIL CAMPAIGN 4. VIDEO 

Goal: Increase conversion rateand sign-ups

Goal: Increase productpurchases and improve buyerexperience

Goal: Increase open rates anddesign effective campaigns

Goal: Increase audienceengagement and viewhour

Usage of A/B Testing

We have heard a lot about web,

mobile app A/B testing, but not

much about video A/B testing...

How is Video A/BTesting Different?

VIEWHOURCTR (CLICK THROUGH RATE)

COMPLETION RATE

Video A/B Testing measuresdifferent metrics other than

conversion rates

VIEWER ENGAGEMENT

Video A/B TestingIdeas

Test #1. Video Thumbnails

A video thumbnail is the first thing the user sees when interactingwith a video. It’s a visual call‐to‐action.

The quality of your thumbnails needs to beas sharp as possible.Brightly lit, high-contrast images encourageuser to click the play buttonSelect the most exciting part of the video Test different images for different devicesfor the best visibility. Remember, much ofyour traffic will come from mobile devices!

Tips

According to research done in Netherlands,which examined thumbnails ranging from60px to 110px, the bigger thumbnails

performed slightly better. 

Test #2. Video Metadata

The video contains many typesof metadata, such as the title ofvideo, descriptions, tags.

Changing metadata is thesimplest way to A/B test video.

properly select titles to encourage viewersplay your video

video title 

use language that is frequently searched for

video description

enter in words and phrases that describeyour video and are likely to be searched

tags

Test #3. Video Quality

High Video Quality

Higher Engagement,Better Experience

≠

There's trade‐off between high resolutionand chance of rebuffering during playback,

 which can lead to audience churn. 

Find the optimal resolution thatmaximizes user experience with the

least cost 

It is impossible to maximize the QoE when a video is distributedat a bit rate that is either too high or too low.

As a result, a video must be distributed at a bit rate that matchesnetwork throughput to maximize the QoE.

Testing is a continuous process. Keep testing and measure wisely.

Why Streaming Businesses need Video A/B Testing

Learn more about video A/B testing at our blog:

click!

Streamlyzer provides powerful video analytics to OTT service providers and

media companies to help make data-driven decisions. Our dashboard

delivers deep insights into video performance, audience behavior and

contents consumption patterns all in real-time across different devices.

Start 30 day free-trial