FULL MATRIX AUTO TEST

FRAMEWORK FOR

S F W E B R T C M E E T U P, J U N E 1 5 T H , 2 0 1 6K E N S A K U KO M AT S U @ N T T C O M M U N I C AT I O N S

INTRODUCE TO MYSELF• Who am I ?

– Kensaku Komatsu (call me Ken)– Working at NTT Communications in Palo Alto office.

• Position– Technical manager of SkyWay– Web Application Evangelist of NTT communications

• Social– Google Developer Expert (HTML5)– Chairman of WebRTC conference in Japan

ACTIVITIES

https://skyway.io/ https://box.skyway.io/

MAIN IDEA FOR TODAY

Testing!!

GENERIC TESTING FOR WEB APP

Order of N

WEBRTC TESTING …..

WEBRTC TESTING …..

NAT type combinatio

n ? PROXY ?

NW condition?

Devices?

mnhttps://www.flickr.com/photos/58782395@N03/

NeedFramework !!

https://www.flickr.com/photos/jantik/

LAST YEAR: BUILT TESTING ENV.

LAST YEAR: BUILT TESTING ENV.

LAST YEAR : DASH BOARD

http://status.skyway.io/

LAST YEAR : IMPLEMENT EACH NAT FROM SCRATCH

ISSUES

• Specific for our system.– On top of our cloud system : Cloudn– Use our specific servers : SkyWay only

• Every components were deeply bounded together

Make itOpen source !!

AUTO TEST FRAMEWORK

• Framework has 4 phases–Bootstrap–Configure–Orchestrate / server_ctl–Orchestrate / job_ctl

AUTO TEST FRAMEWORK:: BOOTSTRAP

Built VMson top of AWS-VPCvia CloudFormation

AUTO TEST FRAMEWORK:: CONFIGURE

Install each componentsUsing Ansible• Reference signalling srv• Coturn• Sample Web apps• NAT• Chrome & FF• …

AUTO TEST FRAMEWORK:: ORCHESTRATE/SERVER_CTL

Execute server programs.

AUTO TEST FRAMEWORK:: ORCHESTRATE/JOB_CTL

Run Selenium for all patterns.

HOW TO ADOPT TO EACH PROJECT?• Framework has 4 phases

–Bootstrap–Configure–Orchestrate / server_ctl–Orchestrate / job_ctl

Update each script and configuration files.

CURRENT STATUS

http://52.196.173.127/

Caused by ….Web Driver mismatch?Due to resource limitation?(t2.micro)

RELEASE PLANWill be open-sourced in fall or winter.

Now private repo.

THANKS!@komasshu

/kensaku.komatsu/in/kensaku-komatsu-6528333bSlideshare: /KensakuKOMATSU/eastandwest