Welcome [tc18.tableau.com]...MATILLION ETL FOR BigQuery Snowflake How to Engage •Visit •Launch...

Post on 30-Mar-2021

3 views 0 download

Transcript of Welcome [tc18.tableau.com]...MATILLION ETL FOR BigQuery Snowflake How to Engage •Visit •Launch...

Welcome

Give Your Data A Workout

Arawan GajajivaSolution Architect

Matillion

# T C 1 8

Want to hit the ground running with advanced data analytics?

No sweat!

ELT to the rescue!

“Wait, did he just say E-L-T?

Doesn’t he mean E-T-L?”

This might be a process you are familiar with... ...prepare to have your mind blown.

First, we connected to Strava APIs.

To fetch all Workout Activities.

In raw JSON format.

[{"resource_state":2,"athlete":{"id":16782953,"resource_state":1},"name":"EveningRun","distance":5261.8,"moving_time":1750,"elapsed_time":1868,"total_elevation_gain":43.8,"type":"Run","workout_type":0,"id":1738996722,"external_id":"1297e650882ee3c8e8329b41926905db","upload_id":1865841116,"start_date":"2018-07-31T00:15:49Z","start_date_local":"2018-07-30T18:15:49Z","timezone":"(GMT-07:00) America/Denver","utc_offset":-21600,"start_latlng":[39.63,-105.33],"end_latlng":[39.63,-105.32],"location_city":null,"location_state":null,"location_country":"","start_latitude":39.63,"start_longitude":-105.33,"achievement_count":0,"kudos_count":1,"comment_count":0,"athlete_count":1,"photo_count":0,"map":{"id":"a1738996722","summary_polyline":"amzpFpszaSoCsCiDt@_DkDmDfFdEfHuEaAy@vByCHgFp\\mEfBP{FmDoOgAoV|HmMb@sDmA}ChLvHaEfQp@nIdBv@iBdScCvH}DjA?gGcDiOMaO}@aBf@eEvHsLu@gG","resource_state":2},"trainer":false,"commute":false,"manual":false,"private":false,"flagged":false,"gear_id":"g3396464","from_accepted_tag":false,"average_speed":3.007,"max_speed":7.8,"has_heartrate":true,"average_heartrate":156.1,"max_heartrate":168,"elev_high":2202.5,"elev_low":2144.5,"pr_count":0,"total_photo_count":0,"has_kudoed":false,"suffer_score":50}]

We then connected to WorldWeatherOnline.com APIs.

To fetch Historical Hourly Weather data.

Also in JSON format.

{"data":{"request":[{"type":"LatLon","query":"Lat 39.63 and Lon -105.33"}],"weather":[{"date":"2018-07-01","astronomy":[{"sunrise":"05:38 AM","sunset":"08:33 PM","moonrise":"11:00 PM","moonset":"08:42 AM","moon_phase":"WaningGibbous","moon_illumination":"83"}],"maxtempC":"27","maxtempF":"81","mintempC":"12","mintempF":"54","totalSnow_cm":"0.0","sunHour":"14.5","uvIndex":"0","hourly":[{"time":"0","tempC":"13","tempF":"56","windspeedMiles":"4","windspeedKmph":"7","winddirDegree":"242","winddir16Point":"WSW","weatherCode":"176","weatherIconUrl":[{"value":"http://cdn.worldweatheronline.net/images/wsymbols01_png_64/wsymbol_0025_light_rain_showers_night.png"}],"weatherDesc":[{"value":"Patchy rain possible"}],"precipMM":"0.2","humidity":"62","visibility":"10","pressure":"1016","cloudcover":"76","HeatIndexC":"14","HeatIndexF":"57","DewPointC":"7","DewPointF":"45","WindChillC":"14","WindChillF":"57","WindGustMiles":"6","WindGustKmph":"9","FeelsLikeC":"14","FeelsLikeF":"57"},{"time":"300","tempC":"12","tempF":"54","windspeedMiles":"3","windspeedKmph":"5","winddirDegree":"285","winddir16Point":"WNW","weatherCode":"116","weatherIconUrl":[{"value":"http://cdn.worldweatheronline.net/images/wsymbols01_png_64/wsymbol_0004_black_low_cloud.png"}],"weatherDesc":[{"value":"Partlycloudy"}],"precipMM":"0.0","humidity":"57","visibility":"10","pressure":"1017","cloudcover":"4","HeatIndexC":"13","HeatIndexF":"55","DewPointC":"5","DewPointF":"41","WindChillC":"13","WindChillF":"55","WindGustMiles":"6","WindGustKmph":"10","FeelsLikeC":"13","FeelsLikeF":"55"}]}]}}

Data preparation was performed on both data sets to allow for them to be joined for deeper analysis.

Matillion and Snowflake made this task simple!

Matillion Demo

We make purpose-built, native solutions that leveragethe intersection of data and cloud computing

MATILLION ETL FOR

Amazon RedshiftMATILLION ETL FOR

BigQueryMATILLION ETL FOR

Snowflake

How to Engage

• Visit www.matillion.com

• Launch on the AWS Marketplace, GCP Marketplace or Azure Marketplace

• Free Trial or Test Drive

• Booth #715 in the Data Village

Please complete the

session survey from the

Session Details screen

in your TC18 app

Thank you!

#TC18

Visit us at Booth #715

Appendix