Post on 30-Mar-2021
Welcome
Give Your Data A Workout
Arawan GajajivaSolution Architect
Matillion
# T C 1 8
Want to hit the ground running with advanced data analytics?
No sweat!
ELT to the rescue!
“Wait, did he just say E-L-T?
Doesn’t he mean E-T-L?”
This might be a process you are familiar with... ...prepare to have your mind blown.
First, we connected to Strava APIs.
To fetch all Workout Activities.
In raw JSON format.
[{"resource_state":2,"athlete":{"id":16782953,"resource_state":1},"name":"EveningRun","distance":5261.8,"moving_time":1750,"elapsed_time":1868,"total_elevation_gain":43.8,"type":"Run","workout_type":0,"id":1738996722,"external_id":"1297e650882ee3c8e8329b41926905db","upload_id":1865841116,"start_date":"2018-07-31T00:15:49Z","start_date_local":"2018-07-30T18:15:49Z","timezone":"(GMT-07:00) America/Denver","utc_offset":-21600,"start_latlng":[39.63,-105.33],"end_latlng":[39.63,-105.32],"location_city":null,"location_state":null,"location_country":"","start_latitude":39.63,"start_longitude":-105.33,"achievement_count":0,"kudos_count":1,"comment_count":0,"athlete_count":1,"photo_count":0,"map":{"id":"a1738996722","summary_polyline":"amzpFpszaSoCsCiDt@_DkDmDfFdEfHuEaAy@vByCHgFp\\mEfBP{FmDoOgAoV|HmMb@sDmA}ChLvHaEfQp@nIdBv@iBdScCvH}DjA?gGcDiOMaO}@aBf@eEvHsLu@gG","resource_state":2},"trainer":false,"commute":false,"manual":false,"private":false,"flagged":false,"gear_id":"g3396464","from_accepted_tag":false,"average_speed":3.007,"max_speed":7.8,"has_heartrate":true,"average_heartrate":156.1,"max_heartrate":168,"elev_high":2202.5,"elev_low":2144.5,"pr_count":0,"total_photo_count":0,"has_kudoed":false,"suffer_score":50}]
We then connected to WorldWeatherOnline.com APIs.
To fetch Historical Hourly Weather data.
Also in JSON format.
{"data":{"request":[{"type":"LatLon","query":"Lat 39.63 and Lon -105.33"}],"weather":[{"date":"2018-07-01","astronomy":[{"sunrise":"05:38 AM","sunset":"08:33 PM","moonrise":"11:00 PM","moonset":"08:42 AM","moon_phase":"WaningGibbous","moon_illumination":"83"}],"maxtempC":"27","maxtempF":"81","mintempC":"12","mintempF":"54","totalSnow_cm":"0.0","sunHour":"14.5","uvIndex":"0","hourly":[{"time":"0","tempC":"13","tempF":"56","windspeedMiles":"4","windspeedKmph":"7","winddirDegree":"242","winddir16Point":"WSW","weatherCode":"176","weatherIconUrl":[{"value":"http://cdn.worldweatheronline.net/images/wsymbols01_png_64/wsymbol_0025_light_rain_showers_night.png"}],"weatherDesc":[{"value":"Patchy rain possible"}],"precipMM":"0.2","humidity":"62","visibility":"10","pressure":"1016","cloudcover":"76","HeatIndexC":"14","HeatIndexF":"57","DewPointC":"7","DewPointF":"45","WindChillC":"14","WindChillF":"57","WindGustMiles":"6","WindGustKmph":"9","FeelsLikeC":"14","FeelsLikeF":"57"},{"time":"300","tempC":"12","tempF":"54","windspeedMiles":"3","windspeedKmph":"5","winddirDegree":"285","winddir16Point":"WNW","weatherCode":"116","weatherIconUrl":[{"value":"http://cdn.worldweatheronline.net/images/wsymbols01_png_64/wsymbol_0004_black_low_cloud.png"}],"weatherDesc":[{"value":"Partlycloudy"}],"precipMM":"0.0","humidity":"57","visibility":"10","pressure":"1017","cloudcover":"4","HeatIndexC":"13","HeatIndexF":"55","DewPointC":"5","DewPointF":"41","WindChillC":"13","WindChillF":"55","WindGustMiles":"6","WindGustKmph":"10","FeelsLikeC":"13","FeelsLikeF":"55"}]}]}}
Data preparation was performed on both data sets to allow for them to be joined for deeper analysis.
Matillion and Snowflake made this task simple!
Tableau Analysis
Workout Map – Weather
Pace vs Elevation
Workout Weather Diagram
We make purpose-built, native solutions that leveragethe intersection of data and cloud computing
MATILLION ETL FOR
Amazon RedshiftMATILLION ETL FOR
BigQueryMATILLION ETL FOR
Snowflake
How to Engage
• Visit www.matillion.com
• Launch on the AWS Marketplace, GCP Marketplace or Azure Marketplace
• Free Trial or Test Drive
• Booth #715 in the Data Village
Please complete the
session survey from the
Session Details screen
in your TC18 app
Thank you!
#TC18
Visit us at Booth #715
Appendix