Streak + Google Cloud Platform
-
Upload
bigdatacloud -
Category
Technology
-
view
253 -
download
6
Transcript of Streak + Google Cloud Platform
![Page 2: Streak + Google Cloud Platform](https://reader036.fdocuments.us/reader036/viewer/2022081504/55d4fa3cbb61eb3f428b45c1/html5/thumbnails/2.jpg)
What is Streak?
![Page 3: Streak + Google Cloud Platform](https://reader036.fdocuments.us/reader036/viewer/2022081504/55d4fa3cbb61eb3f428b45c1/html5/thumbnails/3.jpg)
1. Serve our app and run business logic
2. Store and Analyze user data
3. Record and analyze every UI action
4. Record and analyze all server logs
5. Record and analyze all client logs
AppEngine + Prediction API + Search API
AppEngine Datastore + Memcache + Cloud Storage + BigQuery
BigQuery (Streaming + Bigquery Extension)
BigQuery (Streaming + Bigquery Extension)
BigQuery (Streaming + Bigquery Extension)
What do we use Google Cloud Platform for?
![Page 4: Streak + Google Cloud Platform](https://reader036.fdocuments.us/reader036/viewer/2022081504/55d4fa3cbb61eb3f428b45c1/html5/thumbnails/4.jpg)
![Page 5: Streak + Google Cloud Platform](https://reader036.fdocuments.us/reader036/viewer/2022081504/55d4fa3cbb61eb3f428b45c1/html5/thumbnails/5.jpg)
![Page 6: Streak + Google Cloud Platform](https://reader036.fdocuments.us/reader036/viewer/2022081504/55d4fa3cbb61eb3f428b45c1/html5/thumbnails/6.jpg)
Streak on Google Cloud
App Engine. .
.
app data
Datastore + Memcache
![Page 7: Streak + Google Cloud Platform](https://reader036.fdocuments.us/reader036/viewer/2022081504/55d4fa3cbb61eb3f428b45c1/html5/thumbnails/7.jpg)
Streak on Google Cloud
App Engine. .
.
app data
log da
ta
Logstore
Datastore + Memcache
BigQuery
log data
![Page 8: Streak + Google Cloud Platform](https://reader036.fdocuments.us/reader036/viewer/2022081504/55d4fa3cbb61eb3f428b45c1/html5/thumbnails/8.jpg)
Streak on Google Cloud
App Engine. .
.
app data
log da
ta
Logstore
Datastore + Memcache Cloud
Storage
BigQuery
Prediction API
app data
log data
![Page 9: Streak + Google Cloud Platform](https://reader036.fdocuments.us/reader036/viewer/2022081504/55d4fa3cbb61eb3f428b45c1/html5/thumbnails/9.jpg)
Streak on Google Cloud
App Engine. .
.
app data
log da
ta
Logstore
Datastore + Memcache Cloud
Storage
BigQuery
Prediction API
app data
App Engine Search API
app data
log data
![Page 10: Streak + Google Cloud Platform](https://reader036.fdocuments.us/reader036/viewer/2022081504/55d4fa3cbb61eb3f428b45c1/html5/thumbnails/10.jpg)
Streak on Google Cloud
App Engine. .
.
app data
log da
ta
Logstore
Datastore + Memcache Cloud
Storage
BigQuery
Prediction API
app data
App Engine Search API
app data
Translation API & Human Translators
i18n
log data
![Page 11: Streak + Google Cloud Platform](https://reader036.fdocuments.us/reader036/viewer/2022081504/55d4fa3cbb61eb3f428b45c1/html5/thumbnails/11.jpg)
Streak on Google Cloud
App Engine. .
.
app data
log da
ta
Logstore
Datastore + Memcache Cloud
Storage
BigQuery
Prediction API
app data
App Engine Search API
app data
Translation API & Human Translators
i18n
log data
event dataevent data
event data
![Page 12: Streak + Google Cloud Platform](https://reader036.fdocuments.us/reader036/viewer/2022081504/55d4fa3cbb61eb3f428b45c1/html5/thumbnails/12.jpg)
BigQuery Demo
![Page 14: Streak + Google Cloud Platform](https://reader036.fdocuments.us/reader036/viewer/2022081504/55d4fa3cbb61eb3f428b45c1/html5/thumbnails/14.jpg)
Summary
Benefits
● Move fast and build lean!● Google quality infrastructure for everyone● Ask critical business questions
Tradeoffs
● Need to move data incrementally ● Need to make your pipelines fault tolerant at scale
Tips
● Mirror your data in multiple systems, storage is cheap!● Build systems incrementally