Google Cloud NEXT'17 정리

37
YongYoon. SHIN ETR I http://uni2u.tistory.com Google Cloud Next 2017 What’s NEW? What is Google Cloud thinking about?

Transcript of Google Cloud NEXT'17 정리

Page 1: Google Cloud NEXT'17 정리

YongYoon.�SHIN�ETRI�

http://uni2u.tistory.com

Google�Cloud�Next�2017

What’s�NEW?�What�is�Google�Cloud�thinking�about?

Page 2: Google Cloud NEXT'17 정리

Let’s�Together• OverView�

• Google�Cloud�Acquisitions�

• Google�Cloud�Security�

• Google�Cloud�Platform�

• Data�Analytics�

• Database�Services�

• Machine�Learning�Services�

• Pricing�&�Support�

• Developer�Platform�&�Tools�

• Infrastructure

Page 3: Google Cloud NEXT'17 정리

History• Google�Cloud�Next�2017�(2017.03.08.�~�03.10.�San�Francisco)�

• 12,000+�attendees�

• 200+�sessions�

• Google�Cloud�platform�Services�

• GCP,�G�Suite,�Chrome,�Maps�and�Education�

• https://cloudnext.withgoogle.com/�

• https://www.youtube.com/playlist?list=PLIivdWyY5sqI8RuUibiH8sMb1ExIw0lAR

Page 4: Google Cloud NEXT'17 정리

kaggle�AppBridge

Page 5: Google Cloud NEXT'17 정리

AppBridge�인수

• 기업의�Google�Cloud�도입을�위함�

• AppBridge�(https://www.appbridge.io/)�

• Share�point,�Exchange,�On-Premises�등�파일�스토리지에서�G�Suite�및�Google�Drive로�마이그레이션�

• 드롭박스나�MS의�원드라이브�등�기업용�파일�동기화�및�공유�서비스

Page 6: Google Cloud NEXT'17 정리

Identity-Aware�Proxy�(IAP)�Data�Loss�Prevention�(DLP)�

Key�Management�Service�(KMS)�Security�Key�Enforcement�(SKE)�

Google�Vault�Titan

Page 7: Google Cloud NEXT'17 정리

Cloud�Identity-Aware�Proxy• Cloud�IAP�(Cloud�Identity-Aware�Proxy)�

• https://cloud.google.com/iap/�

• Google�Cloud�Paltform�에서�실행되는�클라우드�Application�Access�제어�

• VPN을�사용하지�않고�Application에�접근�

• 어디서나�안전한�Application�Access�

• 사용자,�ID,�Group�별�Access�제한�

• 통합�피싱�방지�보안�키�배포

Page 8: Google Cloud NEXT'17 정리

Data�Loss�Prevention�API

• DLP�API�(Data�Loss�Prevention�API)�

• https://cloud.google.com/dlp/�

• 주요�데이터�관리�

• 패턴,�형식�식별을�위한�API�제공�

• 미리�정의�된�식별자�(40+)를�사용하여�데이터�분류�

• 텍스트�및�이미지�지원

https://cloud.google.com/sensitive-data-classification/demo/#/�https://storage.googleapis.com/gweb-uniblog-publish-prod/original_images/DLP_API_Presentation_2.gif

Page 9: Google Cloud NEXT'17 정리

Cloud�Key�Management�Service

• Cloud�KMS�(Cloud�Key�Management�Service)�

• https://cloud.google.com/kms/�

• 클라우드에서�사용할�암호화�키�생성,�삭제,�관리

Page 10: Google Cloud NEXT'17 정리

Security�Key�Enforcement

• SKE�(Security�Key�Enforcement)�

• https://cloud.google.com/security-key/�

• G�Suite�및�GCP�리소스�접근을�위한�보안키�

• 2단계�인증�

• USB�타입의�키�버튼

Page 11: Google Cloud NEXT'17 정리

Vault�for�Google�Drive

• Vault�(Google�Vault)�

• https://gsuite.google.com/products/vault/�

• G�Suite를�위한�eDiscovery�및�아카이빙�솔루션�

• Vault를�사용하여�G�Suite�라이프�사이클�관리�

• 도메인에서�G�Suite�데이터�검색�

• 이메일�및�채팅�기록�보관

Page 12: Google Cloud NEXT'17 정리

Titan

• 하드웨어�레벨의�인프라�액세스를�위한�인증�칩�

• 특수�목적�칩�

• 데이터�센터의�물리적�보안�

• 클라우드�인프라에�대한�물리�장치간�액세스를�위한�인증�칩

Page 13: Google Cloud NEXT'17 정리

BigQuery�Data�Transfer�Service�Cloud�Dataprep�

New�Commercial�Datasets�Google�Cloud�Dataflow�Google�Cloud�Datalab�Google�Cloud�Dataproc

Page 14: Google Cloud NEXT'17 정리

BigQuery�Data�Transfer�Service

• Fully�managed�data�import�service�for�Google�BigQuery�

• https://cloud.google.com/bigquery/transfer/�

• Google에서�관리하는�모든�광고�데이터�세트�쿼리�

• Google�Adwards,�DoubleClick�Campaign�Manager,�DoubleClick�for�Publishers,�YouTube�콘텐츠�및�채널�보고서에서�데이터�쿼리

Page 15: Google Cloud NEXT'17 정리

Cloud�Dataprep

• Intelligent�Data�Preparation�

• https://cloud.google.com/dataprep/�

• 전용�데이터�엔지니어�리소스�없이�분석을�위한�데이터�시각화

Page 16: Google Cloud NEXT'17 정리

New�Commercial�Datasets

• 상업용�데이터�셋�제공�

• Xignite:�금융�시장�데이터�

• HouseCanary:�주거용�부동산�평가�데이터�

• Remine:�주택�판매�시기�예측�데이터�

• AccuWeather:�과거�기상�데이터�

• Dow�Jones:�뉴스�아카이브

“Google�Cloud�is�making�Dow�Jones’�world-class�content�and�

data�easier�to�access�than�ever�before.�This�will�enable�

analysts�and�developers�to�use�modern�data�analytics�and�

machine-learning�tools�to�integrate�business-critical�

information�into�their�workflows.”�

—�Clancy�Childs,�Chief�Product�&�Technology�Officer,�Dow�

Jones

Page 17: Google Cloud NEXT'17 정리

Python�for�Google�Cloud�Dataflow

• Cloud�Dataflow�

• https://cloud.google.com/dataflow/�

• 파이프�라인�처리를�위한�서비스�

• 일괄�처리�및�스트림�실행�

• Java�환경만�지원하였으나�Python�SDK�추가�지원

Page 18: Google Cloud NEXT'17 정리

Stackdriver�Monitoring�for�Cloud�Dataflow

• Google�Stackdriver�

• https://cloud.google.com/stackdriver/�

• GCP�및�AWS의�Application에�대한�모니터링�및�진단�

• 모니터링�과�Dataflow�통합�

• Cloud�Dataflow�에�접근하여�분석하고�특정�Dataflow�작업�조건에�대한�경고�생성

Page 19: Google Cloud NEXT'17 정리

Google�Cloud�Datalab

• Google�Cloud�Datalab�

• https://cloud.google.com/datalab/�

• 대화형�워크�플로우�

• python�및�SQL�등�사용�

• Jupyter�노트북�기반�환경�

Page 20: Google Cloud NEXT'17 정리

Cloud�Dataproc

• Cloud�Dataproc�

• https://cloud.google.com/dataproc/�

• Spark,�Flink,�Hadoop�파이프�라인�관리�

• 대규모�데이터�세트�처리

Page 21: Google Cloud NEXT'17 정리

Cloud�SQL�for�Postgre�SQL�Microsoft�SQL�Server�Enterprise�

Cloud�SQL�for�MySQL�improvements�Cloud�Spanner�

SSD�persistent-disk�performance�improvements�Federated�query�on�Cloud�Bigtable

Page 22: Google Cloud NEXT'17 정리

Cloud�Spanner

• SQL�DB�서비스�

• 자동화된�수평확장�기능을�제공하는�관계형�DB�

• 내부적인�동작�방식은�보이지�않음�

• 3�노드�형식으로�셋팅하는�경우�읽기�초당�3만�쿼리/쓰기�초당�6천�쿼리�성능�주장

Page 23: Google Cloud NEXT'17 정리

Cloud�Machine�Learning�Engine�Cloud�Video�Intelligence�API�

Cloud�Vision�API�Machine�learning�Advanced�Solution�Lab�

Cloud�Jobs�API�Machine�Learning�Startup�Competition

Page 24: Google Cloud NEXT'17 정리

Cloud�Machine�Learning�Service• Cloud�Machine�Learning�Service�

• https://cloud.google.com/products/machine-learning/�

• https://cloud.google.com/ml-engine/�

• 분산�클라우드�머신�러닝�

• 몇시간�이내로�Terabytes�단위�모델링�

• GCP와�통합되어�TensorFlow,�Google�Dataflow,�BigQuery,�Cloud�Datalab�확장�활용

Page 25: Google Cloud NEXT'17 정리

Cloud�Video�Intelligence�API• Cloud�Video�Intelligence�API�

• https://cloud.google.com/video-intelligence/�

• 동영상을�실시간으로�분석하여�장면전환�시점,�분위기,�출연중인�사물�등을�분석하여�데이터를�제공�

• ML�(Machine�Learning)�API�공개�(Vision�API)�

• 쉽게�사용할�수�있도록�API�가공�

• 퍼포먼스�및�커스텀�선택�가능�

• GPU�장착�Compute�Engine�추가�

• 시간당�0.7$�(상당히�고가)

https://cloud.google.com/video-intelligence/

Page 26: Google Cloud NEXT'17 정리

Cloud�Vision�API

• Cloud�Vision�API�

• https://cloud.google.com/vision/�

• 다양한�이미지�세트�분류�

• Label�detection�

• Explicit�Content�Detection�

• Face/Logo/Landmark�Detection�

• Integrate�REST�API

Page 27: Google Cloud NEXT'17 정리

Machine�Learning�Advanced�Solutions�LAB

• ASL�(Machine�Learning�Advanced�Solutions�LAB)�

• https://cloud.google.com/asl/�

• Google의�ML�전문가와�직접�협력하여�ML�적용

Page 28: Google Cloud NEXT'17 정리

Cloud�Jobs�API

• Cloud�Jobs�API�

• https://cloud.google.com/jobs-api/�

• 구직자가�찾고있는�최적의�일자리�매칭

Page 29: Google Cloud NEXT'17 정리

Google�AppEngine�Flex�Cloud�Functions�

Firebase�integration�with�GCP�Cloud�Container�Builder�

Community�Tutorials

Page 30: Google Cloud NEXT'17 정리

App�Engine�Flexible�Environment• App�Engine�Flexible�

• https://cloud.google.com/appengine/docs/flexible/�

• Runtime�

• Java8/Servlet3.1/Jetty9/Python2.7/Python3.5/Node.js/Ruby/PHP/.NET/GO�지원�

• Infrastructure�Customization�

• Libraries�Customization�

• Performance�

• 응용�프로그램의�각�인스턴으세�필요한�CPU,�메모리�지정

Page 31: Google Cloud NEXT'17 정리

Cloud�Functions• Serverless�Architecture�

• https://cloud.google.com/functions/�

• Cloud�Pub/Sub�&&�Cloud�Functions�(GCF)�

• Cloud�Pub/Sub�

• 이벤트�발신자에서�수신자로�전달하는�역할�

• Cloud�Source�Repo�PUSH�event/Cloud�Logging�event�

• GCF�

• 전달과정에서�실제�동작�수행�

• Node.js�만�지원

Page 32: Google Cloud NEXT'17 정리

Cloud�Container�Builder

• Container�Builder�

• https://cloud.google.com/container-builder/�

• 배포�환경에�관계없이�GCP에�Docker�컨테이너�구축�

• 소프트웨어를�컨테이너에�패키징

Page 33: Google Cloud NEXT'17 정리

Pricing

Page 34: Google Cloud NEXT'17 정리

preemptible�instance• 선점(preemptible)�인스턴스�

• 남는�자원을�임시로�사용하는�요금제�

• 남아있는�구글�클라우드�리소스�일시�사용�

• standard-1�(1vCPU�+�3.75GB)�

• 기본가격:�44.53$�

• 지속사용에�대한�할인�적용:�31.17$�

• 1년�약정:�25.29$�

• 3년�약정:�18.07$�

• 선점�인스턴스:�9.67$�

• 단점�

• 인스턴스�실행시�최대�24시간�사용�(24시간�이전에�서버�종료)�

• 만약에�다른곳에서�더�많은�자원을�요청하면�해당�서비스가�종료

- 선점�인스턴스�사용�예�페르미랩�- 16만개의�vCPU�,�320�TB�RAM�을�사용하는데�시간당�1400$�- 대규모로�선점�인스턴스�사용하여�최대�80%까지�할인

Page 35: Google Cloud NEXT'17 정리

New�Data�Center�Region

Page 36: Google Cloud NEXT'17 정리

New�Region

Page 37: Google Cloud NEXT'17 정리

2017.03.28.�신용윤�올림