THE PATH TO SECURE DATA SHARING AND … › wp-content › uploads › 2019 › 09 ›...

Post on 04-Jul-2020

0 views 0 download

Transcript of THE PATH TO SECURE DATA SHARING AND … › wp-content › uploads › 2019 › 09 ›...

© 2019 Snowflake Inc. All Rights Reserved

THE PATH TO SECURE DATA

SHARING AND MONETIZATIONJUSTIN LANGSETH

VP DATA SHARINGSNOWFLAKE

© 2019 Snowflake Inc. All Rights Reserved

AGENDA

2

1. What is Data Sharing and why should you care?

2. How Secure Data Sharing works with Snowflake

3. Data Governance and Security

4. Routes to Data Monetization

5. Coming soon… (sneak preview)

6. Key Takeaways

© 2019 Snowflake Inc. All Rights Reserved

Source: Forrester Research

have launched, or

plan to launch,

initiatives to

improve their

ability to source

external data

76%

currently

commercialize

their data

47%

want to expand

their use of

external data

80%

ACCESS TO DATA IS TOP PRIORITY FOR MOST ORGANIZATIONS

3

© 2019 Snowflake Inc. All Rights Reserved

ACCESS TO DATA UNLOCKS NEW VALUE ACROSS INDUSTRIES

Usage-based Insurance

Hyper Personalization

Location-based Advertising

Risk Management

Value-added Services

4

© 2019 Snowflake Inc. All Rights Reserved

OutdatedUnsecure

DownloadDecryptDecompressDB and schema LoadError check

Hours

Hours

Query & Analytics

Data extractionCompressionEncryptionTransmission

Traditional Data Exchange

Provider

THE PROBLEM: EXCHANGING DATA IS DIFFICULT

Consumer

! 5

© 2019 Snowflake Inc. All Rights Reserved

A BETTER WAY TO SHARE DATA

6

Data Providers Data Consumers

Seamless sharingData stays in owner’s account and

can be shared with unlimited

number of consumers

Global Data Sharing Cross-region, Cross-cloud

Direct Query AccessConsumers can immediately

start querying and join to their

own data

© 2019 Snowflake Inc. All Rights Reserved

DATA STAYS ENCRYPTED, IN THE DATA PROVIDER’S

ACCOUNT

DIFFERENTIATOR #1

© 2019 Snowflake Inc. All Rights Reserved

THE DATA IS LIVE & FRESH FOR NEAR REAL-TIME IMMEDIATE ACCESS

DIFFERENTIATOR #2

© 2019 Snowflake Inc. All Rights Reserved

ACCESS RIGHTS ARE FULLY REVOCABLE, AND FINE-GRAINED.

DIFFERENTIATOR #3

© 2019 Snowflake Inc. All Rights Reserved

DATA SHARING EXAMPLE VIA SQL

10

use role accountadmin;

create share sales_share;

grant usage on database sales_db to share sales_share;

grant usage on schema sales_db to share sales_share;

create secure view merchant_view as select * from sales;

grant select on secure view merchant_view to share sales_share;

alter share sales_share add accounts=xy12345, yz23456;

© 2019 Snowflake Inc. All Rights Reserved

USING THE SNOWFLAKE UI

11

© 2019 Snowflake Inc. All Rights Reserved

DATA SECURITY & GOVERNANCE

Ensure data privacy and restrict access to source data

12

SECURE VIEWSCell-level security in multi-tenant situations

SECURE UDFsPrevent consumers from seeing underlying data

SECURE JOINSSecurely mask data during join operations

SECURE MATERIALIZED VIEWSSecure, precomputed views

© 2019 Snowflake Inc. All Rights Reserved

CREATING A SECURE VIEW FOR ROW LEVEL SECURITY

13

Entitlements Table Sales Fact Table

Customer_Name Customer_Id Snowflake_Account

Coca cola 0001 COCACOLA

Pepsi 0002 PEPSI

Dr Pepper 0003 DRPEPPER

Customer_Id Product Sales

0001 6-pack Coca Cola Bottles $10

0002 18-pack Diet Pepsi Cans $20

0003 2-liter Dr Pepper $5

CREATE THE SECURE VIEW BY JOINING EACH TABLE

ON CUSTOMER ID AND USING THE CURRENT_ACCOUNT()

FUNCTION TO SET DATA SECURITY BY ROWS.

© 2019 Snowflake Inc. All Rights Reserved

SHARE ANALYTICAL FUNCTIONS

14

select 6139 as input_item, ss_item_sk as basket_Item,

count(distinct ss_ticket_number) baskets

from udf_demo.public.sales

where ss_ticket_number in (select ss_ticket_number from

udf_demo.public.sales where ss_item_sk = 6139)

group by ss_item_sk

order by 3 desc, 2;

© 2019 Snowflake Inc. All Rights Reserved

SHARE ANALYTICAL FUNCTIONS

15

INPUT_ITEM BASKET_ITEM BASKETS

6139 6139 1048

6139 7115 405

6139 7114 189

6139 9257 128

6139 9256 102

6139 7116 95

6139 9258 40

6139 23492 37

6139 40008 10

© 2019 Snowflake Inc. All Rights Reserved

SHARE ANALYTICAL FUNCTIONS

16

create or replace secure function

UDF_DEMO.PUBLIC.get_market_basket(input_item_sk

number(38))

returns table (input_item NUMBER(38,0), basket_item_sk

NUMBER(38,0), num_baskets NUMBER(38,0))

as

'select input_item_sk, ss_item_sk basket_Item,

count(distinct ss_ticket_number) baskets

from udf_demo.public.sales

where ss_ticket_number in (select ss_ticket_number from

udf_demo.public.sales where ss_item_sk = input_item_sk)

group by ss_item_sk

order by 3 desc, 2';

© 2019 Snowflake Inc. All Rights Reserved

SHARE ANALYTICAL FUNCTIONS

17

use database UDF_DEMO;

create share if not exists UDF_DEMO_SHARE;

grant usage on database UDF_DEMO to share UDF_DEMO_SHARE;

grant usage on schema UDF_DEMO.PUBLIC to share UDF_DEMO_SHARE;

grant usage on function

UDF_DEMO.PUBLIC.get_market_basket(number) to share

UDF_DEMO_SHARE;

alter share UDF_DEMO_SHARE add accounts=<consumer account id>;

© 2019 Snowflake Inc. All Rights Reserved

SHARE ANALYTICAL FUNCTIONS

18

use role accountadmin;

create database UDF_TEST from share <provider_account>.UDF_DEMO_SHARE;

grant imported privileges on database UDF_TEST to role PUBLIC;

use database UDF_TEST;

select * from table(UDF_TEST.PUBLIC.get_market_basket(6139));

INPUT_ITEM BASKET_ITEM_SK NUM_BASKETS

6139 6139 1048

6139 7115 405

6139 7114 189

6139 9257 128

6139 9256 102

6139 7116 95

6139 9258 40

6139 23492 37

6139 40008 10

© 2019 Snowflake Inc. All Rights Reserved

ROUTES TO DATA MONETIZATION

© 2019 Snowflake Inc. All Rights Reserved

Atheon is a leading grocery Flow-of-Goods tracker for FMCG suppliers - providing visual analytics

for ALL suppliers to UK supermarkets

ATHEON ANALYTICS

CREATING NEW DATA PRODUCTS

20

© 2019 Snowflake Inc. All Rights Reserved21

REDUCING COSTS AND IMPROVING THE

CUSTOMER EXPERIENCE

The Situation Before Snowflake:

5-10 hours of Engineering work per week

• Debugging pipelines

• Cluster maintenance

• Dealing with unique customer set-ups

• Resource contention

5+ hours of Solutions time per week

• Getting proper credentials/access

• Scheduling cluster operations

• Creating, maintaining, and resizing hosted Redshift clusters

Heap is a web analytics tool that allows you to capture and measure every user

action on your website or mobile app including clicks, taps, swipes, page views,

form submissions, and more.

HEAP:

© 2019 Snowflake Inc. All Rights Reserved

HEAP: AFTER SNOWFLAKEImprovement in Customer Experience | Better / More Practical Security | Decreased Support Burden

22

HEAP Connect is a product

built on data sharing

© 2019 Snowflake Inc. All Rights Reserved

SNOWFLAKE DATA EXCHANGE

© 2019 Snowflake Inc. All Rights Reserved

THE SNOWFLAKE DATA EXCHANGE

24

© 2019 Snowflake Inc. All Rights Reserved

WHAT IS THE DATA EXCHANGE?

25

DATA

PROVIDERS

DATA

CONSUMERS

Discover

Access

Generate

Insights

Create

Awareness

Generate New

Revenue

Improve Customer

Experience

DATA EXCHANGE

ALL DATA AND VERTICALS STANDARD AND PERSONALIZED LISTINGS BI-DIRECTIONAL FULLY SECURE

• No need to pay for storage

• No ETL required

• Query data immediately

• No ETL required

• Reduce costs

• Increase awareness and revenues

© 2019 Snowflake Inc. All Rights Reserved

ACCESS STANDARD LISTINGS

26

For Standard listings,

click Get

© 2019 Snowflake Inc. All Rights Reserved

ACCESS PERSONALIZED LISTINGS

27

For Personalized

listings, click Request

Request email sent to

Data Provider

© 2019 Snowflake Inc. All Rights Reserved

DATA MONETIZATION VIA DATA EXCHANGE

28

• Snowflake Data Exchange is opportunity to evolve

their business and gain market share

• Provide freemium data sets on Exchange:

Historical (3 years), Forecast (15 days), Climatology

all US Zip codes

• Immediate Success < 1 month

• New business/logos

• Upsell existing customer

• How they monetize

• Pre-packaged datasets by location or history

• Customized per customer 100+ mil rows 6.2 GBs

© 2019 Snowflake Inc. All Rights Reserved

COMING SOON...

© 2019 Snowflake Inc. All Rights Reserved

THE PRIVATE DATA EXCHANGE

30

Security & Access Controls

© 2019 Snowflake Inc. All Rights Reserved

SHARE

Data Provider

Website Request

Data Consumer

View, Query, Join

BI, ETL, Query Tools

Reader(/Writer)

AccountSimple Web

Report

Cloud Blob Store

S3, Azure, GCP

Any other

system

RECAP: HOW TO SHARE AND MONETIZE DATA

31

© 2019 Snowflake Inc. All Rights Reserved

KEY TAKEAWAYS

32

Data monetization can

follow many routes

• Give customers access to

raw data

• Provide data augmentation

services

• Build insights and analytics

on top of customer data

• Upsell customers services

powered by data sharing

and reader accounts

• Monetize data via the

Snowflake Data Exchange

Traditional data

sharing

methods are

risky, costly,

and don’t

provide a good

experience

Snowflake Secure Data

Sharing removes complexity

• Data stays in data owners

account

• No copying of data into data

consumer’s account

• Data is live, fresh and

available for immediate

access

• Access rights are fully

revocable and fine-grained

High performing

companies are

looking for better

ways to source

external data

© 2019 Snowflake Inc. All Rights Reserved

Thank YouSTOP BY OUR BOOTH FOR A DEMO