UNICO SOLUTION INFORMATICA - Snowflake · The Informatica Cloud Snowflake v1 Connector built by...
10
UNICO SOLUTION INFORMATICA
Transcript of UNICO SOLUTION INFORMATICA - Snowflake · The Informatica Cloud Snowflake v1 Connector built by...
UNICO SOLUTIONINFORMATICA
Snowflake City Tour 2017
Thomas Bennett – VP of Architecture
Overviewo Data Management Expertise In:
o Data Warehouse
o Data Integration
o MDM
o Analytics
o Cloud Solutions
o Data Lifecycle
o In partnership with key Data Management solutions companies
o With deep expertise in architecting, planning, and delivering Data Management advisory and implementation services
o With proven experience in building API connectors for Cloud Data Integration
o Have Managed Services experience, including business process solutions and customer on-boarding
Data Management … Simplified.
§ Foundedin2009§ DataManagementFocus§ 50+DataManagementConsultants§ CloudImplementationExperts§ 4NorthAmericaLocations§ 2OffshoreLocationsinIndia§ OffshoredeliverycenterinIndia
1 o Gartner MQ Leader 4th Straight Year o Cloud RDBMS
2 o Universal Connectivity o Elastic (Scalable at Query Level)
3 o 600B Transactions a Month (99.9% uptime)
o Separate Compute from Storage (3x-5x compression)
4 o Semi-Structure / Unstructured Data o Natively Supports Semi-Structured Data
o JSONo AVRO
Snowflake Connector (Informatica):
o Snowflake-JDBC Driver Basedo JDBC SSL Supporto Bulk-Inserto Dynamically Create Targetso Supports Partitioningo Parametrizeo Secure Agent
o Informatica Hostedo On-Premise
Informatica Connector - Architecture
TheInformaticaCloudSnowflakev1ConnectorbuiltbyUnico Solution
o Industry Standardo Difficult to Parseo Complex validation checkso Requires specialized libraries or tools
LoadingSemi-StructuredDataisaStruggle!
o No Fixed Schema (Self Describing)o Format can change Dynamically
o Cannot predict every possible elemento Custom Processing (Libraries)
o Time Consumingo Error Prone
o Industry Standardo Difficult to Parseo Complex validation checkso Requires specialized libraries or tools
Complexities of Semi-Structured Data
Traditional Data Warehouse:
o Fixed Compute Powero Fixed Storageo Limited Infrastructureo Growing Data
o Missed SLAo Demand from various Business Unitso Slow to Scaleo Upgradeso Complex Administration
Problems of Traditional Data Warehouse
LoadingData- ResourceContentionisastruggle!
o Industry Standardo Difficult to Parseo Complex validation checkso Requires specialized libraries or tools
LoadingSemi-StructuredDataisnotaStruggle!
o Informaticao Hierarchy Parser / Builder Transformationso Data Transformation Engine (B2B DT)
o Snowflakeo Variant Data Typeo Creates Schema on Ingestiono Ability to Query JSON
o JSON: {"fname":"John","lname":"Smith","age":22}
o Query: select customer:fname::varchar as fname, customer:lname::varchar as lname, customer:age::int as age from Customers
EDI:o Informatica
o Cloud B2B Gatewayo Data Transformation Engine (B2B
DT)
Solution - Semi-Structured Data Simplified!
o Informatica Cloudo Light Weight Secure Agent
o Deploy o On-Premise o AWS | AZURE | Google
o Clustered Agentso Hosted Agent (No Infrastructure)
Loading Data - Resource Contention Solved!
o Snowflakeo Easy Administrationo Dynamic Scalability
o Granular at Queryo Virtual Warehouse
o Accommodate Business Unito Multi-Clustered Warehouses
o Increase performance in parallelo Unlimited Storageo Unlimited Compute
Q & A
