Using Talend with Couchbase

7
Using Talend with Couchbase Will Gardella, Couchbase Product Management

Transcript of Using Talend with Couchbase

Page 1: Using Talend with Couchbase

Using Talend with Couchbase

Will Gardella,Couchbase Product Management

Page 2: Using Talend with Couchbase

©2015 Couchbase Inc. 2

Use Case: Talend Open Studio for Big Data

Page 3: Using Talend with Couchbase

©2015 Couchbase Inc. 3

Couchbase Talend Connector

The Talend connector for Couchbase is shipped with Talend Open Studio for Big Data.

This enables you to manage and transform your data between Couchbase Server and other data stores in your enterprise.

The connector consists of two components: 1. tCouchbaseInput, the input component, takes

incoming data streams, transforms them into JSON documents, and stores them in Couchbase

2. tCouchbaseOutput, the output component, transforms JSON documents into target data formats and stores in target system

Page 4: Using Talend with Couchbase

©2015 Couchbase Inc. 4

Moving data via ETL

Page 5: Using Talend with Couchbase

©2015 Couchbase Inc. 5

Compatibility Info

Works with at least Couchbase 3.0.3 latest production and Couchbase 4.0 (DP and Beta 1)

Talend Big Data Studio 5.6 Java 1.6 (Talend Requirement)

Page 6: Using Talend with Couchbase

©2015 Couchbase Inc. 6

Step-by-Step Instructions

Tutorial on Overall process http://blog.couchbase.com/mysql-couchbase-using-talend-etl See errata next slide

Couchbase Installation & Setup Note: start the server but don’t configure it or

install sample buckets– http://docs.couchbase.com/4.0/getting-started/installing.html

Install the travel sample as described here – http://docs.couchbase.com/4.0/travel-app/index.html

Before you run your Talend job: Create new bucket named ‘default’

– easiest way: http://localhost:8091/index.html#sec=buckets – if you set up the travel-sample you will have default user:’ Administrator’ /’

password’

Page 7: Using Talend with Couchbase

©2015 Couchbase Inc. 7

Tutorial Errata for Talend 5.6

Couchbase server version 2.0 hard-coded in Talend component panel (it works )

The blog post talks about a modules tab that was used to import external jars. It no longer exists in 5.6

Mapping to Couchbase looks different from the screenshots in the tutorial, but the steps to set it up are the same as described there

http://blog.couchbase.com/mysql-couchbase-using-talend-etl