Get started with data migration

16

Transcript of Get started with data migration

Page 1: Get started with data migration

DATA MIGRATION

OVERVIEWGET STARTED

WITH DATA

MIGRATION

Page 2: Get started with data migration

TABLE OF CONTENTS

1. Introduction

2. Data Migration- Process Flow

• System Discovery-Source, Target• Field Mappings –Source, Target• Data Extraction• Data Transformation• Staging System• Data Load• Data Verification

3. Data Migration Tools

4. Data Migration Checklist

Page 3: Get started with data migration

What is Data Migration

Typically part of a large program and is often triggered by a merger or Acquisition, a business decision to standardise systems or modernizationof an organisation’s system .

Why it’s required

Data Migration

Data migration is the process of transferring data between storage types, formats, or computer systems.

Introduction

Page 4: Get started with data migration

Process Flow

Source and Target System Discovery

Source and Target Field mapping

Data Transformation

Data Load

Data Extraction

Page 5: Get started with data migration

System

Discovery

(Positive forces for change) (Obstacles to change)

System Discovery

Migration Hardware and softwareenvironment details collected.

Number of Source Systems involved.

Size of the legacy system data.

More critical data elements with respect to target application system.

Whether aim is to convert all thelegacy application data at once or inPhases.

Data Cleansing involvement in the migration of data from legacy system to target system with/without data.

Redundant data during migration.

Level of Data cleansing required to maximize the benefit of conversionand migration.

Page 6: Get started with data migration

Field Mappings- Source, Target

Mapping performed with the information derived from source, target and business rules.

Document maintained containing the following :

• Change Description (Indicated mapping changes)• Key Indicator(Indicates whether the field is primary key or not• Source Field Name• Source Table/File Name• Source Field Data Type• Source Field Length• Source Field Description• Business Rule• Target Table Name• Target Field Name• Target Data Type• Target Field Length• Comments

Page 7: Get started with data migration

Export Features of the source systems used.

Data Extraction

Identified data extracted in System Discovery phase.

Scripts generated to export the data.

• Systems provide the feasibility to export data into CSV formats Salesforce,Siebel CRM, Microsoft Dynamics. Microsoft Access provides .accdb formats. SQL provides the .ldf , .mdf and .bak files.

Page 8: Get started with data migration

Transformations achieved with scripting

Transact -SQL stored procedures,functions,SQL

blocks

Data type conversion

Transaction Rules Implemented

Data Accuracy

Data Validation

Data Transformation

Page 9: Get started with data migration

Data Cleansing

• Detects incomplete parts of data.

• Modifies/Eliminates inaccurate records.

• Detects AnomaliesData Sampling- (*) of the rows for a department column needs to be counted

• Column Property Enforcement Null values in required columns. Numeric values that fall outside of expected high and lows. Columns whose lengths are exceptionally short/long. Business Rule Application.

Data Transformation

Page 10: Get started with data migration

In Staging, data is dumped to a location (Staging Area )1

Minimizes ETL activity on both Source and Target systems

Used by the transformation phase

2

3

4

Staging System

Can be used for next processing phase

Transformation performed on rational database server separate from the source databases and target database.

Page 11: Get started with data migration

• Target system loaded with data.• Cumulative data may overwrite the existing data.

Data Load

Load

Update

Schedule

• The extracted data is updated.• Bulk load facility is available in most DBMS.

• Schedule the load/import process.• The speed of loading can be influenced by many factors such as table size, proportion of updates and inserts.

Page 12: Get started with data migration

Involves testing

for datatype

conversions.

Check the

Table Row

Count.

Monitor Database

Integrity.

Has an impact

on the

operational

performance.Testing of

Translational

rules

implementation. Tester should

fulfil these

tests against

the subset of

data.

Black Box

Testing- Business

Cases,

Data samplings

use cases Use

cases.

Data Verification

Page 13: Get started with data migration

Data Migration Tools

Pentaho Data Integration Dataloader

Jitterbit Dataloader Ab Initio

Cognos Decisionstream Talent Open Studio

SAS Open Studio Microsoft SQL Server Integration Services

Informatica PowerCenter Oracle ETL

Page 14: Get started with data migration

Migration Planning Datamap Document Source System Information Target System Information Efficient Scripting Migration execution Test cases development for Data

Verification

Data Migration Checklist

Page 15: Get started with data migration

Zen4orce Service Offerings

jQuery

SALESFORCE

CUSTOMIZATION

SALESFORCE

AUTOMATION

ADVISORY SERVICES

INTEGRATED

SOLUTIONS

Lightning

Bootstrap

Visualforce

App-

exchangeCommuni

-ties

Service

Cloud

Sales

Cloud

GitHub

Apex

Web

Services

Visit www.zen4orce.com for further details about Zen4orce Services & Offerings.

Skillset