DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion...
Transcript of DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion...
![Page 1: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/1.jpg)
DATA
CONVERSIONS
The Good, Bad
and UglyCarolyn Yon, PMI-ACP
Richland County Government
![Page 2: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/2.jpg)
DATA
CONVERSIONS
The Good, Bad
and Ugly
![Page 3: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/3.jpg)
Lazlo – Real Genius (1985)
![Page 4: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/4.jpg)
Practices for
Successful Data
Conversions
![Page 5: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/5.jpg)
Complex
and
Difficult
![Page 6: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/6.jpg)
Difficult
to
Estimate • Time
• Budget
![Page 7: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/7.jpg)
Expect
Perfection
90-95%
![Page 8: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/8.jpg)
Other Considerations
• Delivery Methods
• XP, Lean
• Scrumban
• Team Composition
• IT
• Users/Stakeholders
• Issue Tracking
• Information Radiation
![Page 9: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/9.jpg)
Data to Convert
Reference Tables System/Setup/Configuration
Entity / Child Data to LoadNeeds little/no pre-processing before loading
Entity / Child Data to ConvertNeeds re-processing/validation before loading
![Page 10: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/10.jpg)
Data Mapping Workbook
Target Table
Target Field
Source Table
Source Field
Notes, Formulas
![Page 11: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/11.jpg)
Tools for Data Conversion
Reference Tables SQL Server Integration Services (SSIS)
Entity / Child Data to Load SQL Server Integration Services (SSIS)
Entity / Child Data to ConvertMicrosoft Visual Studio .Net
![Page 12: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/12.jpg)
UniSys(Legacy)
Interim SQL Server
Conversion DB
Assess SQL
InterimConversion
SQL
New CAMASQL
Flat Files(Weekly)
SSIS(Weekly)
Stored Procedures
(On Demand)
Internet Apps
Conversion or SSIS
![Page 13: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/13.jpg)
Tools for Issue Tracking
![Page 14: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/14.jpg)
Tools for Issue Tracking
Status
![Page 15: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/15.jpg)
• Central Body of Knowledge• Fast Import wherever possible• Enforced Data Integrity• Increased Application Integrity• Facilitate product growth
Data Documentation & Tools
![Page 16: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/16.jpg)
• Manual documentation• Time to learn, architect SSIS
Data Documentation & Tools
![Page 17: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/17.jpg)
• Time Consuming Administrivia• Manual SSIS Runs
Data Documentation & Tools
![Page 18: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/18.jpg)
![Page 19: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/19.jpg)
SQL Server Agent
SSIS Packages
Entity Pkgs
![Page 20: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/20.jpg)
Parcel DEV Job
![Page 21: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/21.jpg)
SQL Server Agent
Delivery Time
Environment
Scripts
![Page 22: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/22.jpg)
SQL Server Agent
Delivery Time
![Page 23: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/23.jpg)
Delivery Cycles
![Page 24: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/24.jpg)
Delivery Cycles
Conversion
Effort
Demo to
Users
Evaluate
Feedback
Entity & Issue
Analysis
Retro &
Planning
![Page 25: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/25.jpg)
• Involved user’s in selecting data subset;
• Early detection on accuracy of data;
• Early connection with users;
• Early considerations of business process changes;
• Identification of desired future enhancements;
• Early scheduling helped to ensure user’s presence;
• The further along we got, users began to see some of the benefits of the new system.
Delivering
![Page 26: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/26.jpg)
• Inconsistent business process knowledge;
• Progress of user acceptance testing;
• Live legacy system is a moving target;
• User’s lack of understanding of the new system;
• User’s lack of experience with conversions;
• Dependencies among the entities.
Delivering
![Page 27: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/27.jpg)
• Inconsistent data integrity;
• Users reluctant buy-in to new system;
• Users reluctant to consider business process changes;
• Changes in conversion inadvertently broke something else;
• Integration testing laborious;
• Features not present/ not identified back during development.
Delivering
![Page 28: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/28.jpg)
SUMMARY
Data Conversion
is only going to be as easy
as the quality of the data.
![Page 29: DATA CONVERSIONS - SCGMISDATA CONVERSIONS The Good, Bad and Ugly. ... Tools for Data Conversion Reference Tables SQL Server Integration Services (SSIS) Entity / Child Data to Load](https://reader036.fdocuments.us/reader036/viewer/2022063000/5f0fc9377e708231d445dff5/html5/thumbnails/29.jpg)
SUMMARY
People Collaboration
can be just as complex and
difficult.