DATA CLEANSING WITH SSIS BRIAN KNIGHT PRAGMATIC WORKS [email protected].
-
Upload
jayce-hicklin -
Category
Documents
-
view
217 -
download
0
Transcript of DATA CLEANSING WITH SSIS BRIAN KNIGHT PRAGMATIC WORKS [email protected].
![Page 2: DATA CLEANSING WITH SSIS BRIAN KNIGHT PRAGMATIC WORKS BKNIGHT@PRAGMATICWORKS.COM.](https://reader035.fdocuments.us/reader035/viewer/2022062511/55163c3b55034694308b64c4/html5/thumbnails/2.jpg)
ABOUT BRIAN
Wasn’t very good with girls
Even Kermit the Frog founded a company
All 13 still awaiting a publisher.
BI Savvy or BI Curious?
• SQL Server MVP
• Founder of Pragmatic Works
• Author of 13 books
• Blogs at BIDN.com
Twitter: @BrianKnight
![Page 3: DATA CLEANSING WITH SSIS BRIAN KNIGHT PRAGMATIC WORKS BKNIGHT@PRAGMATICWORKS.COM.](https://reader035.fdocuments.us/reader035/viewer/2022062511/55163c3b55034694308b64c4/html5/thumbnails/3.jpg)
TAKEAWAYS
Profiling the data
Cleansing and validating with scripts
Fuzzy techniques
![Page 4: DATA CLEANSING WITH SSIS BRIAN KNIGHT PRAGMATIC WORKS BKNIGHT@PRAGMATICWORKS.COM.](https://reader035.fdocuments.us/reader035/viewer/2022062511/55163c3b55034694308b64c4/html5/thumbnails/4.jpg)
DATA PROFILING
Retrieves metadata about your data
Help identify data issues
Uses an SSIS Data Profiling Task
![Page 5: DATA CLEANSING WITH SSIS BRIAN KNIGHT PRAGMATIC WORKS BKNIGHT@PRAGMATICWORKS.COM.](https://reader035.fdocuments.us/reader035/viewer/2022062511/55163c3b55034694308b64c4/html5/thumbnails/5.jpg)
Data Profiling Task
Demo
![Page 6: DATA CLEANSING WITH SSIS BRIAN KNIGHT PRAGMATIC WORKS BKNIGHT@PRAGMATICWORKS.COM.](https://reader035.fdocuments.us/reader035/viewer/2022062511/55163c3b55034694308b64c4/html5/thumbnails/6.jpg)
SCRIPTING IN SSIS
Tasks
Data Flow
• Source• Transform• Destination
![Page 7: DATA CLEANSING WITH SSIS BRIAN KNIGHT PRAGMATIC WORKS BKNIGHT@PRAGMATICWORKS.COM.](https://reader035.fdocuments.us/reader035/viewer/2022062511/55163c3b55034694308b64c4/html5/thumbnails/7.jpg)
CLEANSING USES IN SCRIPTING
Advanced data cleansing
Complex data validation
Unusual data sources
![Page 8: DATA CLEANSING WITH SSIS BRIAN KNIGHT PRAGMATIC WORKS BKNIGHT@PRAGMATICWORKS.COM.](https://reader035.fdocuments.us/reader035/viewer/2022062511/55163c3b55034694308b64c4/html5/thumbnails/8.jpg)
Script Transform Demo
Demo
![Page 9: DATA CLEANSING WITH SSIS BRIAN KNIGHT PRAGMATIC WORKS BKNIGHT@PRAGMATICWORKS.COM.](https://reader035.fdocuments.us/reader035/viewer/2022062511/55163c3b55034694308b64c4/html5/thumbnails/9.jpg)
FUZZY TECHNIQUES
De-duplicating data
Fuzzy catches misspelt words or variants
Fuzzy Grouping and Fuzzy Lookup
![Page 10: DATA CLEANSING WITH SSIS BRIAN KNIGHT PRAGMATIC WORKS BKNIGHT@PRAGMATICWORKS.COM.](https://reader035.fdocuments.us/reader035/viewer/2022062511/55163c3b55034694308b64c4/html5/thumbnails/10.jpg)
FUZZY GROUPING DEMO
![Page 11: DATA CLEANSING WITH SSIS BRIAN KNIGHT PRAGMATIC WORKS BKNIGHT@PRAGMATICWORKS.COM.](https://reader035.fdocuments.us/reader035/viewer/2022062511/55163c3b55034694308b64c4/html5/thumbnails/11.jpg)
THE END ALREADY?Questions
http://www.bidn.com/people/brianknight
@BrianKnight
http://www.youtube.com/pragmaticworks