@Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension...
Transcript of @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension...
![Page 1: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/1.jpg)
![Page 2: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/2.jpg)
![Page 4: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/4.jpg)
Slowly Changing Dimension 101
SSIS Solution for SCD
Inferred Dimension Member 101
SSIS Solution for Inferred Members
Master Data Services; To Keep Single Version of Truth
MDS and SSIS synchronization issue
Architecture for a solution
![Page 5: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/5.jpg)
![Page 6: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/6.jpg)
![Page 7: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/7.jpg)
![Page 8: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/8.jpg)
••
•
•
••
![Page 9: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/9.jpg)
![Page 10: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/10.jpg)
![Page 11: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/11.jpg)
![Page 12: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/12.jpg)
![Page 13: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/13.jpg)
![Page 14: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/14.jpg)
![Page 15: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/15.jpg)
![Page 16: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/16.jpg)
![Page 17: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/17.jpg)
![Page 18: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/18.jpg)
![Page 19: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/19.jpg)
![Page 20: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/20.jpg)
![Page 21: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/21.jpg)
![Page 22: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/22.jpg)
![Page 23: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/23.jpg)
![Page 24: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/24.jpg)
![Page 25: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/25.jpg)
![Page 26: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/26.jpg)
![Page 27: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/27.jpg)
![Page 28: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/28.jpg)
![Page 29: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/29.jpg)
![Page 30: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/30.jpg)
![Page 31: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/31.jpg)
Lookup for
dimension
member
If not exists,
create the
Dimension
Member Record
in Staging table
of MDS (with
IsINF attribute)
Execute MDS
Batch to transfer
data from
staging to MDS
entity.
Transfer MDS
entity records to
the Data
Warehouse
dimension.
Fetch dimension
surrogate key
with a lookup
component.
Load fact record
with the new SK.
![Page 32: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/32.jpg)
Use MDS subscription view as
source.
Check existence of dimension
member with lookup.
DW not exists, MDS non-INF:
regular insert
DW not exists, MDS INF: regular
insert (consider setting the INF
flag)
DW exists non-INF, MDS
changed: Apply SCD
DW exists INF, MDS changed
(non-INF): Update record
(consider removing the INF flag)
![Page 33: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/33.jpg)
![Page 34: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/34.jpg)
![Page 35: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/35.jpg)
http://www.amazon.com/The-Data-Warehouse-Toolkit-Dimensional/dp/0471200247
http://www.radacad.com/CoursePlan.aspx?course=1
http://www.packtpub.com/microsoft-sql-server-2012-
integration-services-expert-cookbook/book
http://technet.microsoft.com/en-
us/sqlserver/jj737651.aspx
http://www.amazon.com/Microsoft-Server-2012-
Master-Services/dp/0071797858
![Page 36: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/36.jpg)
@Rad_Reza
www.rad.pasfu.com
www.linkedin.com/in/rezarad
![Page 37: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/37.jpg)
![Page 38: @Rad Reza a.raad.g@gmail · Slowly Changing Dimension 101 SSIS Solution for SCD Inferred Dimension Member 101 SSIS Solution for Inferred Members Master Data Services; To Keep Single](https://reader033.fdocuments.us/reader033/viewer/2022041715/5e4ae7479a2ad759291d8b96/html5/thumbnails/38.jpg)
ios (version 6 or below):
Please input the below URL:
http://aka.ms/DBI368
Other platform:
QR Code: