ArchitectingADataWarehouse: ArchitectingADataWarehouse: ACaseStudy ACase Study A CaseStudy

Project:zBis CarlZeissVisionNorthAmerica

MarkGinnebaugh,UserGroupLeader, Mark Ginnebaugh User Group Leader mark@[Link]

TheJourney
DeterminedNeedforEnterpriseDataWarehouse Determined Need for Enterprise Data Warehouse WorkedwithBusinessUserstoUnderstandBusiness

Requirements D DeterminedSoftwareRequirements i dS f R i MSSQLServer2005&2008 MS SSIS (ETL Tool) MSSSIS(ETLTool) MSSSAS(AnalyticCubeTool) MSSSRS&Excel(ReportingTools) SharePointforDeployingReportsoverCompany Intranet DesignedandDevelopedzBis DataWarehouse g p

ZBIS=WhatWeWillDeliver

Thisprojectteamwilldeliverthefollowing:
X ConsolidatedreportingforCarlZeiss Vision

NorthAmerica

X Reportingthatisconsistentandfromone
datawarehouse

XR Reportingthatiseasytouseandeasyto ti th ti t d t
access

X Toolsetwillbeflexibleandabletogrowand
changewithourbusiness

X PhaseIrocksoliddownloadfromERP/Manf
g y Providing abilitytoreviewlabinformation asalabnetwork notindividualsilos with accuratereportingacrossallproductsand services
Wewilldeliverthebestproductpossiblebasedontheinformationwe canplaceinourdatawarehouse!

 Reporting from cubes off source systems only No data warehouse N d t h Disparate data systems with different results from p y each Most systems not balanced to GL Reporting for each business unit only No reporting across all business units

TransactionalCubeofApproach
SalesQueries OtherReports SalesReports

Corporate

Download D l d
DataMart Finance DataMart Inventory DataMart Sales&Marketing

ETLLoads ETLLoad

ODS/Staging g g OperationalDataStore
ETLLoad

ERP

Manufacturing

Other

BI Tools/Analytics
Excel

Active Reports

Static Reports

PerformancePoint Server SharePoint

SQL Analytics Server (SSAS) SQL Reporting Server

Aggregated Data Mart TBD

Finance Data Mart

Inventory Data Mart

Sales Data Mart

ETL Load (SSIS) Data Warehouse

ETL Load (SSIS) ODS/Staging O S/S

Operational Data Store

ETL Load (SSIS)

ERP Manufacturing SW Other Data Sources

IntroductiontoDataWarehousing
WhatisaDataWarehouseSystem [Link] y y [Link]
StarSchemaseaseofsystemintegrating StarSchemasprovidesubstantialperformancegains StarSchemashierarchycapabilitiesorDrillDown

Capabilities Capabilities RalphKimballDevelopedCurrentIndustryStandardsforStar Schema DimensionsandFacts

DataWarehouseProjectLifecycle
Technical Architecture Design Project Planning Business Requirement Definition Dimensional Modeling Product Selection & Installation Physical Design Data Staging Design & Development Report Development Testing ETL & DW/DM Report Testing Deployment Maintenance

Report Specifications

Project Management

4 + 1 Steps 4+1 Steps DimensionalDesignProcess

RalphKimballsProcessforDevelopingStarSchemas 1. DetermineBusinessProcess

ModelbusinessProcesses Model business Processes EachProcesswilldetermine1ormoreFacts DesignDWbyBusinessProcessNotBusinessUnit Whatdoes1rowinFacttablerepresent TransactionalorSummary

2. 2

IdentifytheGrainoftheFact Identify the Grain of the Fact

3. 4.

DesigntheDWDimensions D i h DW Di i DesigntheDWFacts

+1 Determine Hierarchies DetermineHierarchies

[Link]
DesignDW/BISystemviaBusinessProcess DevelopDW/BISystemviaDatafromSourceSystems l / f
ProfileDataasearlyaspossible Understand data and design DW using existing data UnderstanddataanddesignDWusingexistingdata

Design & Develop using both Business Process and available Design&DevelopusingbothBusinessProcessandavailable

Dataifpossible

UnderstandingYourBusiness
IdentifykeybusinesssponsorsforDWproject
UseCorporateOrgChart

Setupinitialinterviewswithkeysponsors DevelopBusinessProcessdiagrams D DevelophighlevelUseCaseDiagrams l hi h l l U C Di DetermineBusinessHierarchies

The Business Executive Interview TheBusinessExecutiveInterview

Whataretheobjectivesofyourorganization? WhatBusinessgoalsdoyouwanttoaccomplishwiththe

developmentofzBis d t d l t f Bi datawarehouseSystem? h S t ?
How do you measure success? How do you know you are doing Howdoyoumeasuresuccess?Howdoyouknowyouaredoing

well?Howoftendoyoumeasureyourcorporateperformance?
Whatareyourkeybusinessissuesthatyouaretryingtosolve

fromthezBis system?Iftheseissuesarenotjustifiedwhatisthe impacttoyourdepartmentandorganization? impact to your department and organization?

The Business Executive Interview TheBusinessExecutiveInterview

Howdoyouidentifyproblemsorknowwhenyoumightbe

headedfortrouble?

Howdoyouspotexceptionsinyourbusiness?What

opportunitiesexisttodramaticallyimpactyourbusinessbased opportunities exist to dramatically impact your business based onimprovedaccesstoinformation?Whatisthefinancial impact

Ifyoucould..,Whatwoulditmeantoyourbusiness? What is your vision to better leverage information within your Whatisyourvisiontobetterleverageinformationwithinyour

organization?

H Howdoyouanticipatethatyourstaffwillinteractdirectlywith d ti i t th t t ff ill i t t di tl ith

thisinformation?

Th B i M I t i TheBusinessManagerInterview
Whataretheobjectivesofyourdepartment? What are the objectives of your department? Whatareyoutryingtoaccomplish?Howwoulddoyougo

aboutachievingyourobjectives? about achieving your objectives?

Whatareyoursuccessmetrics? Howdoyouknowyouaredoingwell? Howoftendoyoumeasureyourdepartment/team? y y p Howdoyouanticipatethatyourstaffwillinteractdirectlywith

thisinformation?

BusinessProcessDiagrams
UnderstandBusinessRequirementsforbuilding

DW/BIsystem. DW/BI system.

Defines the Measures and Dimensions for data DefinestheMeasuresandDimensionsfordata

warehouse

DetermineHierarchies
CustomerHierarchies SalesChannels DistributionChannels BusinessChannels CustomerChannels Product Divisions ProductDivisions SalesOrganizations Sales Office SalesOffice BuyGroups/DirectlyPurchase

DetermineHierarchies
ProductHierarchy
Manufacturer Brand ProductType EachproducttypehadownHierarchy

Lens Service Equipment etc t Design Make/Model /

DetermineHierarchies
GeoHierarchy
SalesDivision SalesRegion SalesTerritory

ConformedDimensions
Standardizeddimensionsacrossdatawarehouse St d di d di i d t h
Dimensionsareassociatedwithmultiplebusiness

processes DeterminebyusingBusMatrix&enforcedinETL C f ConformedDimensionsaresharedandconsistent d Di i h d d it t acrossfacttables

UseDataWarehouseBUSMatrix
UseDataWarehouseBUSMatrixfor
Understanding&mappingofBusinessProcessesand

Dimensions OngoingDW/BIplanningefforts Team & Management Communications Team&ManagementCommunications UnderstandBusinessProcessunionsacrosstheenterprise

DataWarehouseBUSMatrix
Date Company Sales Customer Discounts Product Cost Company Inventory DistCtr Inventory Company Customer Product Geo DistCtr Promo

X X X X X

X X X X X

X X X

X X X X X

X X X X

X X X

De elop Dimensional Schema DevelopDimensionalSchema

Sl Ch i Di i SlowChangingDimensions
Type1 OverwriteexistingDimensionRow Type 1 Overwrite existing Dimension Row
Usewhendontneedtokeephistorydatarow Canbeusedtocorrectbaddata

Type2 CreateanewDimensionRow
Usedateand/oractivenonactivefieldstoidentifycurrent

andinactivedatarows Type3 KeepoldandaddnewattributesinDimensionRow Allow Alternate realities to exist simultaneously in one AllowAlternaterealitiestoexistsimultaneouslyinone DimensionRow SlowChangingDimensionsarehandledintheETL

T f Di i TypeofDimensions
MiniDimension Mini Dimension JunkDimensions Outrigger Dimensions OutriggerDimensions SmallStaticDimensions
Lookup tables Lookuptables

T fF t TypeofFacts
TransactionFactTables SnapshotFactTables AccumulatingSnapshotFactTables ConsolidatedorAggregatedFactTables

B id T bl BridgeTables

B id T bl BridgeTables

R d d R di li RecommendedReadinglist
TheDataWarehouseToolkit:TheCompleteGuidetoDimensional

Modeling(SecondEdition) byRalphKimballandMargy Ross M d li (S d Edi i ) b R l h Ki b ll d M R

TheMicrosoftData WarehouseToolkit:WithSQLServer2005andthe

MicrosoftBusiness IntelligenceToolset byJoyMundy,Warren Thornthwaite,andRalphKimball

Building a Data Warehouse: With Examples in SQL Server (Expert's Voice) BuildingaDataWarehouse:WithExamplesinSQLServer(Expert sVoice)

byVincentRainardi
TheDataWarehouseLifecycleToolkit byRalphKimball,Margy Ross,

WarrenThornthwaite,andJoyMundy
TheDataWarehouseETLToolkit:PracticalTechniquesforExtracting,

Cleanin by Ralph Kimball and Joe Caserta byRalphKimballandJoeCaserta

Tolearnmoreorinquireaboutspeakingopportunities, pleasecontact: MarkGinnebaugh,UserGroupLeader mark@[Link]