Create Aggregates Using Aggregate Persistence Wizard in Oracle BI 11g

10/7/2015
CreateAggregatesUsingAggregatePersistenceWizardinOracleBI11g
Overview
Purpose
ThistutorialshowsyouhowtousetheAggregatePersistenceWizardinOracleBI11g,tocreateandmodelaggregatetablestoincreasequeryperformanceby
precalculatingfrequentlyaccessedmeasureaggregations.
TimetoComplete
Approximately30minutes
Overview
ThistutorialshowsyouhowtocreateandmodelaggregatetablesusingtheAggregatePersistenceWizard.Datawarehouseperformancebottlenecksareoftendue
tomeasureaggregation(forexample,summingordersatdifferentlevelsofadimensionalhierarchy)thatisbeingperformedatruntime.Havingidentifiedcandidate
aggregatetablesforinclusioninyourdatawarehouse,youusetheAggregatePersistenceWizardtocreateandmodelaggregatestorelievethebottleneckand
precalculateandstorethedataforbetterqueryresponse.
WhenyouusetheAggregatePersistenceWizardtocreateaggregates,itisimportantthatyouhaveafullyfunctionalbusinessmodel,withacompletesetof
measures,dimensions,andhierarchies.Beforebuildingtableswiththewizard,youshouldhaveconceptuallydesignedthedesiredsetofaggregatesonpaper.The
conceptualdesignshouldincludethesetofaggregatestarsbyname,thesetoffactsineachstar,andthedimensionalityandgrainofeach.Tohelpyouin
designingaggregates,youcanenableusagetracking.Whenusagetrackingisenabled,theOracleBIServercollectsusagetrackingdataforeachquery,andit
insertsthestatisticsdirectlyintoadatabasetable.Usagetrackingisalsohelpfulindeterminingwhichuserqueriesarecreatingperformancebottlenecks,basedon
queryfrequencyandresponsetime.Tolearnhowtosetupusagetracking,youcangothroughthetutorialonSettingUpUsageTrackinginOracleBI11g.You
shouldalsodeterminethedatabasewheretheaggregatesaretobedeployedin.Thisisusuallytheexistingdatabasethatcontainsthebasetablesthatarebeing
aggregated.However,thetablescanbeplacedinadifferentdatabase.Theseminimumrequirementsforthelogicalandphysicaldesigndetailsaresufficientto
createthetableswiththeAggregatePersistenceWizard.YoucouldusetheModelCheckertoseeifthereareanyerrorsinthemodel.
Prerequisites
Beforestartingthistutorial,youshould:
HaveaccesstoorhaveinstalledOracleDatabase11.2orhigher
HaveaccesstoorhaveinstalledOracleBIEE11.1.1.7OBIEE
DownloadtheSamplerpdfromhere.
HaveSampleAppsrpdrunninginonlinemode.
http://www.oracle.com/webfolder/technetwork/tutorials/obe/fmw/bi/bi11117/agp/agr.html
1/35
10/7/2015
HaveSampleAppsrpdrunninginonlinemode.
SettingUptheDataSchemainOracleDatabase
TocreatetherequiredtablespaceandBISAMLE_EXAuser(replacepathstoappropriatevaluesonyourenvironment)executethefollowingSQLstatements:
1. createtablespaceBISAMPLE_EXAdatafile'\home\oracle\app/oracle\oradata\orcl\bisample_exa.dbf'size10Mautoextendondefaultcompress
createtemporarytablespaceBISAMPLE_EXA_TEMPtempfile'\home\oracle\app\oracle\oradata\orcl\bisample_exa_temp.dbf'size10Mautoextendon
2. createuserBISAMPLE_EXAidentifiedbyBISAMPLE_EXAdefaulttablespaceBISAMPLE_EXAtemporarytablespaceBISAMPLE_EXA_TEMP
grantdbatoBISAMPLE_EXA
3. Copythedumpfilefromhere.Unzipandcopyovertoyourdatabasemachine.
LogintoBISAMPLE_EXAschemaandcreateadirectoryobjecttopointtothedirectorywhereyouvecopiedthisfile.ExecutetheSQLstatement:
Createorreplacedirectorysampleappas'C:\bisample_exa'
4. OpenWindowscommandandnavigatetothedirectorycontainingbisample_exa.dmpfile.Importthedumpusingthefollowingcommand:
impdpBISAMPLE_EXA/BISAMPLE_EXAdirectory=sampleappdumpfile=bisample_exa.dmpschemas=bisample_exa
2/35
10/7/2015
5. Onceimported,logintoBISAMPLE_EXAschemaandverifyalltablesarecreatedandloaded(SAMP_REVENUE_Ftableshouldhave5millionrows)
3/35
10/7/2015
6. DownloadthetutorialSampleApp30212AforAPrpdfromhereandmakeitonline.ThisisaSampleAppsrpdmodifiedforthistutorial.Forthetutorial,B
SampleSalesExasubjectareawillbeused.EnterAdmin123astheRepositorypassword.
4/35
10/7/2015
7. Createaquerywiththefollowing:
Time.T02PerNameMonth
Products.P4Brand
Offices.D4Company
BaseFacts.1Revenue
BaseFacts.2BilledQuantity
BaseFacts.3DiscountAmount
BaseFacts.4PaidAmount
8. ClickResults.
5/35
10/7/2015
9. Notehowlongittakesforthequerytoreturntheresults.
CreatingtheAggregates
Inthistopic,youunderstandtheroleandfunctionoftheAggregatePersistenceWizardincreatingandmodelingaggregatestoresolvequerybottlenecks.
Aggregatetablesstoreprecomputedresults,whicharemeasuresthathavebeenaggregated(typicallysummed)overasetofdimensionalattributes.Using
aggregatetablesisaverypopulartechniqueforspeedingupqueryresponsetimesindecisionsupportsystems.Thiseliminatestheneedforruntimecalculations
anddeliversfasterresultstousers.Thecalculationsaredoneaheadoftimeandtheresultsarestoredintables.Aggregatetablesshouldhavefewerrowsthanthe
nonaggregatetablesand,therefore,processingshouldbequicker.
TheaggregatenavigationcapabilityofOracleBIServerallowsqueriestousetheinformationstoredinaggregatetablesautomatically,withoutqueryauthorsortools
havingtospecifyaggregatetablesinthequeries.OracleBIServerallowsuserstoconcentrateonaskingtherightbusinessquestions,becausetheserverdecides
whichtablesprovidethefastestanswers.ForOracleBIServertohaveenoughinformationtonavigatetoaggregatetables,certainmetadataintherepositorymustbe
correctlyconfigured.
ThetraditionalprocessofcreatingaggregatesforOracleBIServerqueriesismanual.Itcanbetedious,requiringcomplicateddatadefinitionlanguage(DDL)and
datamanipulationlanguage(DML)scriptstobewrittenforcreatingtablesinthedatabasesinvolved.Additionally,theseaggregatedtablesneedtobemappedtothe
repositorymetadatatobeavailableforqueries.Thisisatimeconsumingand,possibly,errorproneprocess.
TheAggregatePersistenceWizardenablesyoutoautomatethecreationofphysicalaggregatetablesandtheircorrespondingobjectsintherepository.The
AggregatePersistenceWizardcreatesanOracleBIEnterpriseEditionSQLscript,whichisexecutedbytheBIServer.Thescriptspecifieseachaggregatetabletobe
created,thefactsfromthebusinessmodelthatshouldbeincludedinit,anditsdimensionsandgrain.WhentheBIServerrunstheaggregatepersistenceSQL
script,itgeneratesDDLtocreatetherequiredtablesinthetargetdatabase,internalinstructionstogeneratethecorrespondingphysicalandaggregatenavigation
metadata,anddatamanipulationlanguage(DML)toaggregateandloaddatafromthebasetablesintotheaggregatetables.Theaggregatepersistencescriptis
6/35
10/7/2015
metadata,anddatamanipulationlanguage(DML)toaggregateandloaddatafromthebasetablesintotheaggregatetables.Theaggregatepersistencescriptis
intendedtoberunaftereachextraction,transformation,andloading(ETL)ofthebasetables,typicallynightly.ThiscanbedonebyanOracleBIEEJobManagerjob,
oritcanberunasa.batoranyotherscriptcalledbyacustomprogram.
ThedefaultprefixSA_isautomaticallyaddedtodimension(level)aggregates.YoucanchangethisdefaultprefixbyupdatingtheAGGREGATE_PREFIXparameterin
theAGGREGATE_PERSISTENCEsectionoftheNQSConfig.INIfile:AGGREGATE_PREFIX="prefix_name"
Inthistopic,youusetheAggregatePersistenceWizardtocreateandmodelaggregatetablestosupportqueryperformance.
Theconceptualdesignofyouraggregatestarincludesthefollowingcharacteristics.
Measures
BaseFacts.1
Revenue",2Billed
Quantity",3Discount
Amount,4Paid
Amount
Dimension/Grain
SourceDatabase
Products/P4Brand
Time/T02PerNameMonth"
BISAMPLE_EXA
Office/"D4Comapny"
DoingaConsistencyCheck
1. OpenSampleApp30212forAP.rpdinonlinemodeinBIAdministrationTool.EnterAdmin123astheRepositorypassword.Entertheuseridand
passwordforyourinstallation.ForthistutorialwewilluseasUserweblogicandPasswordwelcome1.MakeanoteoftheODBCdatasourcename.
Inthisexampleitiscoreapplication_OH1291352497.
7/35
10/7/2015
2. ClickFile>CheckGlobalConsistency.
3. TheConsistencycheckisdone.
8/35
10/7/2015
4. OncetheconsistencycheckiscompleteConsistencyCheckManagerwindowisopened.Makesuretherearenoerrors.CloseConsistencyCheck
Managerandsavetherpd.Ifthereareanyerrors,pleaseremovetheerrors.
RunningtheModelChecker
YoucanuseModelCheckManagertocheckyourrepositorymetadataforissuesthatmightaffectthesuccessoftheaggregatepersistenceengine,suchas
identifyinglevelprimarykeysthatarenotunique.
AlthoughtheuserexperienceofrunningModelCheckManagerisverysimilartorunningtheConsistencyCheckManager,therearethreekeydifferences
9/35
10/7/2015
AlthoughtheuserexperienceofrunningModelCheckManagerisverysimilartorunningtheConsistencyCheckManager,therearethreekeydifferences
betweenthetwotools:
UnliketheConsistencyCheckManager,ModelCheckManagerrequiresaccesstobackenddatasourcesforsomechecks.Becausesomeoftheback
endqueriescanbeexpensive,itisrecommendedtorunModelCheckManagerduringoffpeakperiods.
ModelCheckManagercanonlyberuninonlinemode.
ModelCheckManagerdoesnotmakeanychangestorepositorymetadataitonlyflagspossibleproblems.
SimilartotheConsistencyCheckManager,ModelCheckManagerreturnsbotherrorandwarningmessages.YoumustfixerrorsidentifiedbyModelCheck
Manager,ortheaggregatepersistenceenginemightfailtocreateaggregates.Itisrecommendedthatyoufixwarnings,butnotrequired.
RunModelCheckManagerrightbeforeyouruntheAggregatePersistenceWizard.Alternatively,youcanrunModelCheckManagertoidentifyproblemsfor
selectedobjectsafterinitialaggregatecreationfailure.IfthereareerrorsinModelChecker,makesuretheyarenotrelatedtothedimensionsyouareselectingto
buildtheaggregate.
SincetherpdforthistutorialisamodifiedversionofSampleAppsrpd,runtheModelCheckerforthedimensionsthatwillbeusedforthistutotrial.TorunModel
CheckManagerforthedimensionsperformthefollowingsteps:
1. IntheBusinessModelandMappingLayer,selecttheD0Timedimensionin01SampleAppExabusinessmodel.RightclickandselectCheckModel.
10/35
10/7/2015
2. ModelCheckerhasthefollowingtwooptions:
Complete:ChecksallobjectsintheBusinessModelandMappinglayeroftheOracleBIrepository.
FilteredbyStatistics:ChecksonlyfacttableobjectsandassociateddimensionsintheBusinessModelandMappinglayerthathavebeen
11/35
10/7/2015
FilteredbyStatistics:ChecksonlyfacttableobjectsandassociateddimensionsintheBusinessModelandMappinglayerthathavebeen
activelyqueriedaccordingtothestatisticstable.Selectthisoptiontospeeduptheprocessforlargerepositories.
ThisoptionisonlyavailableontheOracleExalyticsMachine.IfyouattempttofilterbystatisticsonanonExalyticssystem,orifyouattemptto
filterwhenthestatisticstableisnotavailable,awarningappearsexplainingthatModelCheckManagercannotfilterbystatistics.
3. ClickComplete.WhencompleteModelCheckerManagerwindowwillshowalltheerrors,ifany.Makesuretherearenoerrors.CloseModelChecker
Manager.
4. SimilarlyruntheModelCheckerfortheProductandOfficedimensions.Ineachcase,makesuretherearenoerrors.CloseModelCheckerManager.
UsingtheAggregatePersistenceWizard
1. SelectTools>Utilitiesfromthemenubar.
12/35
10/7/2015
2. FromtheUtilitieswindowsselectAggregatePersistenceandclickExecute.TheAggregatePersistencewizardopens.
3. IntheAggregatePersistenceSelectFileLocationwindowenterthenameoftheSQLscriptfileasaggregate.sql.Enterthefolderwherethisfilewill
beplaced.ClickNext.
13/35
10/7/2015
4. IntheAggregatePersistenceSelectBusinessMeasureswindow,selectthesubjectarea01SampleAppExaandfollowingmeasuresfromtheF0
SalesBaseMeasurestable:
1Revenue
2BilledQuantity
3DiscountAmount
4PaidAmount
ClickNext.
14/35
10/7/2015
5. IntheAggregatePersistenceSelectLevelswindow,selectdimensionH0Time.Month,H1Products.ProductBrand,andH3Offices.Company.Click
Next.
15/35
10/7/2015
6. IntheAggregatePersistenceSelectConnectionPoolwindow,selectthedatabaseas02SampleAppExaData(ORCL).Makesureyouselectthe
Oracledatabase(ORCL)andnotEssbase(ESSB).SelectCatalog/Schemaas02SampleAppExaData(ORCL)>BISAMPLE_EXA.Selectthe
ConnectPoolExaSampleConnection.Changethedefaultaggregatetablenametoag_BISAMPLE_EXA.ClickNext.
16/35
10/7/2015
7. IntheAggregatePersistenceFinishwindow,checkthescript.SelectIamdoneandclickNext.
17/35
10/7/2015
8. IntheAggregatePersistenceFinishScriptwindow,checkthatthescriptiscreatedandplacedinthespecifiedfolder.ClickFinish.
18/35
10/7/2015
9. Opentheaggragate.sqlscriptfileineditmode.Checkthescript.
19/35
10/7/2015
RunningnqcmdinCommandLine
1. Openacommandwindow.Changedirectorytoc:\bi\instances\intance1\bifoundation\OracleBIApplication\coreapplications\setup.Yourenvironment
mayhaveadifferentpath.Enterandrunbiinitinthecommandwindow.
2. Asecondwindowopens.Atthepromptinthesecondcommandwindow,enter:
nqcmddcoreapplication_OH1291352497uweblogicsc:\temp\aggregates.sql
dIstheODBCdatasourcenamefortheOracleBIServertowhichyouwanttoconnect.
uUsername
sSQLscriptfileyoucreatedusingtheAggregatePersistencewizard.Forthistutorialitisc:\temp\aggregate.sql
3. Enterwelcome1asthepasswordandpressEnter.
20/35
10/7/2015
4. WaittillyougetStatementexecutesucceededmessage.
YoucompletedrunningthenqcmdcommandforcreatingaggregateswithAggregatePersistenceWizard..
Note:Ifthestatementexecutionfailed,makesureyoudonothaveanysummarytablesinthedatabase,BusinessModellayer,andinthePhysicallayerforthe
dimensionsyouareusing,priortorunningthenqcmdcommand.YoucanusetheDeleteaggregatescommandtodeletethem.
VerifyingthattheAggregatesw ereSuccessfullyCreated
Inthissectionyouwillcheckwhetheralltheaggregatesweresuccessfullycreated.
21/35
10/7/2015
Inthissectionyouwillcheckwhetheralltheaggregatesweresuccessfullycreated.
VerifyingtheAggregatesinPhysicalLayer
1. CloseandopentheBIAdministrationToolinonlinemode.InthePhysicalLayer,ensurethattheaggregateswerecreatedinBISAMPLE_EXAschema.
Thereshouldbeonenewag_BISAMPLE_EXAaggregatetablewiththecolumnsyouselectedforaggregation.
2. ScrolldownthePhysicalLayerandyoushouldhavethreedimensionaggregatestablesbeginningwithSA_.Oneforeachdimensionselected.
22/35
10/7/2015
3. ViewcompanynamesfromOfficesdimensionaggregatetable.Checkoutobjectswhenprompted.
23/35
10/7/2015
4. UpdaterowcounttoseethenumberofrowsforFactaggregate.Thereare648rowsinthetable.Checkoutobjectswhenprompted.
5. Updaterowcountsforallthenewaggregatesandyoushouldseethefollowingrowcount.Checkoutobjectswhenprompted.
ag_BISAMPLE_EXA684rows
SA_Month*79
SA_Product*9
SA_Offices*3
6. Doubleclickag_BISAMPLE_EXAtoopenthephysicaldialogbox,clicktheForeignKeystab.Verifythatthejoinsarecreatedbetween
ag_BISAMPLE_EXAandthethreedimensionaggregates.
7. Doubleclicktheforeignkeyforthemonthdimension,toviewtherelationshipinthePhysicalForeignKeydialogbox.
24/35
10/7/2015
8. Doubleclicktheforeignkeyfortheproductbranddimension,toviewtherelationshipinthePhysicalForeignKeydialogbox.
25/35
10/7/2015
SimilarlyyoucancheckforOfficeCompany.
VerifyingtheAggregatesintheBusinessModelandMappingLayer
1. InBusinessModelandMappingLayer,openSourcesfolderfor01SampleAppExa.F0SalesBaseMeasuresandconfirmthatanewlogicaltable
called02SampleAppExaData(ORCL)_BISAMPLE_Exa_ag_BISAMPLE_EXAiscreated.
26/35
10/7/2015
2. OpenSourcesfolderforD0Timedimensionandconfirmthatanewlogicaltablecalled01SampleApp_ExaData
(ORCL)_BISAMPLE_EXA_SA_Monthxxxxxxxiscreated.
3. OpenSourcesfolderforD1Products(LevelBasedHier)dimensionandconfirmthatanewlogicaltablecalled01SampleAppData
(ORCL)_BISAMPLE_SA_Productxxxxxxxiscreated.
4. OpenSourcesfolderforD3Officesdimensionandconfirmthatanewlogicaltablecalled02SampleAppExaData
(ORCL)_BISAMPLE_Exa_SA_Officesxxxxxxxiscreated.
5. Doubleclickthe01SampleAppData(ORCL)_BISAMPLE_ag_BISAMPLElogicaltablesource.ClickCheckOut.IntheGeneraltabandconfirmthat
27/35
10/7/2015
5. Doubleclickthe01SampleAppData(ORCL)_BISAMPLE_ag_BISAMPLElogicaltablesource.ClickCheckOut.IntheGeneraltabandconfirmthat
the02SampleAppExaData(ORCL)_BISAMPLE_Exa_ag_BISAMPLE_Exalogicaltablesourcemapstothe02SampleAppExaData
(ORCL).._BISAMPLE_Exa.ag_BISAMPLE_Exaphysicaltable.
6. ClicktheColumnMappingtabandconfirmthatthelogicalmeasurecolumnsmaptocorrespondingphysicalcolumnsintheag_BISAMPLE_Exa
physicaltable.
7. ClicktheContenttabandconfirmthatthelogicallevelsaresetcorrectly.
28/35
10/7/2015
8. ClickCanceltoclosetheLogicalTableSourcedialogbox.
RepeatforD0Time,D1Products(LevelBasedHier),andD3Officestoconfirmthatthelogicallevelsaresetcorrectlyforthenewlogicaltable
sourcesgeneratedbytheaggregatepersistencewizard.
29/35
10/7/2015
9. Closealldialogboxes.Note:YoudonothavetodoanythinginthePresentationLayer.
CreatingAnalysistoUsetheAggregates
1. SignintoOracleBIasweblogicwithpasswordwelcome1.ReturntoAnalysesEditorandcreateanewanalysisinBSampleSalesExasubjectarea.
30/35
10/7/2015
2. Reloadservermetadataorifrequiredrestartalltheservices.
3. Createaquerywithallyourselections.Selectthefollowing:
Time.T02PerNameMonth
Products.P4Brand
Offices.D4Company
BaseFacts.1Revenue
BaseFacts.2BilledQuantity
BaseFacts.3DiscountAmount
BaseFacts.4PaidAmount
4. ClickResults.
31/35
10/7/2015
Noticehowfastthequeryreturned.
5. Youcansavethequery.ClicktheAdministrationlinkatthetop.ClickManageSessionfromtheAdministrationtab.
32/35
10/7/2015
6. Inspectthequerystatementandconfirmthatthequeryusedthecolumnsyourequested.
33/35
10/7/2015
7. ClickViewLogintheActioncolumn.
8. Scrolldownandinspectthequerylog.Confirmthatthequeryusedtheag_BISAMPLE_EXAaggregatetableandtherelateddimensionSA_Month,
SA_ProductBrand,andSA_OfficesCompanyaggregates.
34/35
10/7/2015
Summary
Inthistutorial,youhavelearnedhowtocreateandmodelaggregatetablesusingtheAggregatePersistenceWizard.
Resources
LinktoadditionaltutorialsonBusinessIntelligenceonOLL
LinktotheproductpageonOTN
Credits
LeadCurriculumDeveloper:KasturiShekhar
OtherContributors:AlanLee,PravinJanardanam,PhilippeLions,andLalithaVenkataraman
35/35

Create Aggregates Using Aggregate Persistence Wizard in Oracle BI 11g

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Create Aggregates Using Aggregate Persistence Wizard in Oracle BI 11g

Uploaded by

Copyright:

Available Formats

10/7/2015

You might also like