Oracle BI Applications and OBIEE New Developments

Shyam Nath, IBM / BIWA SIG Robert Davis, Oracle May 2011

Agenda
Reporting and Analytics Overview Operational to Analytical OBIEE (10g, 11g, 11.1.1.5) Oracle Business Intelligence Applications Value proposition of Packaged BI Applications Sneak peak to BI Apps 7.9.6.3 Migration considerations to 7.9.6.3

About Shyam
OBIEE Architect with IBM GBS (Oracle Practice) OCP since 1998 on 4 different DB versions President/Founder of BIWA SIG an IOUG SIG for BI, DW and Advanced Analytics professionals Regular speaker at Oracle OpenWorld (since 03), Collaborate (since 05), ODTUG-KScope (since 08), BIWA Summit and RUGs (NY/RM/SF/NO etc.) Bachelors from IIT-India, MBA and MS from Florida Atlantic University, Boca Raton, FL

About Robert
Oracle, Director - BI Applications with a focus on Partnerships & Alliances First exposure to BI was with Teradata in the early 90s Supporting the BI Applications for over 8 years at Siebel and now Oracle

OBIA OTN Forum

Regular Contributor to OTN BI Apps Forum
http://forums.oracle.com/

OBI 11.1.1.5 / 7.9.6.3 Released!

OBIA 7.9.6.2 OBIA 7.9.6.3 OBIEE 10g OBIEE 11.1.1.5

OBIEE 10g

OBIEE 11.1.1.3

Supported!

Certified!

How I felt about it!

BI Application New Looks and Feel with 11.1.1.5!

Chart zooming

Oracle BI 11.1.1.5 Released OBIEE 11g Changes and New Features

Focuses on OBIEE 11.1.1.5.0 BI Platform Presented May 25, 2011, noon ET (next Wed) Major topics:
First patch release for OBIEE 11g Support for Oracle BI Applications release 7.9.6.3 Full support for the Apple iPad Full support for OLAP sources including Essbase and Oracle OLAP New support for Oracle TimesTen, MS SQL Server Analytic Services, and SAP BW Reduced memory requirements for Weblogic and streamlined install 64-bit BI Admin Tool New visualizations in the BI Admin tool New BI Metadata Web Service

Includes live demo of many new features Presented by Dan Vlamis, Vlamis Software Solutions Oracle PMs will be available for questions

Operational v/s Analytical System

Traditional Circular Join

OBIEE Star (Logical/Physical)

BI Apps Other Extreme

Why Star Schemas?

ComputerWorld on Business Intelligence

BI Analysts salary range $82$116K Data Modelers $81 $111K, ComputerWorld Mar 2011

OBIEE v/s Packaged BI Application

Sales Service and Contact Center Marketing

Procurement and Spend

Supply Chain and Order Management

Financials

CRM ANALYTICS
Price

ERP ANALYTICS
Projects

Loyalty

Human Resources

ORACLE BI ENTERPRISE EDITION (OBIEE)

AND OTHER OPERATIONAL AND ANALYTIC SOURCES

Case Studies - I
Family owned, 50 yrs old, $1b+ manufacturing company in Atlanta, GA Several manufacturing plants using systems like JD Edwards, Demantra, EPM/Planning and Legacy/Main frame systems ODS/Crystal Reports footprint First formal DW initiative OBIEE, ODI and BIP as tech stack Need for Manufacturing, Plant Shop floor analytics, job profitability and Sales Analytics in first go EPM-Workspace Integration Highly formatted and complex BI Publisher reports Better insights to profitability and cost to service a customer Energy Services Company publicly traded, ~$2b in Houston, TX New EBS R12 implementation in 4 divisions, HFM, Planning, one div replacing SAP First formal DW initiative OBIEE and BI Applications purchased Need for HR, SCM/Procurement, Finance Analytics Go-live in Phases such as HR, Fin and SCM Other Energy industry specific applications in use Some SQL Server/Crystal Reports Better view of business across the enterprise

Why OBIEE v/s BI Apps?

OBIEE Need to integrate JD Edwards data with legacy mainframe data as manufacturing plants are in transition In 2009 time frame BI apps for JDE Edwards have no coverage for manufacturing, shop floor production data and job profitability Cost allocation engine needed for job costing and profitability OBIEE, ODI and BIP as tech stack, shop trying to stay as Oracle tech/apps shop Security with EPM-Workspace needed as Essbase/Planning in use since V7 Resulted in 4 subject areas BI Apps New ERP implementation provides opportunities packaged analytics for rapid deployment as the starter DW One manufacturing division replacing SAP, so challenges in replacing existing SAP - Easy Access functionality EBS Versions sliding from R12.1.1 to R12.1.3 No coverage for Oracle Process Manufacturing, HR Advanced Benefits etc in BI Apps today HFM being used for consolidation and Eliminations Resulted in HR, SCM/PS and Fin analytics as starters

JD Edwards Tables
The JD Edwards table names are quite cryptic This shows that that for building custom OBIEE solutions, deep ERP knowledge is required Need for data modeler, ETL/OBIEE architect and developers

Oracle EBS Object Names

Object Name _ALL _B _TL Function of the object Underlying table with all the values Base of underlying table, same as _ALL Language translation table with translation of descriptive fields in different languages View based on translation table View on top of the Basic table Descriptive Flex Field related view, it will have the defined values as Column names instead of generic attribute 1, ..2 Key Flex Field views contain the concatenated fields as it would be displayed to the user. For e.g. A field may consist of Division, Department and Account fields and the KFV will have the concatenated values. OKE_K_Deliverables_VL E.g. PO_DISTRIBUTIONS_ALL RA_TERMS_B

_VL _BASIC_V _DFV

_KFV

EBS Naming Conventions

All objects accessed by EBS application have synonym in APPS schema, e.g.OKE.OKE_K_LINES has synonym APPS.OKE_K_LINES EBS Forms fetch data from a user friendly view with name ending is _V or _VL (e.g. OKE_K_Deliverables_VL). Views have descriptive value as opposed to the numeric ids fields stored in the base table making it human-readable for reports. Views also implement security and restrictions to the data in various forms such as restrict values by language, org_id etc These variables are set by EBS (session context) when the user accesses data via the EBS application.

Some EBS Schema Names

AP - Oracle Payables AR - Oracle Receivables GL - Oracle General Ledger INV - Oracle Inventory MRP - Oracle Master Scheduling/MRP PA - Oracle Projects PAY - Oracle Payroll PER - Oracle Human Resources PJM - Oracle Project Manufacturing WIP - Oracle Work in Process WMS - Oracle Warehouse Management System WSH - Oracle Shipping WSM - Shop Floor Management

Install Process BI Apps Route

End user machines requires no software, browser based assess Windows boxes required for client software and for transferring some server software (A and B) Co-location of Informatica PowerCenter Services and DAC Server C Clients can be installed on multiple Windows boxes

High Level Data Flow

Source eBS (Raw Data) ETL Extraction Transform and Load (Informatica PowerCenter or ODI) OBAW - Business Analytics Warehouse OBIEE Metadata OBIEE Content Reports and Dashboards

OBIEE From Surface to Plumbing

Supporting Infrastructure Informatica and DAC

Case Studies - II
Offshore Petroleum Services Company
PeopleSoft and BI Apps

Financial Services Company for Retirement Planning

PeopleSoft, BI Apps and Financial Services Vertical App (OFSAA)

2011 Q1 go-live with 7.9.6.2 and OBIEE 11.1.1.3, Platform update Challenges resolved manually For BI Apps 7.9.6.3 intake OBIEE needs to be upgraded too Users are able to utilize enhanced visualization features of OBIEE 11g

HR Analytics is live Fin Analytics to go-live on 7.9.6.2 Fin Srvc vertical BI apps uses OBIEE 10g and Essbase Complex hierarchies DRM/Essbase First step towards unified end user experience using OBIEE 10g

OBIEE 10g vs. OBIEE 11g architecture

OBIEE 11g uses Fusion Middleware (FMW) components extensively, including the WebLogic Server (WLS) and Oracle Process Management Network (OPMN) WLS improves scalability and provides unified security framework Enterprise Manager provides a single platform to manage all applications from a single place. Only WLS supported so far (no support for WebSphere etc)
10g architecture 11g architecture

24

Installing BI Apps Change from 7.9.6.2 to 7.9.6.3

7.9.6.2 looked for 10g (Trick the system!) 7.9.6.3 looks for 11g folder structure WLS Server Details
25

Lessons Learnt 7.9.6.2 with OBIEE 11.1.1.3 Categories:

RPD and Presentation LDAP and Security Custom branding of OBIEE

The OBIEE 11g Upgrade Decision Process

Upgrade Decision process prior to 7.9.6.3 / 11.1.1.5 release
Upgrade Decision matrix
Value rank 1 2 3 4 5 6 7 8 9 10 11 12 Consideration Preferred platform 10g Use of action framework Certification of Oracle BI applications OS/Web server compatibility Data warehouse database certification Integration with Hyperion/Essbase Tighter integration with BI publisher Consolidated maintenance Scalability Proven and time tested Web browser compatibility Enhanced UI features Availability of resource pool 11g Architecture Certification Certification Certification Architecture Architecture Architecture Architecture Other Certification Usability Other Category

Sliding Scale
Use OBIEE 11g
New Custom OBIEE Implementation Existing custom OBIEE 10g implementations Upgrade custom implementations of OBIEE using Web Logic on Linux, Windows OS New implementation of OBIEE utilizing Oracle BI Applications up to 7.9.6.2 Existing OBIEE Implementations using one or more Oracle BI Applications

New Existing

Use OBIEE 10g

27

Oracle BI Application 7.9.6.3 Relevant Files

OBIEE Platform

DAC / Informatica

28

BI Apps 7.9.6.3 - Upgrade Flow (11.1.1.5)

29

Informatica 9.0.1 HF2 is the Data Integration / ETL Platform Informatica 8.6.x going out of support by year end

Do not install Informatica in a directory with space in the name, for e.g. do not install in D:\Program Files\INFA
30

OBIEE / BI Apps with Appliance Like DBMS System

A very large Retailer BI Apps on Exadata V2 BI Apps on Teradata and Netezza?? Terdata (including V13.10 ) is supported for both OBIEE / OBIA Netezza is supported for OBIEE via ODBC, native connectivity expected in 11.1.1.6, no support for OBIA)

Teradata BI Apps Best Practices

For maximizing performance in Teradata deployments, follow these: Collect Statistics as a Prerequisite else ETL performance impact and possibly spool space error (error # 2646) LEFT OUTER JOIN Issue some queries and source qualifiers may have to be re-written Group By is more efficient than Distinct when low number of distinct values Pruning of Mappings and Tables improve performance by stripping extraneous fields from mappings & tables Loader Configurations Tpump, Moad, FastLoad etc. More tips in Document e19038.pdf sec 3.5.2

BI Apps with Exadata

The Full Table Scan is no longer your enemy on Exadata side! FTS is very quick in Exadata but not in the regular 11g databases source DBs can choke! In certain situations the performance bottleneck at the source system database as it was not able to feed the Exadata box at it's import capacity consider flat file extracts from sources and using DBFS The performance configurations like indexes might not be required in the Exadata boxes in certain situations Drop the distinct key indexes and change stats method in customsql.xml

BI Apps on Exadata
On larger tables like - AP_AE_LINES_ALL, avoid PARALLEL query option, the difference in time observed was from 4 hours to 2 minutes. Disable or drop all indexes with distinct_keys = 1 (b-tree and bitmaps) reason being such indexes are ineffective, with one unique value. So it's highly unlikely that Optimizer would ever consider them in building any execution plans, e.g. W_AR_XACT_F_F63,
W_GL_REVN_F_F35, W_GL_REVN_F_F24

Avoid query transformation into a union-all query and scanning all the big tables twice. Here we will need to find a workaround to avoid the union-all to scan the tables once or find a way to reduce full scanning of the tables (partitioning/index etc). e.g table W_GL_ACCOUNT_D 8 mil rows getting scanned without any valid filtering Partitioned tables must have stats at both table and partition level

Recap
Looked at OBIEE v/s BI Apps Recent Development and Impacts Case Studies your mileage may vary! Next part Sneak Peak to 7.9.6.3

Robert Davis Oracle BI Apps 7.9.6.3 & Sneak Peak

Some Recent Development

OBIEE 11.1.1.5 released for download on May 6, 2011 OBI Apps 7.9.6.3 released same time! BI platform and BI apps are in-sync Last release 7.9.6.2 (09/2010) came after OBIEE 11.1.1.3 (08/2011) but was supported not certified Focus on exploiting 11g features and Mobile computing

recent
BI Apps 7.9.6.3 requires
New BI platform 11.1.1.5 New Informatica platform 9.0.1 New DAC (not 11g yet) but hot fixed version 10.1.3.4.1 Teradata 13.10 support

Campaign Performance Dashboard on iPad

Provides iPad/iPhone support out of box

BI Apps on iPhone

General Direction 7.9.6.3

In 7.9.6.3 focus was on making the rpd, webcat and security model 11g ready. Oracle switched to role based security from group based Some fixes in the rpd to satisfy the stricter consistency checking in 11g Leveraged some new Presentation capabilities in the reports and dashboards (such as presentation hierarchies). OBIEE 11g now allows BI apps to unlock a breadth of new capabilities such as mobile/iPad, better systems management, scorecards, etc. Primarily a certification release

Security Changes 7.9.6.3

New Security Model User>Group>Role
WebLogic Server
User Administration Group Administration

Enterprise Manager
Role Administration

RPD files now have RPD-specific passwords - used to encrypt the contents. Groups no longer exist in the RPD as objects. Data access security is implemented based on application roles to which a user belongs. Application roles are managed in an external policy store, exist in the RPD, as pointers (references) to the externally managed roles. Users managed in an external authentication provider, no longer in RPD. User objects exist in the RPD, as pointers (references) to the externally managed users.

Oracle BI Applications
Release Roadmap
Available Planned

Convergence Release Dual ETL Support Applications Unlimited Fusion Apps

INFA

Apps Unlimited

7.9.6 7.9.6

7.9.6.1 7.9.6.1

7.9.6.2 7.9.6.2
Fusion Apps

7.9.6.3 7.9.6.3 11g 11g

SAP Select Edge / Industry

11g PS1 11g PS1

11g PS2 11g PS2

ODI

7.9.5.2 7.9.5.2

SAP

7.9.7 7.9.7

7.9.7.1 7.9.7.1

Certification with OBIEE 11g

Future Directions - BI Apps

Users often want one

place / tool for Operational and Analytical reporting Degree of details in warehouse Right time data need for intra-day ETL Highly Formatted reports Security model across BI and Source Systems.

Oracle BI Applications 7.9.6.3

11g Features
Master Detail Linking Chart Sliders & Zooming Hierarchical Columns View prompts Cascading Prompts

Procurement and Spend Analytics

Chart zooming

Supply Chain and Order Management Analytics

Supply Chain and Order Management Analytics

Playback option Graph Sliders

Supply Chain and Order Management Analytics

Master Detail Linking

Graph Sliders

Supply Chain and Order Management Analytics

Select 2009 Q4

Detail graph shows Trend by Month for the selected quarter

Project Analytics
In-place Drill using presentation hierarchies

Financial Analytics
Cascading Prompts Select Fiscal Year = 2008 Fiscal Quarter shows only 2008 values

In-place Drill using presentation hierarchies

Financial Analytics

Graph Sliders

Enhanced Visualizations

Playback option

Human Resources Analytics

Oracle Mobile for BI Apps

Native mobile apps with full Dashboard functionality and all BI content types Dashboard Drill/Navigate Catalog navigation Favorites Alerts Search Actions

Dashboards dynamically adjust to exploit the form-factor of the device

Device support iOS iPhone and iPad in 11.1.1.5 Android next Blackberry awaited??

Oracle BI Applications on Apple ipad

Example: Marketing Analytics

BI Apps Customers to 11g

Two approaches: Upgrade to BI Applications 7.9.6.3
Certifies 11.1.1.5, out of the box support for 11g capabilities Recommended choice for net new implementations and existing BI Apps customers needing 11.1.1.5 capabilities alike

Platform-only upgrade for existing BI Apps deployments

Fully supported with OBIEE 11.1.1.5 but not without challenges Good option for heavily customized deployments with strong need for 11.1.1.5 features Case Study of 7.9.6.2 customer

Summary / Questions
Recap OBIEE Recap BI Applications New 7.9.6.3 Questions ShyamVaran@Gmail.com Follow up discussions at:

http://oraclebiwasig.blogspot.com/
Thanks to IOUG, Florian Shouten, Rich Solari, Abhinav Banerjee