Oracle GoldenGate 12c Implementer's Guide
()
About this ebook
- Orchestrate the rich features of GoldenGate 12c and exploit the performance-enhancing features and manageability in your Enterprise environment
- Master data integration techniques to empower your organisation's readiness to migrate to cloud technologies quickly and easily
- An easy-to-follow step-by-step guide full of hands-on examples that offer a solid foundation of real-time data integration and replication in heterogeneous IT environments
The book is aimed at Oracle database administrators, project managers, and solution architects who wish to extend their knowledge of GoldenGate. The reader is assumed to be familiar with Oracle databases. No knowledge of GoldenGate is required.
John P Jeffries
Originally from a development background, John P Jeffries has worked for Oracle Corporation since the Siebel acquisition in 2005. His time at Siebel was spent developing ETL solutions for Data Warehouses, later moving to Oracle Consulting and then Oracle Advanced Customer Services as a Senior Principal Consultant, earning the internal title of "The UK's Data Replication Expert". Now a freelance consultant, he can be found onsite in many of the world's most respected financial institutions in London, consulting on Oracle GoldenGate, Streams, and Active Data Guard. With over 15 years of Oracle experience, and an OCP since Oracle 8i, he has extensive knowledge of Oracle databases, including Enterprise Linux and RAC, coupled with the ability to design and build high-performance distributed database systems. He has trained internal and external clients in Data Warehousing and Data Replication techniques, and continues to share his knowledge and experience through his own Website: http://www.oracle11ggotchas.com.
Related to Oracle GoldenGate 12c Implementer's Guide
Related ebooks
Oracle GoldenGate 11g Implementer's guide Rating: 5 out of 5 stars5/5Oracle Goldengate 11g Complete Cookbook Rating: 5 out of 5 stars5/5Oracle 11g Streams Implementer's Guide Rating: 0 out of 5 stars0 ratingsOracle 11g R1/R2 Real Application Clusters Essentials Rating: 5 out of 5 stars5/5Oracle Data Guard 11gR2 Administration Beginner's Guide Rating: 0 out of 5 stars0 ratingsAdvanced Oracle PL/SQL Developer's Guide - Second Edition Rating: 5 out of 5 stars5/5Oracle Database 11g - Underground Advice for Database Administrators: Beyond the basics Rating: 0 out of 5 stars0 ratingsGetting Started with Oracle Data Integrator 11g: A Hands-On Tutorial Rating: 5 out of 5 stars5/5Oracle Database 12c Backup and Recovery Survival Guide Rating: 5 out of 5 stars5/5Oracle SQL Developer Rating: 0 out of 5 stars0 ratingsOracle Advanced PL/SQL Developer Professional Guide Rating: 4 out of 5 stars4/5Oracle SQL Developer 2.1 Rating: 0 out of 5 stars0 ratingsLearning Apache Spark 2 Rating: 0 out of 5 stars0 ratingsAzure Storage, Streaming, and Batch Analytics: A guide for data engineers Rating: 0 out of 5 stars0 ratingsOracle Information Integration, Migration, and Consolidation Rating: 0 out of 5 stars0 ratingsIntroduction to Oracle Database Administration Rating: 5 out of 5 stars5/5AWS Certified Database Study Guide: Specialty (DBS-C01) Exam Rating: 0 out of 5 stars0 ratingsOracle 10g/11g Data and Database Management Utilities Rating: 0 out of 5 stars0 ratingsConcise Oracle Database For People Who Has No Time Rating: 0 out of 5 stars0 ratingsOracle Warehouse Builder 11g: Getting Started Rating: 0 out of 5 stars0 ratingsInfrastructure as Code (IAC) Cookbook Rating: 0 out of 5 stars0 ratingsOCA Oracle Database 11g Database Administration I: A Real-World Certification Guide Rating: 4 out of 5 stars4/5Learning Hadoop 2 Rating: 4 out of 5 stars4/5Oracle SOA Suite 12c Administrator's Guide Rating: 0 out of 5 stars0 ratingsDevOps with Windows Server 2016 Rating: 0 out of 5 stars0 ratingsMastering Kubernetes Rating: 5 out of 5 stars5/5PostgreSQL Replication - Second Edition Rating: 0 out of 5 stars0 ratingsPostgreSQL Server Programming - Second Edition Rating: 0 out of 5 stars0 ratingsHadoop in Practice Rating: 0 out of 5 stars0 ratingsGetting Started with Oracle WebLogic Server 12c: Developer’s Guide Rating: 0 out of 5 stars0 ratings
Computers For You
SQL QuickStart Guide: The Simplified Beginner's Guide to Managing, Analyzing, and Manipulating Data With SQL Rating: 4 out of 5 stars4/5Deep Search: How to Explore the Internet More Effectively Rating: 5 out of 5 stars5/5CompTIA Security+ Get Certified Get Ahead: SY0-701 Study Guide Rating: 5 out of 5 stars5/5The ChatGPT Millionaire Handbook: Make Money Online With the Power of AI Technology Rating: 0 out of 5 stars0 ratingsCreating Online Courses with ChatGPT | A Step-by-Step Guide with Prompt Templates Rating: 4 out of 5 stars4/5Mastering ChatGPT: 21 Prompts Templates for Effortless Writing Rating: 5 out of 5 stars5/5How to Create Cpn Numbers the Right way: A Step by Step Guide to Creating cpn Numbers Legally Rating: 4 out of 5 stars4/5Procreate for Beginners: Introduction to Procreate for Drawing and Illustrating on the iPad Rating: 0 out of 5 stars0 ratingsGrokking Algorithms: An illustrated guide for programmers and other curious people Rating: 4 out of 5 stars4/5The Professional Voiceover Handbook: Voiceover training, #1 Rating: 5 out of 5 stars5/5The Insider's Guide to Technical Writing Rating: 0 out of 5 stars0 ratingsCompTIA Security+ Practice Questions Rating: 2 out of 5 stars2/5Remote/WebCam Notarization : Basic Understanding Rating: 3 out of 5 stars3/5Dark Aeon: Transhumanism and the War Against Humanity Rating: 5 out of 5 stars5/5Artificial Intelligence: The Complete Beginner’s Guide to the Future of A.I. Rating: 4 out of 5 stars4/5Ultimate Guide to Mastering Command Blocks!: Minecraft Keys to Unlocking Secret Commands Rating: 5 out of 5 stars5/5Mindhacker: 60 Tips, Tricks, and Games to Take Your Mind to the Next Level Rating: 4 out of 5 stars4/5Everybody Lies: Big Data, New Data, and What the Internet Can Tell Us About Who We Really Are Rating: 4 out of 5 stars4/5Standard Deviations: Flawed Assumptions, Tortured Data, and Other Ways to Lie with Statistics Rating: 4 out of 5 stars4/5Elon Musk Rating: 4 out of 5 stars4/5Network+ Study Guide & Practice Exams Rating: 4 out of 5 stars4/5What Video Games Have to Teach Us About Learning and Literacy. Second Edition Rating: 4 out of 5 stars4/5
Reviews for Oracle GoldenGate 12c Implementer's Guide
0 ratings0 reviews
Book preview
Oracle GoldenGate 12c Implementer's Guide - John P Jeffries
Table of Contents
Oracle GoldenGate 12c Implementer's Guide
Credits
About the Author
About the Reviewers
www.PacktPub.com
Support files, eBooks, discount offers, and more
Why subscribe?
Free access for Packt account holders
Instant updates on new Packt books
Preface
What this book covers
What you need for this book
Who this book is for
Conventions
Reader feedback
Customer support
Downloading the example code
Errata
Piracy
Questions
1. Getting Started
What is GoldenGate?
Oracle GoldenGate evolution
Oracle GoldenGate solutions
Oracle GoldenGate technology overview
Extract – the capture process
Trail files
Data pump
Server collector
Replicat – the apply process
The Manager process
GGSCI
Process data flow
Oracle GoldenGate architecture
Classic configurations
One-to-one architecture
One-to-many architecture
Many-to-one architecture
Cascading
Bidirectional – active-active
Bidirectional – active-passive
New configurations
Oracle Data Integrator
Oracle Big Data
12c new features
Integrated capture
Integrated Replicat
Downstream capture
Installation
Upgrading to 12c
Multitenant database replication
Coordinated Delivery
Enhanced event-based processing
Enhanced security
Conflict Detection and Resolution
Dynamic Rollback
Streams to GoldenGate migration
Improved management and monitoring
Oracle Management Pack
Oracle GoldenGate Veridata
Supported platforms and databases
Oracle GoldenGate topology
Process topology
The rules
Position
Statistics
Design considerations
Choosing a solution
Network
Database schema
What to replicate?
Object mapping and data selection
Initial load
CSN coordination
Trail file format
Summary
2. Installing and Preparing GoldenGate
Prerequisites
The GoldenGate certification matrix
Downloading the software
Software requirements
Hardware requirements
Memory
CPU
Network
Disk
The Oracle virtual machine
The software installation
Installing GoldenGate using the OUI
Unpacking the media
Enabling the X server
Running the installer
Performing a silent installation
The subdirectories
br
dircrd
dirchk
dirdat
dirdef
dirpcs
dirprm
dirrpt
dirsql
dirtmp
dirwlt
Preparing the environment
Preparing the 12c container database for data replication
Enabling archive log mode
Enabling supplemental logging
Creating GoldenGate admin user
Enabling the Flashback Query
Enabling transaction data capture
Preparing the 11g database for replication
Enabling the archive log mode
Creating the GoldenGate admin user
Enabling the transaction data capture
Preparing the operating system
Creating the initial configuration
Configuring the Manager process
The capture process
Creating the capture process
Registering the capture process in a 12c container database
Registering the capture process in a 11g database
The data pump process
Starting the capture process
The apply process
Creating the GoldenGate admin user on the target database
Registering the Replicat process in the target database
Creating and starting the apply process
The configuration summary
Patching the GoldenGate home
GoldenGate deinstallation from Linux/Unix
Summary
3. Design Considerations
Replication methods
Active-active replication
Active-passive replication
Cascading
Downstream capture
Extract Load and Transform (E-LT)
Networking
Surviving network outages
Redundant networks
NIC teaming
Non-functional requirements
Performance
Availability
Security
Backup and recovery
Support
Hardware considerations
Computing architectures
Grid computing
Single server
Clusters
Cloud computing
Machines
The x86-64 Linux server
The database machine
Scaling up and out
Changed data management
Integrated capture and delivery
Classic mode
Coordinated mode
DDL replication
Changed data recovery
Point-in-time recovery (PITR)
Oracle Recovery Manager (RMAN)
Flashback
SAN Snapshot
Summary
4. Configuring Oracle GoldenGate
GoldenGate parameters
The GoldenGate instantiation
Choosing an instantiation method
File to Replicat
Extract parameters
Replicat parameters
File to Database Utility
Extract parameters
Replicat parameters
Direct Load
Extract parameters
Replicat parameters
Direct Bulk Load
Extract parameters
Replicat parameters
Performing the initial load
The example architecture
Direct Load instantiation
Configuring initial data capture
Configuring change data capture
The configuration summary
Creating the configuration for multitenant databases
Creating the configuration for nonCDB databases
Configuring change delivery
Testing change data capture and delivery
Stopping GoldenGate processes
More about trail files
The trail
Trail file purging
Configuring Oracle Manager process
Configuring the downstream mining database
Preparing the source database
Preparing the target database
The GoldenGate configuration
Summary
5. Configuration Options
Using BATCHSQL
The SQL cache
Exceptions
When to use BATCHSQL
Data compression
Compressing the data stream
The COMPRESS option
The Oracle table compression
Security features
The wallet method
The ENCKEYS method
The data encryption
The message encryption
The trail file encryption
The password encryption
The default method
The named method
The Credential Store
Event-based processing
The Event Marker System
Triggering Event Actions
Using Event Actions to improve batch performance
Bidirectional configuration options
The loop detection
Conflict Detection and Resolution in bidirectional environment
CDR reporting
Exception handling
Oracle sequences
Oracle triggers
The DDL support
The DDL replication
The DDL configuration
Filtering
Mapping options
The DDLOPTIONS parameter
Using DUMPDDL
Using LogMiner
Heterogeneous environments
Microsoft SQL Server
IBM DB2
The DEFGEN utility
Oracle Streams to GoldenGate Migration
Summary
6. Configuring GoldenGate for HA
GoldenGate on RAC
Shared Storage
ACFS
DBFS
OCFS
Configuring GoldenGate on RAC
Configuring Grid Infrastructure for GoldenGate
Oracle Grid Infrastructure Agents (XAG)
Installing the XAG Grid Infrastructure Agents
The Virtual IP
Creating an ACFS-shared filesystem
Installing the GoldenGate software
Creating the GoldenGate application VIP
Resilience
GoldenGate on Exadata
Supported compression methods
Considerations
Creating the Extract process
Creating the Replicat process
Failover
The automatic failover
The manual failover
The GoldenGate application failover
The active-active configuration
Summary
7. Advanced Configuration
Mapping your data
Column mapping
Using the COLMAP option
The COLMATCH option
Using the DEFGEN utility
Data selection and filtering
The WHERE clause
The FILTER clause
Loop detection
Active-active
Cascade
Data transformation
Truncation and extraction
Concatenation
Substitution
Case changing
Conversion functions
Arithmetic expressions
Date functions
DDL support
The SQLEXEC parameter
Data lookups
Executing stored procedures
Executing SQL
Executing DML
Handling errors
Scheduling jobs
Using and defining macros
User tokens
Using user tokens to populate a heartbeat table
User exits
Calling C routines
Sample user exits
Source files explained
Using logic in the data replication
Replicating data between different GoldenGate versions
Licensing
Oracle Data Integrator 12c
ETL versus E-LT
Pros
Cons
Knowledge Modules
Summary
8. Managing Oracle GoldenGate
The Oracle Management Pack for GoldenGate
Oracle GoldenGate Monitor 12c
Command-level security
The CMDSEC file
Managing the trail file
Managing the process startup
Managing TCP/IP errors
Reporting and statistics
Monitoring errors
Monitoring latency
Creating an OEM 12c Metric Extension to monitor GoldenGate processes
Creating the monitoring script
Creating the Metric Extension
Deploying the Metric Extension
Historical reporting
Measuring throughput
The data throughput
The operation throughput
Summary
9. Performance Tuning
Before tuning GoldenGate
The online redo logs
Large objects – LOBs
Base lining
DBFS enhancements
Tuning data delivery
Balancing load across parallel process groups
Considerations when using parallel process groups
Splitting large tables into row ranges across process groups
The RANGE function
Adding Replicats with the @RANGE function
Tuning parameters to improve the Replicat throughput
BATCHSQL
COMMIT_SERIALIZATION
EAGER_SIZE
PARALLELISM
Viewing integrated parameters
Controlling the memory consumption
Tracing processes to find wait events
Diagnosing a slow Extract
Static data dictionary views
Tuning the network
Linux TCP tuning
Hardware upgrades
Solid-state disks
Summary
10. Troubleshooting GoldenGate
Troubleshooting tips
Troubleshooting process startup failures
The CHECKPARAMS parameter
Adjusting the replication starting point
Altering Extract processes in RAC environments
Classic capture
Integrated capture
Confirming the integrated capture process status
Checking data throughput
Checking process checkpoints
Recovering from a corrupt trail file
GoldenGate health check
The GoldenGate dynamic performance views
Investigating network issues
TCP/IP
SQL*Net
Bequeath connections
Investigating Oracle errors
Exception handling
Creating an exceptions handler
Viewing exceptions
Handling Oracle Sequences
Using LOGDUMP
Opening files
Viewing the header record
Viewing the transaction record
Miscellaneous commands
Filtering records
Upgrading GoldenGate
Dynamic Rollback
Creating process groups and trails for reverse processing
Summary
11. The Future of GoldenGate
Cloud computing
The Oracle Integration Cloud Service
On-premises to cloud migrations
GoldenGate and Big Data
Deprecation of the nonCDB architecture
Oracle GoldenGate 12c Release 2
Summary
A. GGSCI Commands
B. GoldenGate Installed Components
C. Acronyms
Index
Oracle GoldenGate 12c Implementer's Guide
Oracle GoldenGate 12c Implementer's Guide
Copyright © 2015 Packt Publishing
All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.
Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author nor Packt Publishing, and its dealers and distributors will be held liable for any damages caused or alleged to be caused directly or indirectly by this book.
Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.
First published: February 2011
Second edition: July 2015
Production reference: 1210715
Published by Packt Publishing Ltd.
Livery Place
35 Livery Street
Birmingham B3 2PB, UK.
ISBN 978-1-78528-047-4
www.packtpub.com
Credits
Author
John P Jeffries
Reviewers
Asif Momen
Shuxuan Nie
Gavin Soorma
Eric Yen
Commissioning Editor
Nadeem Bagban
Acquisition Editor
Vinay Argekar
Content Development Editor
Akashdeep Kundu
Technical Editor
Siddhesh Ghadi
Copy Editors
Relin Hedly
Akshata Lobo
Project Coordinator
Milton Dsouza
Proofreader
Safis Editing
Indexer
Monica Ajmera Mehta
Graphics
Disha Haria
Production Coordinator
Conidon Miranda
Cover Work
Conidon Miranda
About the Author
John P Jeffries has worked in many countries around the world, consulting on the Oracle technology. He is interested in different cultures and enjoys teaching others. At present, John lives and works in Singapore and is employed as a subject matter expert at a global bank, delivering enterprise-wide infrastructure design solutions, particularly in the database private cloud and data replication space. Since he wrote his first book, Oracle GoldenGate 11g Implementer's Guide, he has been heavily focused on leveraging Oracle's Fusion Middleware products (including GoldenGate) to address performance, data migration, and data delivery issues.
With over 15 years of experience in Oracle, John has worked for a number of global organizations, such as BT, Siebel Systems, Dell, Thomson Reuters, and Oracle Corporation, to name a few. At Oracle, he worked in advanced customer services on key accounts as a senior principal consultant and became the UK data replication expert, often publishing articles on his own website (http://oracle11ggotchas.com/).
John is an Oracle Certified Professional and a GoldenGate specialist. He gives presentations at ODTUG conferences and continues to share his real-life hands-on experience through his work. Known for his ability to provide robust, effective solutions and workarounds, John delivers his knowledge, tips, and tricks in his new book, Oracle GoldenGate 12c Implementer's Guide.
Thank you for purchasing my book, which would not have been possible without the help and support of a number of key people and organizations. First, I would like to thank my wife, Wendy, for her dedication, encouragement, and the sacrifice that she has endured. I would also like to thank her for her support at weekends and for putting up with my late nights' work. Wendy also helped me with the proofreading. Second, I would like to thank the reviewers of this book, who provided me with excellent feedback that helped me focus on the material for the Oracle community. Finally, I would like to thank Packt Publishing for asking me to write a second edition of Oracle GoldenGate 11g Implementer's Guide. I trust that you will find this edition just as interesting and informative as the first, enabling you to tailor a successful implementation of Oracle 12c GoldenGate to your specific requirements.
About the Reviewers
Asif Momen has been working with Oracle technologies for over 14 years and has expertise in database architecture, performance tuning, and high availability. He has a master's degree in software systems from Birla Institute of Technology and Science (BITS), Pilani.
Asif has been honored with the prestigious Oracle ACE award from Oracle Technology Network. He has authored Oracle Database XE 11gR2 Jump Start Guide for Packt Publishing. Asif is an Oracle Certified Master (OCM) and has certifications in OCP 11g DBA and OCP 9i Forms Developer. He is also an Oracle Certified Expert in RAC 10g.
Asif has given presentations at the Oracle OpenWorld 2012, 2011, and 2010 conferences, All India Oracle User Group (AIOUG), and Middle East Oracle User Group (MEOUG). He is an active contributor to the Oracle user community and plays the following roles in various users groups:
Member of the executive committee, Middle East Oracle User Group (MEOUG)
Member of the editorial team, All India Oracle User Group (AIOUG)
Technical reviewer, Oracle Scene, UK Oracle User Group
His articles have appeared in Oracle Support - Customer Knowledge Exchange. His main areas of interest include database architecture and tuning, Oracle RAC, and backup and recovery. He posts his ideas and opinions on The Momen blog at http://momendba.blogspot.com. Asif can be reached at
Shuxuan Nie is a platform architect with specialization in SOA, Oracle VM, Exalogic, and Java technologies. She holds an MS in computer science from Beijing University of Aeronautics and Astronautics. ShuXuan has 15 years of experience in the IT industry, which includes SOA technologies, such as BPEL, ESB, SOAP, XML, Enterprise Java technologies, Eclipse plugins, and C++ cross-platform development. Since 2010, she has been working at Rubicon Red, helping customers resolve integration issues and design and implement highly available infrastructure platforms on Oracle VM and Exalogic.
From 2007 to 2010, ShuXuan worked with the Oracle Global Customer Support team and focused on helping customers solve their middleware/SOA integration problems. Before joining Oracle, he worked as a staff software engineer at IBM China Software Development Lab for 4 years and participated in several complex products, such as IBM Lotus Workplace, WebSphere, and the Eclipse platform. Later, he joined the Australia Bureau of Meteorology Research Center, where he was responsible for the implementation of the Automated Thunderstorm Interactive Forecast System for Aviation and Defense.
Gavin Soorma is an Oracle ACE and Oracle Certified Master with over 19 years of experience. He is also an Oracle Certified Professional (versions 7.3, 8i, 9i, 10g, 11g, and 12c) and an Oracle Certified Implementation Specialist in GoldenGate, Exadata, and Enterprise Manager 12c.
Gavin regularly gives presentations at various Oracle conferences and seminars. He has presented several papers at the IOUG, South African Oracle User Group, Oracle OpenWorld, and the Australian Oracle User Group. He presented a paper on Oracle GoldenGate titled Real Time Access to Real Time Information at AUSOUG 2015, which was held in Melbourne and Perth.
He is currently employed as a senior principal consultant at OnCall DBA, an Oracle solution provider based in Perth, Western Australia. Prior to this, he held the position of a senior Oracle DBA and team leader with Bankwest in Perth. Before migrating to Australia, Gavin worked for Emirates Airline Group IT in Dubai for over 15 years, where he held the position of a technical team manager of databases.
He has also written a number of tutorials and notes on Oracle GoldenGate, which can be accessed via his personal blog at http://gavinsoorma.com.
He was a technical reviewer for another book, Oracle GoldenGate 11g Implementer's Guide by John P Jeffries, Packt Publishing.
Eric Yen has been working with Oracle products since 1994. His experience includes working with VLDBs for various United States government agencies. Eric's areas of expertise include architecting and implementing Oracle's highly available and replication environments from their conception to implementation. He holds multiple Oracle and Security certifications from ISC2.
First of all, I would like to thank God for all that he has provided me and for being patient with me. Also, I would like to thank all those who have taught me to be a better person every day, both in my professional and personal life. I would like to thank Jane L., Alex C., Zach C., Richard R., Connie R., Carlie R., Emma R., Brenda M., Kristen F., and Brian R. My sincere gratitude goes to Michael R., Tom D., Jim P., Dave A., Joe C., Nick W., Larry C., and Hattie H. from Oracle Corporation. This list can never be all inclusive for those I missed (and those who cannot be mentioned); you are not purposely forgotten. Thank you, all.
When you know, then teach.
When you don't, then learn.
www.PacktPub.com
Support files, eBooks, discount offers, and more
For support files and downloads related to your book, please visit www.PacktPub.com.
Did you know that Packt offers eBook versions of every book published, with PDF and ePub files available? You can upgrade to the eBook version at www.PacktPub.com and as a print book customer, you are entitled to a discount on the eBook copy. Get in touch with us at
At www.PacktPub.com, you can also read a collection of free technical articles, sign up for a range of free newsletters and receive exclusive discounts and offers on Packt books and eBooks.
https://www2.packtpub.com/books/subscription/packtlib
Do you need instant solutions to your IT questions? PacktLib is Packt's online digital book library. Here, you can search, access, and read Packt's entire library of books.
Why subscribe?
Fully searchable across every book published by Packt
Copy and paste, print, and bookmark content
On demand and accessible via a web browser
Free access for Packt account holders
If you have an account with Packt at www.PacktPub.com, you can use this to access PacktLib today and view 9 entirely free books. Simply use your login credentials for immediate access.
Instant updates on new Packt books
Get notified! Find out when new books are published by following @PacktEnterprise on Twitter or the Packt Enterprise Facebook page.
Preface
In recent years, data replication has been an important part of many database systems. The growing trend for data integration is due to today's demand for real-time access and real-time information. GoldenGate is Oracle's strategic data synchronization solution that has become integrated with many sister products to address the most demanding business requirements. Until now, very little has been written about the end-to-end implementation of GoldenGate in a production enterprise-wide environment, irrespective of whether it is the traditional point-to-point replication or on-premise to cloud, performance, scalability, data integrity, and security, which is always paramount.
Welcome to Oracle GoldenGate 12c Implementer's Guide, a comprehensive book that delivers a practical approach in a clear and concise style. Whether you are new to GoldenGate or an advanced user, this book helps you get up to speed quickly. Based on the author's own experience, this long-awaited second edition book has all the information that is required to install, design, configure, and tune data integration solutions suited to every environment. Expert users can dive into key topic areas, such as performance tuning or troubleshooting, and seek desired solutions from the numerous tips and tricks, whereas novice users can go through the early installation and configuration chapters, later progressing to the advanced chapters.
This book helps you master data integration techniques to empower your organizations' readiness to migrate to cloud technologies quickly and easily. Covering both noncontainer and multitenant container database architecture, the book will appeal to the Oracle 11g and 12c database administrator, implementing GoldenGate for the most demanding business requirements.
This book is more than an implementation guide. It offers detailed real-life examples, encouraging additional thought and discussion that goes beyond the manual.
With Oracle GoldenGate 12c Implementer's Guide in hand, you'll be designing, installing, and configuring high-performance solutions with GoldenGate within minutes.
What this book covers
Chapter 1, Getting Started, provides an introduction to Oracle GoldenGate by describing the key components, processes, and considerations required to build and implement a GoldenGate solution. The topics covered include the evolution of the GoldenGate software, including the architecture behind the technology, followed by the solutions GoldenGate can provide along with its effective design. You will become accustomed with the concepts of the data replication and how GoldenGate provides robust enterprise-wide solutions.
Chapter 2, Installing and Preparing GoldenGate, helps you quickly learn the individual tasks needed to complete an end-to-end GoldenGate installation, including downloading, installing, and configuring the Oracle GoldenGate 12c software, the preinstallation steps for the OS and database, apart from the software and hardware requirements. The steps include the Oracle database setup and the configuration of GoldenGate, providing an overview that allows you to swiftly get up and running.
Chapter 3, Design Considerations, tells you how to address some of the issues that influence the decision-making process when you design a GoldenGate solution. This includes design considerations for performance, security, backup and recovery, and high availability. This chapter also helps you choose the appropriate hardware and topology to deliver a fast, robust, and scalable solution.
Chapter 4, Configuring Oracle GoldenGate, initially discusses the main GoldenGate configuration parameters and provides a methodical approach to the configuration process, stepping through each task to give in-depth information necessary to successfully implement Oracle GoldenGate 12c. In this chapter, you will learn the basic steps necessary to configure one-way replication in a GoldenGate environment, including data synchronization between the source and target.
Chapter 5, Configuration Options, focuses on the additional configuration options available in Oracle GoldenGate 12c. The powerful options discussed in this chapter allow you to extend your configuration to increase functionality and performance. Starting with a performance enhancing option to exploring the security features, data compression and encryption, heterogeneous environments, and finally discussing the DDL support and the tools available to monitor the DDL replication, this chapter covers an extensive array of configuration topics.
Chapter 6, Configuring GoldenGate for HA, explores how to configure GoldenGate in a RAC environment and talks about the various components that effectively enable HA for data replication and integration. The discussion topics include shared storage options, load balancing, and failover, apart from GoldenGate on Exadata.
Chapter 7, Advanced Configuration, gives you a deeper understanding about how to configure GoldenGate. By the time you are done with this chapter, you will be able to explore and realize each parameter specification and further develop your GoldenGate configuration. You will also learn how GoldenGate is used with Oracle Data Integrator to deliver real-time data synchronization solutions.
Chapter 8, Managing Oracle GoldenGate, focuses on the management features already built-in the GoldenGate Command Interpreter (GGSCI). This chapter discusses and implements a number of utilities, including tips and tricks that allow you to manage your GoldenGate environment effectively at no extra cost. This includes a step-by-step guide to configure a Metric Extension in Oracle Enterprise Manager 12c to monitor your GoldenGate Enterprise.
Chapter 9, Performance Tuning, covers the main areas that lend themselves to tuning, especially parallel processing and load balancing, enabling high data throughput and very low latency. In this chapter, you will learn how to leverage the performance enhancing new features that are available in GoldenGate 12c, including batch replication latency reduction and data delivery optimization through integrated processes.
Chapter 10, Troubleshooting GoldenGate, tells you how to investigate and resolve some of the common issues faced by the GoldenGate administrator. This chapter has captured some of the most common failure scenarios, offering help and guidance to wards a successful resolution. From using LOGDUMP to drilling into the GoldenGate trail files to automatic exception handling, you will quickly understand the importance of a methodical approach to troubleshooting.
Chapter 11, The Future of GoldenGate, takes you through the new technology and concepts where GoldenGate plays a role. It discusses cloud computing, Software as a Service (SaaS), and advances in integration, such as on-premise to cloud migrations and big data as well.
Appendix A, GGSCI Commands, provides a quick reference guide to all the available GGSCI commands.
Appendix B, GoldenGate Installed Components, lists the GoldenGate-installed components and their descriptions.
Appendix C, Acronyms, lists the acronyms with their fully qualified names that have been used throughout this book.
What you need for this book
At the minimum, you will require the following elements to run the code featured in this book. Starting with the hardware, you can configure a simple GoldenGate solution on just one personal computer that acts as a database server, running Oracle or Red Hat Enterprise Linux x86 Version 5.2. These can be native Linux or Linux virtual machines hosted on Microsoft Windows 7 or 8.
The same PC may be used as a client that supports terminal emulation software for logging in to the database server.
The following list provides the minimum hardware specification for the PC that will host the virtual machines:
1 x 2.3 GHz Core i7 Intel-based 64-bit architecture CPU
8 GB of physical memory
500 GB hard disk drive
1 x 1Gb/s Ethernet adapter
Oracle VM VirtualBox 64-bit for Windows (version 4.3.26)
The virtual machine specification is as follows; for 2VMs, each has:
4 CPU cores
4 GB RAM
30 GB filesystem storage
To implement a simple point-to-point data replication solution, you will need two Oracle 12c Release 1 databases. Both source and target databases can reside on the same machine.
Refer to the preinstallation requirements found on the Oracle website at https://docs.oracle.com/database/121/LADBI/pre_install.htm#LADBI7487.
The following list provides the software requirements:
Oracle or Red Hat Enterprise Linux Server Release 6.4 64 bit
Oracle Server 12.1.0 on Oracle Enterprise Linux 6.4 64 bit (This is required for the 2 Oracle databases: source and target)
Oracle GoldenGate Version 12.1.2.x for Oracle 12c on Oracle Enterprise Linux 6 64 bit
Microsoft Windows 7 or 8
Perl v5.10.1 (included with OEL/RHEL 6.4)
PuTTY 0.64 for MS Windows (the terminal emulation software that supports the SSH protocol)
WinSCP Version 5.7.2 for MS Windows (the file transfer software that supports the SFTP protocol)
Who this book is for
This book is for solution and database architects, who wish to learn about the functionality and efforts required in implementing a data replication, migration, or integration solution using GoldenGate. It is also designed for system administrators and database administrators, who want to implement, or who have already implemented GoldenGate, and who want to explore its advanced features. An intermediate understanding of Oracle's database technology is assumed.
Conventions
In this book, you will find a number of text styles that distinguish between different kinds of information. Here are some examples of these styles and an explanation of their meaning.
Code words in text, database table names, folder names, filenames, file extensions, pathnames, dummy URLs, user input, and Twitter handles are shown as follows: We can include other contexts through the use of the include directive.
A block of code is set as follows:
pdb2=
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = db12server02)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = pdb2)
)
)
Any command-line input or output is written as follows:
[oracle@db12c ogg_src]$ oerr ora 1466 01466, 00000, unable to read data - table definition has changed
// *Cause: Query parsed after tbl (or index) change, and executed // w/old snapshot // *Action: commit (or rollback) transaction, and re-execute
New terms and important words are shown in bold. Words that you see on the screen, for example, in menus or dialog boxes, appear in the text like this: This provides all GoldenGate INFO, WARNING, and ERROR messages.
Note
Warnings or important notes appear in a box like this.
Tip
Tips and tricks appear like this.
Reader feedback
Feedback from our readers is always welcome. Let us know what you think about this book—what you liked or disliked. Reader feedback is important for us as it helps us develop titles that you will really get the most out of.
To send us general feedback, simply e-mail <feedback@packtpub.com>, and mention the book's title in the subject of your message.
If there is a topic that you have expertise in and you are interested in either writing or contributing to a book, see our author guide at www.packtpub.com/authors.
Customer support
Now that you are the proud owner of a Packt book, we have a number of things to help you to get the most from your purchase.
Downloading the example code
You can download the example code files from your account at http://www.packtpub.com for all the Packt Publishing books you have purchased. If you purchased this book elsewhere, you can visit http://www.packtpub.com/support and register to have the files e-mailed directly to you.
Errata
Although we have taken every care to ensure the accuracy of our content, mistakes do happen. If you find a mistake in one of our books—maybe a mistake in the text or the code—we would be grateful if you could report this to us. By doing