GoldenGate - Replication

STRICTLY CONFIDENTIAL
DRAFT
GoldenGate - Replication
Part - 2
March 7, 2006
DRAFT
pillair [printed: March 9, 2006 8:37 AM] [saved: April 6, 2006 8:04 AM] C:\Documents and Settings\pillair\Local Settings\Temporary Internet Files\OLK20\GoldenGate - Replication - Part 2.ppt
Table of Contents
SECTION 1 SECTION 2 SECTION 3 SECTION 4
Installation Setting up Primary Setting up Destination Starting Replication
2 7 22 28
SECTION 1
Installation
DRAFT
Installation
Install Standards
j Unix account for installation: oracle j GoldenGate software base directory: $ORACLE_BASE/ggs j GoldenGate trail file location: /sbcdata/0?/ggsdata j Oracle database schema for GG replication: ggsuser j Default table space for ggsuser: tools j Primary database must have secondary arch log destination created to go to "arch1" directory. This setup can be shared with existing DataGuard configuration. j User tables need to be listed clearly as <schema>.<table> in prm files. j A primary database should only have one EXTRACT process. GG datapump(s) can be configured to distribute replication data to multiple destinations from a single source.
DRAFT
Installation
Install Standards
j "ggsrepmon_install_ora_9i.sql" need to be run against all databases as oracle user. This script will create monitoring table "sa_repmonchk" under oracle schema. j Table "ORACLE.SA_REPMONCHK" should be included in the list of replicated tables. j All GoldenGate related scripts including prm and setup scripts would be generated by "ggsrepgen" script generator. Since the name and description of a GoldenGate process has to be unique within a system, ggsrepgen will automatically generate those names for you. Please do not modify the name and description manually.
DRAFT
Installation
Naming Standards of GG processes
Process Nam e
EXTRACT Exxxx (E0001)
Descript ion
EXT_<PDB>
Dat a Pump REPLICAT
Pxxxx (P0008) Rxxxx (R0012)
PM P_<PDB>_<RDB> REP_<PDB>_<RDB>
DRAFT
Installation
ANY QUESTIONS?
SECTION 2
Setting up Primary
DRAFT
Setting up Primary
j General process of setup GG:
Prepare ggs base installation. Prepare pw file for the primary host. Arrange disk space for GG trail. Prapare prm files for MGR and EXTRACT. Setup supplemental log group for tables. Add EXTRACT through ggsci. Start the process
j Sample test case Set-up: The sample scripts are generated based on the following set-up.
Primary machine: schi6500nap Destination machine: xldn0567dor Schema name: muthusse Primary DB: NPJ06MS Target DB: NPJ06LX
DRAFT
Setting up Primary
Step-by-Step Installation
j Install Goldengate software. Make sure to tar the right version of GG to match OS. The software is in tar format as ggs_<ostype>_<ggversion>.tar.Z
cd $ORACLE_BASE mkdir ggs cd ggs zcat /home/dbtools/GoldenGate/ggs_sun28_ora92_v7316.tar.Z | tar xvf
j Copy the password file. (if it is a new server, get password string from Nitin, Mark Gokman, Martin Cyriac, Jacob, or Alan)
cp /home/dbtools/GoldenGate/PasswordFile/pw .
j If the password is incorrect, GG generates the following error:

schi6500nap(oracle):NPJ06MS:ggs$ ggsci 2006-04-04 14:38:58 GGS ERROR 101 Bad Password/Unlicensed Access: Contact GoldenGate Software (system schi6500nap). 2006-04-04 14:38:58 GGS ERROR 190 PROCESS ABENDING.
DRAFT
Setting up Primary
j Install support tools, if necessary. (importhufs should automatically copy ggsrepgen, ggsrolo and ggsrepmon to bin directory).
cp ggsrepgen ggsrolo ggsrepmon /sbclocal/app/oracle/local/bin
j Put the Primary database in Archivelog mode and turn on supplemental logging and Force logging.
alter database archivelog; alter database force logging; alter database add supplemental log data (primary key) columns
j Edit init or spfile file to add arch1 location.

alter system set log_archive_dest_2='LOCATION=/sbclocal/app/oracle/admin/NPJ06MS/arch1 scope=both;
j Create ggsuser (if required) and remember the password to enter in config file for ggsrepgen. This script creates replicatican_role and grant necessary system privileges.
sqlplus / @/home/dbtools/GoldenGate/setup/create_ggsuser.sql
10
DRAFT
Setting up Primary
j Install monitoring utility by connecting Oracle (not as sysdba). It installs sa_repmonchk table and an Oracle package to support UBS customized GG monitoring function.
sqlplus / @/home/dbtools/GoldenGate/setup/ggsrepmon_install_ora_9i.sql
j Prepare configuration file for ggsrepgen, which is a internal tool to generate GG scripts to set-up replication. The following information are needed to prepare cfg file:
Replication topology according to the application design. Primary database name and its $ORACLE_BASE. Destination database name(s) and $ORACLE_HOME. Local and remote queue file locations. List of tables that need to be replicated including oracle.sa_repmonchk. Copy from some other server and modify suitably.
11
DRAFT
Setting up Primary
j Sample ggsrepgen_<DBNAME>.cfg file:
schi6500nap(oracle):NPJ06MS:source$ cat ggsrepgen_NPJ06MS.cfg # this is a test config file for ggsrepgen #datapump = false oracentral=LNDBSP1 # default database id and password *.db_userid = ggsuser *.db_password =changeme90 NPJ06MS.ora_home = /sbclocal/app/oracle/product/9.2.0.6.0.1 NPJ06LX.ora_home = /sbclocal/app/oracle/product/9.2.0.6.0.1cpu # only one PDB can be defined pdb = NPJ06MS rdb = NPJ06LX # define ggs trailfile directory path (no '/' at the end of path) NPJ06MS.trailfile = /sbcdata/01/oradumps/ggs NPJ06LX.trailfile = /sbcdata/01/oradumps/ggs # database specific id and password (overrides the default) #OBJFILENAME= OBJECTS= ORACLE.SA_REPMONCHK MUTHUSSE.TEST1
12
DRAFT
Setting up Primary
j Generate GG scripts and parameter files using ggsrepgen. (sample output below):
schi6500nap(oracle):NPJ06MS:source$ ggsrepgen -f ggsrepgen_NPJ06MS.cfg ========================================================================== Please make sure the following prerequisites are met : 1. make sure all of instance involved are in the tnsnames.ora. 2. make sure the primary instance and the listener is running. 3. make sure all of the objects that need to be replicated are created. 4. make sure you have a database user login that can access ORACENTRAL database and ALL the involved databases. The login must has the same password across all of them and must has proper privileges to access system catalog and user schema. ========================================================================== Invalid key word: oracentral=LNDBSP1 ggsrepgen will now need to access ORACENTRAL and the primary instance NPJ06MS to verify the table list. you can use your own database login or a standard one. Please enter your login: muthusse Please enter your password: ==============================================================
13
DRAFT
Setting up Primary
Configuration Summary: Total tables listed in cfg file : 2 Total non-duplicate tables : 2 0 0 0 2 Total tables donot exist in PDB : Total IOT tables found in PDB : Total tables without primary key: Total tables meet prerequisites :
Checking primary database pre-requsite: NPJ06MS is in archive log mode. NPJ06MS secondary archive log: /sbclocal/app/oracle/admin/NPJ06MS/arch1 . NPJ06MS supplemental logging is on for Primary key. NPJ06MS force logging option is on. Please correct error above, or type 'YES' to ignore the error and continue:YES ggsrepgen will generate script for 2 tables including those with/without primary key. Retriving database name for instance NPJ06MS... ggsrepgen is getting GG process name from OraCentral (LNDBSP1) Getting GG EXTRACT process info for NPJ06MS.
14
DRAFT
Setting up Primary
Using existing GG EXTRACT for NPJ06MS: Key GG name PDB 1 E0079 NPJ06MS RDB Schema CR DBA CR date Desc --- -------- -------- -------- -------- -------- ---------------- -------------muthusse 2006-04-05 17:39 EXT_NPJ06MS Retriving database name for instance NPJ06LX... Getting GG replicate process info for NPJ06MS to NPJ06LX. ========================================================== GG replication setup for NPJ06MS at 2006-04-05 12:03:23 Primary instance is NPJ06MS at schi6500nap Primary database is NPJ06MS EXTRACT: E0079 (EXT_NPJ06MS) exttrail: /sbcdata/01/oradumps/ggs/E0079_NPJ06MS/ea DataPump: P0101 (PMP_NPJ06MS_NPJ06LX) to host: xldn0567dor rmttrail: /sbcdata/01/oradumps/ggs/P0101_NPJ06MS_NPJ06LX/ra REPLICAT: R0101 (REP_NPJ06MS_NPJ06LX) to database NPJ06LX Please verify the information and type 'YES' to continue:YES generating files ...
15
DRAFT
Setting up Primary
j ggsrepgen Creates the following directory structure under source directory. In this test case, it created NPJ06MS/schi6500nap for primary and NPJ06MS/xldn0567dor for destination and saved all the GG set-up scripts underneath.
16
DRAFT
Setting up Primary
j Check the scripts under source/<PRIMARYDB>/<primary machine> directory. j Create directory for trail files by running config_dir_<PRIMARYDB>.sh
mkdir -p /sbcdata/01/oradumps/ggs/E0079_NPJ06MS
j Turn supplemental log for the tables; Verify and then run add_trandata_<PRIMARYDB>.
cat add_trandata_NPJ06MS -- this is a ggsci script DBLOGIN USERID ggsuser@NPJ06MS, PASSWORD changeme90 add trandata MUTHUSSE.TEST1 ./ggsci < /sbclocal/app/oracle/ggs/source/NPJ06MS/schi6500nap/add_trandata_NPJ06MS > /sbclocal/app/oracle/ggs/source/NPJ06MS/schi6500nap/add_trandata_NPJ06MS.log
j Check the output of the trandata logfile. The GG trandata command runs similar to following SQL statement for each table.
ALTER TABLE MUTHUSSE".TEST1" ADD SUPPLEMENTAL LOG GROUP "GGS_TEST1" (A) ALWAYS
17
DRAFT
Setting up Primary
j Verify the supplemental logging for each tables by running info_trandata_<PRIMARYDB>
DBLOGIN USERID ggsuser@NPJ06MS, PASSWORD changeme90 info trandata MUTHUSSE.TEST1 info trandata ORACLE.SA_REPMONCHK ./ggsci < /sbclocal/app/oracle/ggs/source/NPJ06MS/schi6500nap/info_trandata_NPJ06MS GoldenGate Command Interpreter for Oracle Version 7.3.1.6 Build 005 Copyright GoldenGate Software, Inc. 1995-2005 GGSCI (schi6500nap) 1> GGSCI (schi6500nap) 2> Successfully logged into database. GGSCI (schi6500nap) 3> Logging of supplemental redo log data is enabled for table MUTHUSSE.TEST1 GGSCI (schi6500nap) 4> Logging of supplemental redo log data is enabled for table ORACLE.SA_REPMONCHK
18
DRAFT
Setting up Primary
j Add trace table, extract process and extract and remote trails from setup_primary_<PRIMARYDB>
cat setup_primary_NPJ06MS -- this is a ggsci script DBLOGIN USERID ggsuser@NPJ06MS, PASSWORD changeme90 ADD TRACETABLE -- EXTRACT process add extract E0079, tranlog, threads 1, begin now, description EXT_NPJ06MS add exttrail /sbcdata/01/oradumps/ggs/E0079_NPJ06MS/ea, extract E0079, megabytes 200 -- datapump process add extract P0101, exttrailsource /sbcdata/01/oradumps/ggs/E0079_NPJ06MS/ea, description PMP_NPJ06MS_NPJ06LX add rmttrail /sbcdata/01/oradumps/ggs/P0101_NPJ06MS_NPJ06LX/ra, extract P0101, megabytes 200
./ggsci < /sbclocal/app/oracle/ggs/source/NPJ06MS/schi6500nap/setup_primary_NPJ06MS
19
DRAFT
Setting up Primary
j Copy or merge the parameter file for Manager in dirprm directory. If it is new GG set-up, copy the parameter file; otherwise merge/append to the existing configuration. The manager is common for all the DBs and uses only one parameter file.
schi6500nap(oracle):NPJ06MS:schi6500nap$ cat mgr_NPJ06MS.prm PORT 3501 AUTORESTART EXTRACT *, RETRIES 2, WAITMINUTES 2 AUTORESTART REPLICAT *, RETRIES 2, WAITMINUTES 2 PURGEOLDEXTRACTS /sbcdata/01/oradumps/ggs/E0079_NPJ06MS/*, USECHECKPOINTS, MINKEEPDAYS 5, FREQUENCYHOURS 6 cp /sbclocal/app/oracle/ggs/source/NPJ06MS/schi6500nap/mgr_NPJ06MS.prm /sbclocal/app/oracle/ggs/dirprm/mgr.prm
j Copy the parameter files for extract and pump process to dirprm directory.
cp /sbclocal/app/oracle/ggs/source/NPJ06MS/schi6500nap/E0079.prm /sbclocal/app/oracle/ggs/dirprm/ cp /sbclocal/app/oracle/ggs/source/NPJ06MS/schi6500nap/P0101.prm /sbclocal/app/oracle/ggs/dirprm/
20
DRAFT
Setting up Primary
Any Questions?
21
SECTION 3
Setting up Destination
DRAFT
j Install Goldengate software in destination machine. Make sure to tar the correct version of GG to match OS. The software is in tar format as ggs_<ostype>_<ggversion>.tar.Z
cd $ORACLE_BASE mkdir ggs cd ggs
zcat /home/dbtools/GoldenGate/ggs_rhat3_v7316.tar.Z | tar xvf -
j Copy the password file or add the password to the existing file. (if it is a new server, get a password from Nitin, Mark Gokman, Martin Cyriac, Jacob, or Alan).
cp /home/dbtools/GoldenGate/PasswordFile/pw .
j Install support tools, if necessary. (importhufs should automatically copy ggsrepgen, ggsrolo and ggsrepmon to bin directory).
cp ggsrepgen ggsrolo ggsrepmon /sbclocal/app/oracle/local/bin
23
DRAFT
j Edit init or spfile file to increase open_cursors parameter, if the replication will be heavily used. j Create ggsuser (if required) and the password should be consistent with the password in ggsrepgen config file. This script creates replicatican_role and grant necessary system privileges.
sqlplus / @/home/dbtools/GoldenGate/setup/create_ggsuser.sql
j Install monitoring utility by connecting Oracle (not as sysdba). It installs sa_repmonchk table and an Oracle package to support UBS customized GG monitoring function.
sqlplus / @/home/dbtools/GoldenGate/setup/ggsrepmon_install_ora_9i.sql
j Copy the parameter files and GG scripts from the primary server and saved under source directory.
cd /sbclocal/app/oracle/ggs/source/ scp -r muthusse@schi6500nap.chi:/sbclocal/app/oracle/ggs/source/NPJ06MS .
24
DRAFT
j Create directory for remote trail files. (config_dir_NPJ06MS.sh)
mkdir -p /sbcdata/01/oradumps/ggs/P0101_NPJ06MS_NPJ06LX
j Add replicate process and trace table. (setup_replicat_TARGETDB)

cat /sbclocal/app/oracle/ggs/source/NPJ06MS/xldn0567dor/setup_replicat_NPJ06LX -- this is a ggsci script DBLOGIN USERID ggsuser@NPJ06LX, PASSWORD changeme90 ADD TRACETABLE -- REPLICAT process add replicat R0101, exttrail /sbcdata/01/oradumps/ggs/P0101_NPJ06MS_NPJ06LX/ra, description REP_NPJ06MS_NPJ06LX cd /sbclocal/app/oracle/ggs ./ggsci < /sbclocal/app/oracle/ggs/source/NPJ06MS/xldn0567dor/setup_replicat_NPJ06LX
25
DRAFT
j Copy or merge the parameter file for Manager in dirprm directory. If it is new GG set-up, copy the parameter file; otherwise append/merge to the existing configuration. The manager is common for all the DBs and uses only one parameter file.
schi6500nap(oracle):NPJ06MS:schi6500nap$ cat mgr_NPJ06MS.prm PORT 3501 AUTORESTART EXTRACT *, RETRIES 2, WAITMINUTES 2 AUTORESTART REPLICAT *, RETRIES 2, WAITMINUTES 2 PURGEOLDEXTRACTS /sbcdata/01/oradumps/ggs/P0101_NPJ06MS_NPJ06LX/*, USECHECKPOINTS, MINKEEPDAYS 5, FREQUENCYHOURS 6 cp /sbclocal/app/oracle/ggs/source/NPJ06MS/xldn0567dor/mgr_NPJ06MS.prm /sbclocal/app/oracle/ggs/dirprm/mgr.prm
j Copy the parameter files for extract and pump process to dirprm directory.
cp /sbclocal/app/oracle/ggs/source/NPJ06MS/xldn0567dor/R0101.prm /sbclocal/app/oracle/ggs/dirprm/
26
DRAFT
Any Questions
27
SECTION 4
Starting Replication
DRAFT
Start Goldengate
j Logon to destination machine as oracle. j Start GG manager and Replication process.
xldn0567dor(oracle):NPJ06LX:ggs$ cd /sbclocal/app/oracle/ggs xldn0567dor(oracle):NPJ06LX:ggs$ ./ggsci GGSCI (xldn0567dor) 1> start mgr Manager started. GGSCI (xldn0567dor) 2> start * Sending START request to MANAGER... REPLICAT R0101 starting GGSCI (xldn0567dor) 3> info * REPLICAT R0101 Description Checkpoint Lag Last Started 2006-04-05 22:17 Status RUNNING 00:00:00 (updated 00:00:03 ago) REP_NPJ06MS_NPJ06LX
Log Read Checkpoint File /sbcdata/01/oradumps/ggs/P0101_NPJ06MS_NPJ06LX/ra000000 First Record RBA 0

29
DRAFT
Start Goldengate
j Logon to Primary machine as oracle. j Start GG manager and Replication process.
schi6500nap(oracle):NPJ06MS:ggs$ ./ggsci GGSCI (schi6500nap) 1> start mgr Manager started. GGSCI (schi6500nap) 2> start * Sending START request to MANAGER... EXTRACT E0079 starting Sending START request to MANAGER... EXTRACT P0101 starting GGSCI (schi6500nap) 3> info * EXTRACT Description Checkpoint Lag E0079 Last Started 2006-04-05 16:24 Status RUNNING 00:01:14 (updated 00:00:02 ago) EXT_NPJ06MS
Log Read Checkpoint File /sbclocal/app/oracle/admin/NPJ06MS/data/NPJ06MS_redo1_3a.log 2006-04-05 16:23:03 Thread 1, Seqno 12, RBA 1410048 EXTRACT Description Checkpoint Lag P0101 Last Started 2006-04-05 16:24 Status RUNNING 00:00:00 (updated 00:00:38 ago) PMP_NPJ06MS_NPJ06LX
Log Read Checkpoint File /sbcdata/01/oradumps/ggs/E0079_NPJ06MS/ea000000 First Record RBA 0

30
DRAFT
Testing replication
j Logon to Primary DB and connect as / in sqlplus j Insert data into sa_repmonchk table in primary DB:
sqlplus / SQL> exec sa_repchk(1,'Test Data'); PL/SQL procedure successfully completed.
j Verify data in sa_repmonchk table in Destination DB:

sqlplus / SQL> set serveroutput on size 100000 SQL> exec sa_repchk; ID Source DB.Schema 1 NPJ06MS.ORACLE Info Test Data Init Time at source Latency T ---- ------------------- ---------------- ------------------- ------------ 2006-04-05 16:28:08 +00 00:00:21 T PL/SQL procedure successfully completed.
31
DRAFT
Testing replication
Any Questions?
32

GoldenGate - Replication

Uploaded by

Document Information

Original Description:

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

GoldenGate - Replication

Uploaded by

Copyright:

Available Formats

STRICTLY CONFIDENTIAL

Installation Setting up Primary Setting up Destination Starting Replication

Dat a Pump REPLICAT

Pxxxx (P0008) Rxxxx (R0012)

j If the password is incorrect, GG generates the following error:

j Edit init or spfile file to add arch1 location.

./ggsci < /sbclocal/app/oracle/ggs/source/NPJ06MS/schi6500nap/setup_primary_NPJ06MS

zcat /home/dbtools/GoldenGate/ggs_rhat3_v7316.tar.Z | tar xvf -

j Add replicate process and trace table. (setup_replicat_TARGETDB)

Log Read Checkpoint File /sbcdata/01/oradumps/ggs/P0101_NPJ06MS_NPJ06LX/ra000000 First Record RBA 0

Log Read Checkpoint File /sbcdata/01/oradumps/ggs/E0079_NPJ06MS/ea000000 First Record RBA 0

j Verify data in sa_repmonchk table in Destination DB:

You might also like