rac10g添加节点详解

和通数据库htsjk.Com2019-03-14 15:52 来源:未知阅读:504 评论 324 热度5

标签：节点

rac10g添加节点详解

目标：

当前我环境中是有两个节点RAC1和RAC2 节点，现在增加一个RAC3节点。

概要：为现有的Oracle10g RAC 添加节点大致包括以下步骤:

1. 配置新的服务器节点上的硬件及操作系统环境

2. 向 Cluster 集群中加入该节点

3. 在新节点上安装 Oracle Database software

4. 为新的节点配置监听器 LISTENER

5. 通过 DBCA 为新的节点添加实例

注意：在新的服务器节点上配置操作系统环境

1. 这包括配置该节点今后使用的 public network 公用网络和 private network 接口，不要忘记在 hosts 文件中加入之前节点的网络信息，并将该份完整的hosts 文件传到集群Cluster 中已有的节点上，保证处处可以访问。

2. 同时需要在原有的基础上配置 oracle(或其他DBA)用户的身份等价性，这需要将新节点上生成的 id_rsa.pub 和id_dsa.pub 文件中的信息追加到authorized_keys 文件中，并保证在所有节点上均有这样一份相同的authorized_keys 文件。

3. 调整新节点上的操作系统内核参数，保证其满足今后在该节点上运行实例的内存要求以及 10g RAC Cluster 的推荐的udp网络参数。

4. 调整新节点上的系统时间以保持同其他节点一致，或者配置NTP 服务。

5. 保证原有 Cluster 中所有节点上的CRS 都正常运行，否则addNode时会报错。

6. 配置 clusterware 和database 软件的安装目录，要求路径和原有节点上的一致。

一．准备工作

1. 查看当前RAC环境版本和状态

SYS@RACDB1>select * from v$version;

BANNER

----------------------------------------------------------------

Oracle Database 10g Enterprise Edition Release10.2.0.1.0 - Prod

PL/SQL Release 10.2.0.1.0 - Production

CORE 10.2.0.1.0 Production

TNS for Linux: Version 10.2.0.1.0 - Production

NLSRTL Version 10.2.0.1.0 – Production

[root@rac1 bin]# ./crs_stat -t

Name Type Target State Host

------------------------------------------------------------

ora....B1.inst application ONLINE ONLINE rac1

ora....B2.inst application ONLINE ONLINE rac2

ora.RACDB.db application ONLINE ONLINE rac1

ora....SM1.asm application ONLINE ONLINE rac1

ora....C1.lsnr application ONLINE ONLINE rac1

ora.rac1.gsd application ONLINE ONLINE rac1

ora.rac1.ons application ONLINE ONLINE rac1

ora.rac1.vip application ONLINE ONLINE rac1

ora....SM2.asm application ONLINE ONLINE rac2

ora....C2.lsnr application ONLINE ONLINE rac2

ora.rac2.gsd application ONLINE ONLINE rac2

ora.rac2.ons application ONLINE ONLINE rac2

ora.rac2.vip application ONLINE ONLINE rac2

2. 配置节点3

[root@rac3 ~]# hostname

rac3

[root@rac3 ~]# id oracle

uid=54321(oracle) gid=54321(oinstall)groups=54321(oinstall),54322(dba)

[root@rac3 ~]# ifconfig

eth0 Link encap:Ethernet HWaddr00:50:56:25:82:62

inet addr:192.168.90.10 Bcast:192.168.90.255 Mask:255.255.255.0

inet6 addr: fe80::250:56ff:fe25:8262/64 Scope:Link

UPBROADCAST RUNNING MULTICAST MTU:1500 Metric:1

RX packets:1 errors:0 dropped:0overruns:0 frame:0

TXpackets:12 errors:0 dropped:0 overruns:0 carrier:0

collisions:0 txqueuelen:1000

RXbytes:60 (60.0 b) TX bytes:720 (720.0 b)

Interrupt:67 Base address:0x2024

eth1 Link encap:Ethernet HWaddr00:50:56:2D:0F:8D

inet addr:192.168.90.11 Bcast:192.168.90.255 Mask:255.255.255.0

inet6 addr: fe80::250:56ff:fe2d:f8d/64 Scope:Link

UPBROADCAST RUNNING MULTICAST MTU:1500 Metric:1

RXpackets:20 errors:0 dropped:0 overruns:0 frame:0

TXpackets:14 errors:0 dropped:0 overruns:0 carrier:0

collisions:0 txqueuelen:1000

RXbytes:1200 (1.1 KiB) TX bytes:804 (804.0b)

Interrupt:67 Base address:0x20a4

lo Link encap:Local Loopback

inet addr:127.0.0.1 Mask:255.0.0.0

inet6 addr: ::1/128 Scope:Host

UPLOOPBACK RUNNING MTU:16436 Metric:1

RXpackets:723 errors:0 dropped:0 overruns:0 frame:0

TXpackets:723 errors:0 dropped:0 overruns:0 carrier:0

collisions:0 txqueuelen:0

RXbytes:1217460 (1.1 MiB) TX bytes:1217460(1.1 MiB)

3. 配置三个节点/etc/hosts映射

注意：三个节点都要配置！！！

[root@rac3 ~]# vi /etc/hosts

# Do not remove the following line, or variousprograms

# that require network functionality will fail.

127.0.0.1 localhost.localdomain localhost

::1 localhost6.localdomain6 localhost6

192.168.90.2 rac1

192.168.90.5 rac2

192.168.91.3 rac1-priv

192.168.91.6 rac2-priv

192.168.90.3 rac1-vip

192.168.90.4 rac2-vip

#=========add node rac3==========#

192.168.90.10 rac3

192.168.91.11 rac3-priv

192.168.90.7 rac3-vip

检查网络是否通畅：

[root@rac3 ~]# ping rac1

PING rac1 (192.168.90.2) 56(84) bytes of data.

64 bytes from rac1 (192.168.90.2): icmp_seq=1ttl=64 time=0.614 ms

64 bytes from rac1 (192.168.90.2): icmp_seq=2ttl=64 time=0.169 ms

--- rac1 ping statistics ---

2 packets transmitted, 2 received, 0% packet loss,time 1000ms

rtt min/avg/max/mdev = 0.169/0.391/0.614/0.223 ms

4. 配置OS级别内核参数

这里显示的都是要添加的参数，原来的都不要动！！！

[root@rac3 ~]# cat /etc/sysctl.conf

kernel.shmmni = 4096

kernel.sem = 250 32000 100 128

fs.file-max = 65536

net.ipv4.ip_local_port_range = 1024 65000

net.core.rmem_default = 1048576

net.core.rmem_max = 1048576

net.core.wmem_default = 262144

net.core.wmem_max = 262144

/sbin/sysctl –p 生效一下

[root@rac3 ~]# cat /etc/security/limits.conf

oracle soft nproc 2047

oracle hard nproc 16384

oracle soft nofile 1024

oracle hard nofile 65536

[root@rac3 ~]# cat /etc/pam.d/login

session required pam_selinux.so open

[root@rac3 ~]# cat /etc/profile

if [ $USER = oracle ]; then

if [ $SHELL = /bin/ksh ]; then

ulimit -p 16384

ulimit -n 65536

else

ulimit -u 16384 -n 65536

5. 检查所需要的rpm是否都在,没有的话具体安装

[root@rac3 ~]# rpm -q binutils compat-dbcontrol-center gcc gcc-c++ glibc glibc-common libstdc++ libstdc++-devel make

binutils-2.17.50.0.6-14.el5

compat-db-4.2.52-5.1

control-center-2.16.0-16.el5

gcc-4.1.2-50.el5

gcc-c++-4.1.2-50.el5

glibc-2.5-58

glibc-common-2.5-58

libstdc++-4.1.2-50.el5

libstdc++-devel-4.1.2-50.el5

make-3.81-3.el5

二．开始配置Openfiler存储

用节点3打开火狐配置：

配置略。。。就是加了一个rac3的MAPPING

2.1 在节点3上发现存储如果没有返回值重启一下Linux

[root@rac3 ~]# iscsiadm --mode discoverydb --typesendtargets --portal 192.168.90.8 --discover

192.168.90.8:3260,1 rac3

[root@rac3 ~]#

[root@rac3 ~]# iscsiadm --mode node --targetnamerac3 192.168.90.10:3260 --login

Logging in to [iface: default, target: rac3,portal: 192.168.90.8,3260]

2.2 配置开机启动规则

[root@rac3 ~]# cat /etc/udev/rules.d/60-raw.rules

# Enter raw device bindings here.

# An example would be:

# ACTION=="add", KERNEL=="sda", RUN+="/bin/raw/dev/raw/raw1 %N"

# to bind /dev/raw/raw1 to /dev/sda, or

# ACTION=="add", ENV{MAJOR}=="8",ENV{MINOR}=="1", RUN+="/bin/raw /dev/raw/raw2 %M %m"

# to bind /dev/raw/raw2 to the device with major 8,minor 1.

ACTION=="add",KERNEL=="/dev/sdb1", RUN+="/bin/raw /dev/raw/raw1 %N"

ACTION=="add", ENV{MAJOR}=="8",ENV{MINOR}=="17", RUN+="/bin/raw /dev/raw/raw1 %M %m"

ACTION=="add",KERNEL=="/dev/sdc1", RUN+="/bin/raw /dev/raw/raw2 %N"

ACTION=="add", ENV{MAJOR}=="8",ENV{MINOR}=="33", RUN+="/bin/raw /dev/raw/raw2 %M %m"

ACTION=="add",KERNEL=="/dev/sdd1", RUN+="/bin/raw /dev/raw/raw3 %N"

ACTION=="add", ENV{MAJOR}=="8",ENV{MINOR}=="49", RUN+="/bin/raw /dev/raw/raw3 %M %m"

ACTION=="add",KERNEL=="/dev/sde1", RUN+="/bin/raw /dev/raw/raw4 %N"

ACTION=="add", ENV{MAJOR}=="8",ENV{MINOR}=="65", RUN+="/bin/raw /dev/raw/raw4 %M %m"

ACTION=="add",KERNEL=="/dev/sdf1", RUN+="/bin/raw /dev/raw/raw5 %N"

ACTION=="add", ENV{MAJOR}=="8",ENV{MINOR}=="81", RUN+="/bin/raw /dev/raw/raw5 %M %m"

KERNEL=="raw[1-5]",OWNER="oracle", GROUP="oinstall", MODE="640"

使之生效

[root@rac3 ~]# start_udev

Starting udev: [ OK ]

三．创建相应目录，配置环境变量，配置互信

3.1 创建目录

[root@rac3 ~]# mkdir -p /u01/app/oracle

[root@rac3 ~]# chown oracle:oinstall -R /u01/

[root@rac3 ~]# ll /u01/

total 4

drwxr-xr-x 3 oracle oinstall 4096 Aug 26 12:28 app

3.2 配置环境变量

[oracle@rac3 ~]$ cat .bash_profile

# .bash_profile

# Get the aliases and functions

if [ -f ~/.bashrc ]; then

.~/.bashrc

# User specific environment and startup programs

PATH=$PATH:$HOME/bin

export PATH

export ORACLE_BASE=/u01/app/oracle

export ORACLE_HOME=$ORACLE_BASE/product/10.2.0/db_2

export CRS_HOME=$ORACLE_BASE/product/10.2.0/db_1

export PATH=$PATH:$CRS_HOME/bin:$ORACLE_HOME/bin

[oracle@rac3 ~]$ . .bash_profile

3.3 配置互信

[oracle@rac3 ~]$ ssh-keygen

Generating public/private rsa key pair.

Enter file in which to save the key(/home/oracle/.ssh/id_rsa):

Created directory '/home/oracle/.ssh'.

Enter passphrase (empty for no passphrase):

Enter same passphrase again:

Your identification has been saved in/home/oracle/.ssh/id_rsa.

Your public key has been saved in/home/oracle/.ssh/id_rsa.pub.

The key fingerprint is:

19:66:a4:57:de:5d:21:1c:4a:2b:f1:0b:31:79:ae:fcoracle@rac3

[oracle@rac3 ~]$ cd .ssh/

[oracle@rac3 .ssh]$ ls

id_rsa id_rsa.pub

[oracle@rac3 .ssh]$ scprac1:/home/oracle/.ssh/authorized_keys .

The authenticity of host 'rac1 (192.168.90.2)'can't be established.

RSA key fingerprint is94:54:4a:64:74:0f:d4:e8:7f:7a:ba:43:0d:0f:70:30.

Are you sure you want to continue connecting(yes/no)? yes

Warning: Permanently added 'rac1,192.168.90.2'(RSA) to the list of known hosts.

oracle@rac1's password:

authorized_keys 100% 786 0.8KB/s 00:00

[oracle@rac3 .ssh]$ cat id_rsa.pub >>authorized_keys

[oracle@rac3 .ssh]$ cat authorized_keys

ssh-rsaAAAAB3NzaC1yc2EAAAABIwAAAQEAzSn5D7BcQXTJbxwG9yW9no1nKB8n23ydm8f6g9ROrJ0iYVyK6Rg9iV1jS/NJHws/CInLWWYTqYuzZcTO+Hj2iAg8SzhaIBN9glXZvjbfzyS4Wi+FZUbH6TMDwiNXxKXEuWwUzH0c9yvvRuF/s2BoIve/rZ+go3lb4zsbCM3jLDFHDZmsJ89NLG80bljM8iHt6Y18Z3Il1OPFjgpojGg8jwQTXm2IWwxeRYdB6C9IxGJ2VUciOECqx5JtXEfC+vY0zl0zFtZnejVSiA9MZehS/QuCIcT0eC/+OsMVXAT93dsuVfZvuvfjsejmV0lnH9f001ZeBPl6pKqQWxUCVmcJKw==oracle@rac1

ssh-rsaAAAAB3NzaC1yc2EAAAABIwAAAQEAyApaZkkfr1WEXNJwLuukbmLFZEcXaYmZpCxZ78QwO3MKOyZbDaCpDY0muSqPa5UOuH///aXAXp8ki1JVhACVaq5/45yFKqYVxsOXHoxRRmUnCLnXbsnnK5qAew6pLzNNeNzMeqoCLz4rVM7r+aIDYs6j05H0oEXxAbe4E3pFroTdEl7ULM7kUWgWf4UlQKWNPVJ01YYhYnzbgXr2vpVpAYRMDuH6+PikF4cgl/WvpQBmO4WHkwqZ1m12bINSKfiX384UmhxzJWl4IYVlMYrqYqluVL14F/cUBFnV9avq6TxmraDG1eZwi1nCTZhLpMS1juXcRPGqY0mV3LkUSTwGwQ==oracle@rac2

ssh-rsaAAAAB3NzaC1yc2EAAAABIwAAAQEA0zDPoxlo7BJD2kCuKVhqA2vOML4IIWdKmP3ejqiqCxfgTkMUCoa0ml2AEOtB11FdEsRFJ7p3lxzLcYMgsY3fJCNb59KiyRA5FCqiqRBiVYiwnUYG3iVvFsz4brne6fv+mc4AMgvdw6UqrGVcgieY4754Hji/i6qbv4GkmHbGv2LMFgtBn3JXon4prJws8aepHt4hBp1F0nL99pC+xyHkXtqa7DGaFW3Qy7nIF05VdD+ibzgiFOYWqDShXYHKNLql++/LmR3/hC/W71CeED7NdPcu8X1Eg8OvypMfIu1jO6HpU1rhmwV7QG23XFJB2kxSxDbt4txeQLtCKbV8RwWPzw==oracle@rac3

[oracle@rac3 .ssh]$ scp authorized_keys rac1:/home/oracle/.ssh/

oracle@rac1's password:

authorized_keys 100% 1179 1.2KB/s 00:00

[oracle@rac3 .ssh]$ scp authorized_keysrac2:/home/oracle/.ssh/

The authenticity of host 'rac2 (192.168.90.5)'can't be established.

RSA key fingerprint is0b:7b:ff:55:fb:7b:80:a0:be:13:a0:25:0d:e8:47:2b.

Are you sure you want to continue connecting(yes/no)? yes

Warning: Permanently added 'rac2,192.168.90.5'(RSA) to the list of known hosts.

oracle@rac2's password:

authorized_keys 100%1179 1.2KB/s 00:00

3.4 验证互信

编写一个shell脚本

[oracle@rac2 ~]$ vi ssh.sh

ssh rac1 date

ssh rac1-priv date

ssh rac2 date

ssh rac2-priv date

ssh rac3 date

ssh rac3-priv date

节点1：

[oracle@rac3 ~]$ sh ssh.sh

Tue Aug 26 12:36:09 CST 2014

节点2

[oracle@rac3 ~]$ sh ssh.sh

Tue Aug 26 12:36:40 CST 2014

节点3

[oracle@rac3 ~]$ sh ssh.sh

Tue Aug 26 12:36:50 CST 2014

3.5 安装几个关于oracleasm的rpm包

使用Yum源安装 --由节点1搭建的ftp

[root@rac3 yum.repos.d]# cat oel.repo

[oel5]

name = Enterprise Linux 5.6 DVD

baseurl=ftp://192.168.90.2/pub/Server

gpgcheck=0

[root@rac3 yum.repos.d]# yum -y install oracleasm*

Loaded plugins: rhnplugin, security

This system is not registered with ULN.

ULN support will be disabled.

oel5 | 1.1 kB 00:00

Setting up Install Process

Resolving Dependencies

--> Running transaction check

---> Package oracleasm-2.6.18-238.el5.i6860:2.0.5-1.el5 set to be updated

---> Package oracleasm-2.6.18-238.el5PAE.i6860:2.0.5-1.el5 set to be updated

--> Processing Dependency: kernel-PAE =2.6.18-238.el5 for package: oracleasm-2.6.18-238.el5PAE

---> Package oracleasm-2.6.18-238.el5debug.i6860:2.0.5-1.el5 set to be updated

--> Processing Dependency: kernel-debug =2.6.18-238.el5 for package: oracleasm-2.6.18-238.el5debug

---> Package oracleasm-2.6.18-238.el5xen.i6860:2.0.5-1.el5 set to be updated

--> Processing Dependency: kernel-xen =2.6.18-238.el5 for package: oracleasm-2.6.18-238.el5xen

---> Package oracleasm-support.i3860:2.1.4-1.el5 set to be updated

--> Running transaction check

---> Package kernel-PAE.i686 0:2.6.18-238.el5set to be installed

---> Package kernel-debug.i686 0:2.6.18-238.el5set to be installed

---> Package kernel-xen.i686 0:2.6.18-238.el5set to be installed

--> Finished Dependency Resolution

Dependencies Resolved

================================================================================

Package Arch Version Repository

Size

================================================================================

Installing:

oracleasm-2.6.18-238.el5 i686 2.0.5-1.el5 oel5 22 k

oracleasm-2.6.18-238.el5PAE i686 2.0.5-1.el5 oel5 22 k

oracleasm-2.6.18-238.el5debug i686 2.0.5-1.el5 oel5 23 k

oracleasm-2.6.18-238.el5xen i686 2.0.5-1.el5 oel5 22 k

oracleasm-support i386 2.1.4-1.el5 oel5 83 k

Installing for dependencies:

kernel-PAE i686 2.6.18-238.el5 oel5 17 M

kernel-debug i686 2.6.18-238.el5 oel5 18 M

kernel-xen i686 2.6.18-238.el5 oel5 18 M

Transaction Summary

================================================================================

Install 8 Package(s)

Upgrade 0 Package(s)

Total download size: 53 M

Downloading Packages:

(1/8):oracleasm-2.6.18-238.el5-2.0.5-1.el5.i686.rpm | 22 kB 00:00

(2/8):oracleasm-2.6.18-238.el5PAE-2.0.5-1.el5.i686.rpm | 22kB 00:00

(3/8):oracleasm-2.6.18-238.el5xen-2.0.5-1.el5.i686.rpm | 22kB 00:00

(4/8):oracleasm-2.6.18-238.el5debug-2.0.5-1.el5.i686.rp | 23 kB 00:00

(5/8): oracleasm-support-2.1.4-1.el5.i386.rpm | 83 kB 00:00

(6/8): kernel-PAE-2.6.18-238.el5.i686.rpm | 17 MB 00:01

(7/8): kernel-debug-2.6.18-238.el5.i686.rpm | 18 MB 00:01

(8/8): kernel-xen-2.6.18-238.el5.i686.rpm | 18 MB 00:01

--------------------------------------------------------------------------------

Total 15MB/s | 53 MB 00:03

Running rpm_check_debug

Running Transaction Test

Finished Transaction Test

Transaction Test Succeeded

Running Transaction

Installing :oracleasm-support 1/8

Installing : kernel-PAE 2/8

Installing : kernel-xen 3/8

Installing : kernel-debug 4/8

Installing :oracleasm-2.6.18-238.el5PAE 5/8

Installing : oracleasm-2.6.18-238.el5xen 6/8

Installing :oracleasm-2.6.18-238.el5debug 7/8

Installing :oracleasm-2.6.18-238.el5 8/8

Installed:

oracleasm-2.6.18-238.el5.i686 0:2.0.5-1.el5

oracleasm-2.6.18-238.el5PAE.i686 0:2.0.5-1.el5

oracleasm-2.6.18-238.el5debug.i686 0:2.0.5-1.el5

oracleasm-2.6.18-238.el5xen.i686 0:2.0.5-1.el5

oracleasm-support.i386 0:2.1.4-1.el5

Dependency Installed:

kernel-PAE.i686 0:2.6.18-238.el5 kernel-debug.i686 0:2.6.18-238.el5

kernel-xen.i686 0:2.6.18-238.el5

Complete!

四．开始增加节点（$ORA_CRS_HOME/oui/bin）

4.1 再次查看原集群状态

[root@rac1 bin]# ./crs_stat -t

Name Type Target State Host

------------------------------------------------------------

ora....B1.inst application ONLINE ONLINE rac1

ora....B2.inst application ONLINE ONLINE rac2

ora.RACDB.db application ONLINE ONLINE rac1

ora....SM1.asm application ONLINE ONLINE rac1

ora....C1.lsnr application ONLINE ONLINE rac1

ora.rac1.gsd application ONLINE ONLINE rac1

ora.rac1.ons application ONLINE ONLINE rac1

ora.rac1.vip application ONLINE ONLINE rac1

ora....SM2.asm application ONLINE ONLINE rac2

ora....C2.lsnr application ONLINE ONLINE rac2

ora.rac2.gsd application ONLINE ONLINE rac2

ora.rac2.ons application ONLINE ONLINE rac2

ora.rac2.vip application ONLINE ONLINE rac2

4.2 开始配置

[root@rac1 bin]# xhost +

access control disabled, clients can connect fromany host

[root@rac1 bin]# su - oracle

[oracle@rac1 ~]$ cd/u01/app/oracle/product/10.2.0/db_1/oui/bin/

[oracle@rac1 bin]$ ./addNode.sh

欢迎界面welcome

加入增加节点的信息

Summary信息

开始配置

按顺序与对应节点执行！！！！

不要用ssh，到对应节点上执行！！！

节点1：

[root@rac1 ~]#/u01/app/oracle/product/10.2.0/db_1/install/rootaddnode.sh

clscfg: EXISTING configuration version 3 detected.

clscfg: version 3 is 10G Release 2.

Attempting to add 1 new nodes to the configuration

Using ports: CSS=49895 CRS=49896 EVMC=49898 andEVMR=49897.

node <nodenumber>: <nodename><private interconnect name> <hostname>

node 3: rac3 rac3-priv rac3

Creating OCR keys for user 'root', privgrp 'root'..

Operation successful.

/u01/app/oracle/product/10.2.0/db_1/bin/srvctl addnodeapps -n rac3 -A rac3-vip/255.255.255.0/eth0 -o/u01/app/oracle/product/10.2.0/db_1

节点3：

[root@rac3 ~]#/u01/app/oracle/product/10.2.0/db_1/root.sh

WARNING: directory '/u01/app/oracle/product/10.2.0'is not owned by root

WARNING: directory '/u01/app/oracle/product' is notowned by root

WARNING: directory '/u01/app/oracle' is not ownedby root

WARNING: directory '/u01/app' is not owned by root

WARNING: directory '/u01' is not owned by root

Checking to see if Oracle CRS stack is alreadyconfigured

/etc/oracle does not exist. Creating it now.

OCR LOCATIONS = /dev/raw/raw1

OCR backup directory'/u01/app/oracle/product/10.2.0/db_1/cdata/crs' does not exist. Creating now

Setting the permissions on OCR backup directory

Setting up NS directories

Oracle Cluster Registry configuration upgradedsuccessfully

WARNING: directory '/u01/app/oracle/product/10.2.0'is not owned by root

WARNING: directory '/u01/app/oracle/product' is notowned by root

WARNING: directory '/u01/app/oracle' is not ownedby root

WARNING: directory '/u01/app' is not owned by root

WARNING: directory '/u01' is not owned by root

clscfg: EXISTING configuration version 3 detected.

clscfg: version 3 is 10G Release 2.

assigning default hostname rac1 for node 1.

assigning default hostname rac2 for node 2.

Successfully accumulated necessary OCR keys.

Using ports: CSS=49895 CRS=49896 EVMC=49898 andEVMR=49897.

node <nodenumber>: <nodename><private interconnect name> <hostname>

node 1: rac1 rac1-priv rac1

node 2: rac2 rac2-priv rac2

clscfg: Arguments check out successfully.

NO KEYS WERE WRITTEN. Supply -force parameter tooverride.

-force is destructive and will destroy any previouscluster

configuration.

Oracle Cluster Registry for cluster has alreadybeen initialized

Startup will be queued to init within 90 seconds.

Adding daemons to inittab

Expecting the CRS daemons to be up within 600seconds.

CSS is active on these nodes.

rac1

rac2

rac3

CSS is active on all nodes.

Waiting for the Oracle CRSD and EVMD to start

Oracle CRS stack installed and running underinit(1M)

Running vipca(silent) for configuring nodeapps

/u01/app/oracle/product/10.2.0/db_1/jdk/jre//bin/java:error while loading shared libraries: libpthread.so.0: cannot open sharedobject file: No such file or directory

在master节点的cssd.log中有详细信息

五．为新节点安装数据库软件：($ORACLE_HOME/oui/bin)

[oracle@rac1 ~]$ cd/u01/app/oracle/product/10.2.0/db_2/oui/bin/

[oracle@rac1 bin]$ ls

addLangs.sh addNode.sh lsnodes ouica.sh resource runConfig.sh runInstaller runInstaller.sh

[oracle@rac1 bin]$ ./addNode.sh

Starting Oracle Universal Installer...

No pre-requisite checks found in oraparam.ini, nosystem pre-requisite checks will be executed.

Oracle Universal Installer, Version 10.2.0.1.0Production

同样一个summary 开始安装

节点3：

[root@rac3 ~]#/u01/app/oracle/product/10.2.0/db_2/root.sh

Running Oracle10 root.sh script...

The following environment variables are set as:

ORACLE_OWNER= oracle

ORACLE_HOME= /u01/app/oracle/product/10.2.0/db_2

Enter the full pathname of the local bin directory:[/usr/local/bin]:

The file "dbhome" already exists in/usr/local/bin. Overwrite it? (y/n)

[n]:

The file "oraenv" already exists in/usr/local/bin. Overwrite it? (y/n)

[n]:

The file "coraenv" already exists in/usr/local/bin. Overwrite it? (y/n)

[n]:

Entries will be added to the /etc/oratab file asneeded by

Database Configuration Assistant when a database iscreated

Finished running generic part of root.sh script.

Now product-specific root actions will beperformed.

此时的nodeapps已经添加成功，现在添加Listener和instance

[root@rac1 bin]# ./crs_stat -t

Name Type Target State Host

------------------------------------------------------------

ora....B1.inst application ONLINE ONLINE rac1

ora....B2.inst application ONLINE ONLINE rac2

ora.RACDB.db application ONLINE ONLINE rac1

ora....SM1.asm application ONLINE ONLINE rac1

ora....C1.lsnr application ONLINE ONLINE rac1

ora.rac1.gsd application ONLINE ONLINE rac1

ora.rac1.ons application ONLINE ONLINE rac1

ora.rac1.vip application ONLINE ONLINE rac1

ora....SM2.asm application ONLINE ONLINE rac2

ora....C2.lsnr application ONLINE ONLINE rac2

ora.rac2.gsd application ONLINE ONLINE rac2

ora.rac2.ons application ONLINE ONLINE rac2

ora.rac2.vip application ONLINE ONLINE rac2

ora.rac3.gsd application ONLINE ONLINE rac3

ora.rac3.ons application ONLINE ONLINE rac3

ora.rac3.vip application ONLINE ONLINE rac3

配置监听 -- 遇到问题将新节点重启就好。
[oracle@rac3 bin]$ lsnrctl start
节点2：
[oracle@rac2 bin]$ netca

Oracle Net Services Configuration:

选择 reconfigure