1、明確任務
成都創(chuàng)新互聯公司是一家集網站建設,曲水企業(yè)網站建設,曲水品牌網站建設,網站定制,曲水網站建設報價,網絡營銷,網絡優(yōu)化,曲水網站推廣為一體的創(chuàng)新建站企業(yè)，幫助傳統企業(yè)提升企業(yè)形象加強企業(yè)競爭力。可充分滿足這一群體相比中小企業(yè)更為豐富、高端、多元的互聯網需求。同時我們時刻保持專業(yè)、時尚、前沿，時刻以成就客戶成長自我，堅持不斷學習、思考、沉淀、凈化自己，讓我們?yōu)楦嗟钠髽I(yè)打造出實用型網站。
準備一臺RHEL5的PC機充當SAN設備，san（同時充當DNS和授時系統）
準備兩臺RHEL5的PC機充當RAC節(jié)點，r1和r2
將RAC安裝在ASM磁盤上，包括OCR、VOTING、庫
2、修改r1和r2的內核參數與shell限制
在r1和r2上分別進行
vim /etc/sysctl.conf
------------------------------------------
kernel.shmmax
= 4294967296
kernel.shmmni = 4096
kernel.shmall = 2097152
kernel.sem =
250 32000 100 128
fs.file-max = 6815744
fs.aio-max-nr =
1048576
net.ipv4.ip_local_port_range = 9000
65500
net.core.rmem_default = 262144
net.core.rmem_max =
4194304
net.core.wmem_default = 262144
net.core.wmem_max = 1048586
sysctl -p
vim
/etc/security/limits.conf
------------------------------------------
#Oracle configure shell parameters
oracle soft nofile
65536
oracle hard nofile 65536
oracle soft nproc 16384
oracle hard nproc
16384
grid soft nofile 65536
grid hard
nofile 65536
grid soft nproc 16384
grid hard nproc 16384
3、配置san、r1、r2的網絡
在san、r1、r2上分別配置
vim/etc/hosts
127.0.0.1san localhost.localdomain
localhost
::1localhost6.localdomain6 localhost6
192.168.33.100san
192.168.33.101 r1
192.168.33.102 r2
192.168.33.201 r1-vip#不要配置在網卡上
192.168.33.202 r2-vip#不要配置在網卡上
10.0.0.1 r1-priv
10.0.0.2 r2-priv
4、在san上配置DNS
yum install bind bind-chroot caching-nameserver
cd /var/named/chroot/etc
cp -p named.caching-nameserver.conf named.conf
vim
/var/named/chroot/etc/named.conf
options {
listen-on port 53 { any; };
listen-on-v6 port 53 { ::1;
};
directory "/var/named";
dump-file
"/var/named/data/cache_dump.db";
statistics-file
"/var/named/data/named_stats.txt";
memstatistics-file
"/var/named/data/named_mem_stats.txt";
allow-query { any; };
allow-query-cache { any; };
};
logging
{
channel default_debug {
file "data/named.run";
severity
dynamic;
};
};
view localhost_resolver {
match-clients { any;
};
match-destinations { any; };
recursion yes;
include
"/etc/named.zones";
};
cp -p named.rfc1912.zones named.zones
vim /var/named/chroot/etc/named.zones
// named.rfc1912.zones:
//
// Provided by Red Hat caching-nameserver
package
//
// ISC BIND named zone configuration for zones recommended
by
// RFC 1912 section 4.1 : localhost TLDs and address zones
//
// See
/usr/share/doc/bind*/sample/ for example named configuration
files.
//
zone "." IN {
type
hint;
file "named.ca";
};
zone "localdomain" IN {
type
master;
file
"localdomain.zone";
allow-update {
none; };
};
zone "localhost" IN {
type
master;
file
"localhost.zone";
allow-update {
none; };
};
zone "0.0.127.in-addr.arpa" IN
{
type
master;
file
"named.local";
allow-update {
none; };
};
zone "0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.ip6.arpa"
IN {
type
master;
file
"named.ip6.local";
allow-update {
none; };
};
zone "255.in-addr.arpa" IN {
type master;
file
"named.broadcast";
allow-update {
none; };
};
zone "0.in-addr.arpa" IN {
type
master;
file
"named.zero";
allow-update { none;
};
};
zone "ora11grac.com" IN {
type master;
file
"ora11grac.com.zone";
allow-update { none; };
};
zone "33.168.192.in-addr.arpa" IN {
type
master;
file "33.168.192.local";
allow-update { none; };
};
cd /var/named/chroot/var/named
cp -p named.zero ora11grac.com.zone
cp
-p named.local 33.168.192.local
vim /var/named/chroot/var/named/ora11grac.com.zone
$TTL 86400
@ IN SOA dns.ora11grac.com. root.ora11grac.com. (
42 ;
serial (d. adams)
3H ; refresh
15M ; retry
1W ; expiry
1D ) ;
minimum
@ IN NS dns.ora11grac.com.
r1 IN A 192.168.33.101
r2 IN A
192.168.33.102
r1-vip IN A 192.168.33.201
r2-vip IN A
192.168.33.202
scan IN A 192.168.33.195
scan IN A 192.168.33.196
scan
IN A 192.168.33.197
vim /var/named/chroot/var/named/33.168.192.local
$TTL 86400
@ IN SOA dns.ora11grac.com. root.ora11grac.com.
(
1997022700 ; Serial
28800 ; Refresh
14400 ; Retry
3600000 ;
Expire
86400 ) ; Minimum
@ IN NS dns.ora11grac.com.
101 IN PTR
r1.ora11grac.com.
102 IN PTR r2.ora11grac.com.
201 IN PTR
r1-vip.ora11grac.com.
202 IN PTR r2-vip.ora11grac.com.
195 IN PTR
scan.ora11grac.com.
196 IN PTR scan.ora11grac.com.
197 IN PTR
scan.ora11grac.com.
service named restart
chkconfig named on
完成后在客戶端測試
vim /etc/resolve.conf
search ora11grac.com
nameserver 192.168.33.100
然后ping scan.ora11grac.com，或者nslookup scan.ora11grac.com
5、添加用戶和組在r1、r2
在r1、r2分別
groupadd -g 501 oinstall
groupadd -g 502 dba
groupadd -g 503
oper
groupadd -g 504 asmadmin
groupadd -g 505 asmdba
groupadd -g 506
asmoper
useradd -u 501 -g oinstall -G dba,oper,asmdba oracle
useradd -u 502 -g oinstall -G dba,asmadmin,asmdba,asmoper grid
在r1、r2上修改配置文件
vim /home/grid/.bashrc
export ORACLE_BASE=/u01/app/oracle
export ORACLE_HOME=/u01/app/11.2.0/grid
export PATH=$ORACLE_HOME/bin:$PATH
export ORACLE_OWNER=oracle
export ORACLE_SID=+ASM1 #r2節(jié)點為 export ORACLE_SID=+ASM2
export ORACLE_TERM=vt100
export THREADS_FLAG=native
export
LD_LIBRARY_PATH=$ORACLE_HOME/lib:$LD_LIBRARY_PATH
export
PATH=$ORACLE_HOME/bin:$PATH
export LANG=en_US
alias
sqlplus='rlwrap sqlplus'
alias lsnrctl='rlwrap lsnrctl'
alias
asmcmd='rlwrap asmcmd'
vim /home/oracle/.bashrc
export ORACLE_BASE=/u01/app/oracle
export ORACLE_HOME=$ORACLE_BASE/product/11.2.0/db_1
export PATH=$ORACLE_HOME/bin:$PATH
export ORACLE_OWNER=oracle
export ORACLE_SID=orcl1 #rac2節(jié)點為 export ORACLE_SID=orcl2
export ORACLE_TERM=vt100
export THREADS_FLAG=native
export
LD_LIBRARY_PATH=$ORACLE_HOME/lib:$LD_LIBRARY_PATH
export
PATH=$ORACLE_HOME/bin:$PATH
export EDITOR=vi
export
SQLPATH=/home/oracle
export LANG=en_US
alias
sqlplus='rlwrap sqlplus'
alias lsnrctl='rlwrap lsnrctl'
alias rman='rlwrap
rman'
alias dgmgrl='rlwrap dgmgrl'
6、創(chuàng)建目錄在r1、r2
在r1、r2分別
mkdir -p /u01/app/11.2.0/grid
chown -R grid:oinstall /u01
mkdir
/u01/app/oracle
chown -R oracle:oinstall /u01/app/oracle
chmod -R
775 /u01/
7、配置grid、oracle用戶下的雙機互信（需要單步）
在r1上
su - grid
ssh-keygen -t rsa
ssh-keygen -t dsa
cd .ssh
cat *.pub > authorized_keys
在r2上
su - grid
ssh-keygen -t rsa
ssh-keygen -t dsa
cd .ssh
cat *.pub > authorized_keys
在r1上
scp authorized_keys grid@r2:/home/grid/.ssh/k1
在r2上
cat /home/grid/.ssh/k1 >> authorized_keys
scp authorized_keys grid@r1:/home/grid/.ssh/
在r1上
su - oracle
ssh-keygen -t rsa
ssh-keygen -t dsa
cd .ssh
cat *.pub > authorized_keys
在r2上
su - oracle
ssh-keygen -t rsa
ssh-keygen -t dsa
cd .ssh
cat *.pub > authorized_keys
在r1上
scp authorized_keys oracle@r2:/home/oracle/.ssh/k1
在r2上
cat /home/oracle/.ssh/k1 >> authorized_keys
scp authorized_keys oracle@r1:/home/oracle/.ssh/
分別在r1、r2上測試雙機信任
ssh r1 date
ssh r2 date
ssh r1-priv date
ssh r2-priv date
8、配置NTP服務器在san上（不在san上做在其它機器上做也可以）
在san上
vim /etc/sysconfig/ntpd
# Drop root to id 'ntp:ntp' by
default.
OPTIONS="-x -u ntp:ntp -p /var/run/ntpd.pid"
# Set to 'yes' to sync hw clock after successful
ntpdate
SYNC_HWCLOCK=no
# Additional options for ntpdate
vim /etc/ntp.conf
restrict default nomodify
restrict
127.0.0.1
server 127.127.1.0
fudge 127.127.1.0 stratum 8
driftfile
/var/lib/ntp/drift
broadcastdelay 0.008
啟動ntpd服務
service ntpd restart
chkconfig ntpd on
在客戶端r1、r2
ntpdate san
然后使用crontab -e
*/5 * * * * /usr/sbin/ntpdate san
建議拷貝配置文件到r1、r2，然后在r1、r2也啟動ntpd，因為grid安裝的時候會進行校驗
9、配置集中存儲san
在san上
yum install scsi-target-utils -y
vim /etc/tgt/targets.conf
backing-store /dev/sdb1
backing-store /dev/sdc1
backing-store /dev/sdd1
backing-store /dev/sde1
backing-store /dev/sdf1
backing-store /dev/sdf2
backing-store /dev/sdf3
service tgtd start
tgtadm --lld iscsi -m target --op show
chkconfig
tgtd on
在r1和r2上
yum install iscsi-initiator-utils -y
service iscsid start
iscsiadm -m
discovery -t st -p san
service iscsi start
chkconfig iscsid
on
chkconfig iscsi on
10、配置udev綁定裸設備在r1、r2上
在r1、r2上
ll /dev/sd*
brw-r----- 1 root disk 8,0 Jan4 19:31 /dev/sda
brw-r----- 1
root disk 8,1 Jan4 11:31 /dev/sda1
brw-r----- 1 root disk
8,2 Jan4 19:31 /dev/sda2
brw-r----- 1 root disk 8, 16 Jan4 13:31 /dev/sdb
brw-r----- 1 root disk 8, 17 Jan4 16:30
/dev/sdb1
brw-r----- 1 root disk 8, 32 Jan4 13:31
/dev/sdc
brw-r----- 1 root disk 8, 33 Jan4 16:30
/dev/sdc1
brw-r----- 1 root disk 8, 48 Jan4 13:32
/dev/sdd
brw-r----- 1 root disk 8, 49 Jan4 16:30
/dev/sdd1
brw-r----- 1 root disk 8, 64 Jan4 13:32
/dev/sde
brw-r----- 1 root disk 8, 65 Jan4 16:30
/dev/sde1
brw-r----- 1 root disk 8, 80 Jan4 13:32
/dev/sdf
brw-r----- 1 root disk 8, 81 Jan4 16:29
/dev/sdf1
brw-r----- 1 root disk 8, 96 Jan4 13:33
/dev/sdg
brw-r----- 1 root disk 8, 97 Jan4 16:29
/dev/sdg1
brw-r----- 1 root disk 8, 98 Jan4 16:29 /dev/sdg2
vim /etc/udev/rules.d/60-raw.rules
ACTION=="add", KERNEL=="sdf1", RUN+="/bin/raw /dev/raw/raw1
%N"
ACTION=="add", KERNEL=="sdg1", RUN+="/bin/raw /dev/raw/raw2
%N"
ACTION=="add", KERNEL=="sdg2", RUN+="/bin/raw /dev/raw/raw3
%N"
KERNEL=="raw1", OWNER="grid", GROUP="asmadmin",
MODE="660"
KERNEL=="raw2", OWNER="grid", GROUP="asmadmin",
MODE="660"
KERNEL=="raw3", OWNER="grid", GROUP="asmadmin", MODE="660"
11、安裝依賴包
yum install binutils compat-libstdc++ elfutils-libelf elfutils-libelf-devel gcc gcc-c++ glibc glibc-common glibc-devel glibc-headers ksh libaio libaio-devel libgcc libstdc++ libstdc++-devel make sysstat unixODBC unixODBC-devel -y
12、安裝ASM的RPM包（務必注意版本和平臺）
rpm -ivh oracleasm-2.6.18-164.el5-2.0.5-1.el5.x86_64.rpm oracleasm-support-2.1.7-1.el5.x86_64.rpm oracleasmlib-2.0.4-1.el5.x86_64.rpm
13、配置ASM
在r1上
/etc/init.d/oracleasm configure
用戶指定：grid
組指定：asmadmin
其余都是yes
建立oracleasm磁盤
/etc/init.d/oracleasm createdisk V1 /dev/sdb1
/etc/init.d/oracleasm createdisk V2 /dev/sdc1
/etc/init.d/oracleasm createdisk V3 /dev/sdd1
/etc/init.d/oracleasm createdisk V4 /dev/sde1
在r2上進行掃描
/etc/init.d/oracleasm scandisks
14、用grid用戶安裝grid校驗
./runcluvfy.sh stage -pre crsinst -n r1,r2 -fixup -verbose
15、安裝grid
在grid用戶下
./runInstaller
在Instalaation Type選擇
Install and Configure Grid Infrustructure for a Cluster
在Product Languages選擇
Advanced Installation
在Grid Plug and Play Information填寫
Cluster Name: r-cluster
SCAN Name: scan.ora11grac.com
SCAN Port: 1521
Configure GNS不勾選
在Cluster Node Information填寫
r1.ora11grac.comr1-vip.ora11grac.com
r2.ora11grac.comr2-vip.ora11grac.com
這個vip不要使用ifconfig去添加
在Specify Network Interface Usage對應填寫
eth0192.168.33.0Public
eth210.0.0.0Private
在Storage Option Information選擇
Automatic Storage Management(ASM)
在Create ASM Disk Group
選擇剛剛認出的raw1, raw2, raw3組成Disk Group Name為grid
在Specify ASM Password
填寫用戶口令
在Failure Isolation Support選擇
Do not use Intelligent Platform Management(IPMI)
在Privileged Operating System Groups填寫：
ASM Database Administrator (OSDBA) Group: asmdba
ASM Instance Administration Operator (OSOPER) Group: asmoper
ASM Instance Administrator (OSASM) Group：asmadmin
在Specify Installation Location中填寫：
Oracle Base: /u01/app/oracle
Software Location: /u01/app/oracle/product/11.2.0/grid
在Create Inventory中填寫：
Inventory Directory: /u01/app/oraInventory
oraInventory Group Name: oinstall
安裝完成后
在r1運行
/u01/app/oraInventory/orainstRoot.sh
在r2運行
/u01/app/oraInventory/orainstRoot.sh
在r1運行
/u01/app/11.2.0/grid/root.sh
在r2運行
/u01/app/11.2.0/grid/root.sh
16、安裝數據庫
先要確保所有的重要服務都是ONLINE的
crs_stat -t
一般oc4j會不在線，那就
srvctl enable oc4j
srvctl start oc4j
olsnodes -n
出現r1，r2
這樣就OK了
（gsd服務不在線不影響庫軟件的安裝和庫的建立）
用grid用戶，開啟asmca，創(chuàng)建一個ASM磁盤組+ASM
在r1切換到
su - oracle
./runInstaller
在Select Installation Option
選擇Install database software only，只安裝數據庫引擎軟件
在Node Selection
勾選r1，r2兩個節(jié)點
在Select Database Edition選擇
Enterprise Edition
在Specify Installation Location填寫
Oracle Base: /u01/app/Oracle
Software Location: /u01/app/oracle/product/11.2.0/dbhome_1
執(zhí)行完畢后運行，在r1、r2運行
/u01/app/oracle/product/11.2.0/db_1/root.sh
完成。
重慶分公司
重慶分公司
