RAC 11g Installation steps

                                                        
                                     Oracle RAC 11g Installation

Oracle RAC 11g incorporates a two-phase installation process: 
       Phase one installs Oracle Cluster-ware.
       Phase two installs the Oracle Database 11g software with RAC.
                        .    Total time expend: - 10 Hours
************************************************************************************
  1. Complete pre-installation tasks:                                   4 Hours.
      Hardware requirements
      Software requirements
      Environment configuration, kernel
parameters, and so on
    1. Perform Oracle Cluster-ware installation.                        1 Hour.
    2. Perform ASM installation.                                                    1 Hour.
    3. Perform Oracle Database 11g software installation.       1 Hour.

    4. Install EM agent on cluster nodes if using Grid Control.    1 Hour.
    5. Perform cluster database creation.                                         1 Hour.
    6. Complete post installation tasks.                                             1 Hour.






Each node must meet the following minimum hardware requirements:
·         At least 1 GB of Physical RAM
·         Swap space equivalent to the multiple of the available RAM
Available RAM
Swap Space Required
Between 1 GB and 2 GB
1.5 times the size of RAM
More than 2 GB
Equal to the size of RAM

·         400 MB of disk space in the /tmp directory
·         Up to 4 GB of disk space for the Oracle Software

Software Requirement:-
                             Download software from www.oracle.com
#. Oracle Database 11g Release.
#. All require RPM as per below list.
#. OS Linux4.0

Network Requirements:-
       Each node must have at least two network adapters.
       Each public network adapter must support TCP/IP.
       The interconnect adapter must support User Datagram Protocol (UDP).
       The host name and IP address associated with the public interface must be registered in the domain name service (DNS) or the /etc/hosts file.


---------------------------------------------------------------------------------------------------------------------------------



Pre-installation Tasks:-
                Check system requirements.
                Check software requirements.
                Check kernel parameters.
                Create groups and users.
                Perform cluster setup.
Hardware Requirements:-
·             At least 1 GB of physical memory is needed.
               # grep MemTotal /proc/meminfo
                   MemTotal:       1126400 kB
       A minimum of 1 GB of swap space is required.
                       # grep SwapTotal /proc/meminfo
                       SwapTotal:     1566328 kB
       The /tmp directory should be at least 400 MB.
                                    # df -k /tmp
                                Filesystem   1K-blocks     Used Available Use%
                                 /dev/sda6      6198556  3137920   2745756  54%
       The Oracle Database 11g software requires up to 4 GB of disk space.
IP Requirements:-
Before starting the installation, you must have the following IP addresses available for each node:
  • An IP address with an associated network name registered in the domain name service (DNS) for the public interface. If you do not have an available DNS, then record the network name and IP address in the system hosts file, /etc/hosts.
  • One virtual IP (VIP) address with an associated network name registered in DNS. If you do not have an available DNS, then record the network name and VIP address in the system hosts file, /etc/hosts. Select an address for your VIP that meets the following requirements:
    • The IP address and network name are currently unused
    • The VIP is on the same subnet as your public interface
·         A private IP address with a host name for each private interface
Node
Interface Name
Type
IP Address (example)
Registered In
rac1
rac1
Public
XX.XX.43.20
DNS (if available, else the hosts file)
rac1
rac1-vip
Virtual
XX.XX.33.14
DNS (if available, else the hosts file)
rac1
rac1-priv
Private
10.140.10.1
Hosts file
rac2
rac2
Public
XX.XX.33.21
DNS (if available, else the hosts file)
rac2
rac2-vip
Virtual
XX.XX.33.15
DNS (if available, else the hosts file)
rac2
rac2-priv
Private
10.140.10.2
Hosts file


Package Requirements:-
       Package versions are checked by the cluvfy utility.
       For example, required packages and versions for Red Hat 4.0 and Oracle Enterprise Linux 4 include:
      glibc-2.3.4-2.25
      glibc-common-2.3.4.2-25
      glibc-devel-2.3.4.2-25
      gcc-3.4.6-3
      gcc-c++-3.4.6-3
      libaio-0.3.105-2
      libaio-devel-0.3.105-2
      libstdc++-3.4.6-3.1
      make-3.80-6
      sysstat-5.0.5-11
Required UNIX Groups and Users:-
       Create an oracle user, a dba, and an oinstall group on each node:
                      # groupadd -g 500 oinstall
                       # groupadd -g 501 dba
                       # useradd -u 500 -d /home/oracle -g "oinstall" \  –G "dba" -m  -s /bin/bash oracle
       Verify the existence of the nobody nonprivileged user:
                         # grep nobody /etc/passwd
                         Nobody:x:99:99:Nobody:/:/sbin/nobody

.    Oracle User Environment:-
Set umask to 022.
Set the DISPLAY environment variable.
Set the ORACLE_BASE environment variable.
Set the TMP and TMPDIR variables, if needed.
$ cd
$ vi .bash_profile
umask 022
ORACLE_BASE=/u01/app/oracle; export ORACLE_BASE
TMP=/u01/mytmp; export TMP
TMPDIR=$TMP; export TMPDIR
. User Shell Limits:-
Add the following lines to the /etc/security/limits.conf file:
                              soft           nproc   2047
                                hard       nproc    16384
                                soft        nofile    1024
                                hard       nofile    65536
Add the following line to the /etc/pam.d/login file:
                              session                  required              /lib/security/pam_limits.so

Configuring for Remote Installation:-
To configure Secure Shell:
1.      Create the public and private keys on all nodes:
                           [vx0044]$ /usr/bin/ssh-keygen -t dsa
                           [vx0045]$ /usr/bin/ssh-keygen -t dsa
2.      Concatenate id_dsa.pub from all nodes into the authorized_keys file on the first node:
                                      [vx0044]$ ssh vx0044 "cat ~/.ssh/id_dsa.pub" >> \ ~/.ssh/authorized_keys
                                      [vx0044]$ ssh vx0045 "cat ~/.ssh/id_dsa.pub" >> \ ~/.ssh/authorized_keys
3.      Copy the authorized_keys file to the other nodes:
                        [vx0044]$ scp ~/.ssh/authorized_keys vx0045:/home/oracle/.ssh/
Linux Operating System Parameters:-
$ vi /etc/sysctl.conf
Add or amend the following lines to the "/etc/sysctl.conf" file.

fs.aio-max-nr = 1048576
fs.file-max = 6815744
kernel.shmall = 2097152
kernel.shmmax = 1054504960
kernel.shmmni = 4096
# semaphores: semmsl, semmns, semopm, semmni
kernel.sem = 250 32000 100 128
net.ipv4.ip_local_port_range = 9000 65500
net.core.rmem_default=262144
net.core.rmem_max=4194304
net.core.wmem_default=262144
net.core.wmem_max=1048586

Run the following command to change the current kernel parameters.

#/sbin/sysctl -p




Required Directories for the Oracle Database Software:-
You must identify five directories for the Oracle database software:
      Oracle base directory
      Oracle inventory directory
      Oracle Cluster-ware home directory
      Oracle home directory for the database
      Oracle home directory for ASM
Cluster Setup:-
Download software
Oracle 11g Release 2 (11.2) Software.
Verifying Cluster Setup with cluvfy:-
      Install the cvuqdisk rpm required for cluvfy:
              # su root
                    # cd /stage/db/rpm
                    # export CVUQDISK_GRP=dba
                    # rpm -iv cvuqdisk-1.0.1-1.rpm
      Run the cluvfy utility as oracle as shown below:
                   # cd /stage/db
                    #  ./runcluvfy.sh stage -post hwos -n all -verbose


Installing Oracle Cluster-ware:-
$ export ORACLE_BASE=/u01/app/oracle
 $ ./stage/db/runInstaller


Specifying the Inventory Directory


Specify Home Details
Product-Specific Prerequisite Checks






Cluster Configuration

Private Interconnect Enforcement
Oracle Cluster Registry File



Voting Disk File
Summary and Install




Run Configuration Scripts on All Nodes
End of Installation

Verifying the Oracle Cluster-ware Installation:-
       Check for Oracle Cluster-ware processes with the ps command.
       Check the Oracle Cluster-ware startup entries in the /etc/inittab file.

# cat /etc/inittab
# Run xdm in runlevel 5
x:5:respawn:/etc/X11/prefdm -nodaemon
h1:35:respawn:/etc/init.d/init.evmd run >/dev/null 2>&1 </dev/null
h2:35:respawn:/etc/init.d/init.cssd fatal >/dev/null 2>&1 </dev/null
h3:35:respawn:/etc/init.d/init.crsd run >/dev/null 2>&1 </dev/null
Installing Automatic Storage Management:-
$ id
 oracle
 $ /stage/db/runInstaller





Installation Type

Install Location
Hardware Cluster Installation Mode
Product-Specific Prerequisite Checks
Select Configuration Option
Privileged Operating System Groups

Execute Configuration Scripts
                      
                                 ASM Configuration
$ export ORACLE_HOME=/u01/app/oracle/product/11.1.0/asm_1
$ export PATH=$PATH:ORACLE_HOME/bin
$ dbca
Click on Next
Click on Next

Click on Next





Creating ASM Disk Groups
Click on Ok.
Click on Finish………..





Select a Product to Install:-
$ /stage/db/runInstaller

Click on Next
Select Installation Type
Click on Next


Install Location
Click on next
Specify Cluster Installation
Click on next
Products Prerequisite Check
Click on Next
Select Configuration Option
Click on Next
Privileged Operating System Groups
Click on next
Check Summary
Click on Install
Required Tasks Prior to Database Creation
Set the environment variables for the Oracle database:
$ cd
$ vi .bash_profile
export ORACLE_BASE=/u01/app/oracle
export ORACLE_SID=RDB1
export ORACLE_HOME=/u01/app/oracle/product/11.1.0/db_1;
export PATH=$PATH:$ORACLE_HOME/bin
Checks before Database Creation:-
      Use cluvfy to perform a configuration check before database creation.
      Use the –pre option with the dbcfg argument when executing runcluvfy.
      As oracle, run the command as shown below:
$ cd /stage/db
$ ./runcluvfy.sh stage -pre dbcfg -n vx0306,vx0313 -d /u01/app/oracle/product/11.1.0
      Set the Oracle database–related environment variables for the oracle user.

RAC Database Creation:-
$ cd /stage/EM
$ ./runInstaller
Management Agent Installation:
Specify Installation Type
Click on next
Specify Installation Location
Click on next
Specify Cluster Installation Mode
Click on next
Prerequisite Check and OMS Location
Management Agent Installation Finish
Executing the root.sh Script
Creating the Cluster Database:-
$ cd /u01/app/oracle/product/11.1.0/db_1/bin
$ ./dbca
Click on next
Node Selection
Select Database Type

Database Identification
Cluster Database Management Method
Passwords for Database Schema Owners
.
Storage Options for Database Files
ASM Disk Groups
Database File Locations
Recovery Configuration
Database Content
Initialization Parameters
Security Settings and Maintenance Tasks
Database Storage Options
Create the Database
Monitor Progress

Post installation Tasks:-
      Verify the cluster database configuration.
$ srvctl config database -d racdb
vx0306 racdb1 /u01/app/.../db_1
vx0313 racdb2 /u01/app/.../db_1
      Back up the root.sh script.
$ cd $ORACLE_HOME
$ cp root.sh root.sh.bak
      Back up the voting disk.
$ dd if=/dev/sdb6 of=/RACdb/OCR/backup/vdisk.bak
Download and install the required patch updates...
Check Managed Targets:-
http://vx0314.us.oracle.com:4889/em












ORA-00059: Maximum Number Of DB_FILES Exceeded in 19C database

When I am adding datafile to my 19C database facing the below error. SQL> alter tablespace DATA  add datafile '/u01/data/data15.dbf&#...