Every DBA should have raccheck in their arsenal and should be a pre-requisite for every RAC deployment as one of the audit tools to confirm a proper configuration. RACcheck is a RAC Configuration Audit tool provided by oracle support and designed to audit core configuration settings within a Real Application Clusters (RAC), Automatic Storage Management (ASM) and Grid Infrastructure stack. RACcheck tool audits configuration for the following categories:

* OS kernel parameters
* OS packages
* Other OS configuration settings important to RAC.
* Grid Infrastructure
* RDBMS
* ASM
* Database parameters
* Other database configuration settings important to RAC
* Upgrade Readiness assessment

vnaqa1 > ./raccheck

CRS stack is running and CRS_HOME is not set. Do you want to set CRS_HOME to /u01/app/grid/11203?[y/n][y]

Checking ssh user equivalency settings on all nodes in cluster

Node dalvna2 is configured for ssh user equivalency for oracle user
 
Node dalvna3 is configured for ssh user equivalency for oracle user
 

Searching for running databases . . . . .

. . 
List of running databases registered in OCR
1. vnadbqa
2. vnatmpqa
3. All of above
4. None of above

Select databases from list for checking best practices. For multiple databases, select 3 for All or comma separated number like 1,2 etc [1-4][3].1

Searching out ORACLE_HOME for selected databases.

. . . 


Checking Status of Oracle Software Stack - Clusterware, ASM, RDBMS

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 
-------------------------------------------------------------------------------------------------------
                                                 Oracle Stack Status                            
-------------------------------------------------------------------------------------------------------
Host Name  CRS Installed  ASM HOME       RDBMS Installed  CRS UP    ASM UP    RDBMS UP  DB Instance Name
-------------------------------------------------------------------------------------------------------
dalvna1 Yes             Yes             Yes             Yes        Yes      Yes      vnaqa1  
dalvna2 Yes             Yes             Yes             Yes        Yes      Yes      vnadbqa2  
dalvna3 Yes             Yes             Yes             Yes        Yes      Yes      vnadbqa3  
-------------------------------------------------------------------------------------------------------

104 of the included audit checks require root privileged data collection . If sudo is not configured or the root password is not available, audit checks which  require root privileged data collection can be skipped.


1. Enter 1 if you will enter root password for each  host when prompted

2. Enter 2 if you have sudo configured for oracle user to execute root_raccheck.sh script 

3. Enter 3 to skip the root privileged collections 

4. Enter 4 to exit and work with the SA to configure sudo  or to arrange for root access and run the tool later.

Please indicate your selection from one of the above options[1-4][1]:- 2

*** Checking Best Practice Recommendations (PASS/WARNING/FAIL) ***



Log file for collections and audit checks are at
/home/oracle/ck/raccheck/raccheck_062713_142945/raccheck.log

Running raccheck in serial mode because expect(/usr/bin/expect) is not available to supply root passwords on remote nodes

NOTICE:  Installing the expect utility (/usr/bin/expect) will allow raccheck to gather root passwords at the beginning of the process and execute raccheck on all nodes in parallel speeding up the entire process. For more info - http://www.nist.gov/el/msid/expect.cfm.  Expect is available for all major platforms.  See User Guide for more details.

=============================================================
                    Node name - dalvna1                                
=============================================================
Collecting - ASM DIsk I/O stats 
Collecting - ASM Disk Groups 
Collecting - ASM Diskgroup Attributes 
Collecting - ASM disk partnership imbalance 
Collecting - ASM diskgroup attributes 
Collecting - ASM initialization parameters 
Collecting - Active sessions load balance for vnadbqa database 
Collecting - Archived Destination Status for vnadbqa database 
Collecting - Cluster Interconnect Config for vnadbqa database 
Collecting - Database Archive Destinations for vnadbqa database 
Collecting - Database Files for vnadbqa database 
Collecting - Database Instance Settings for vnadbqa database 
Collecting - Database Parameters for vnadbqa database 
Collecting - Database Properties for vnadbqa database 
Collecting - Database Registry for vnadbqa database 
Collecting - Database Sequences for vnadbqa database 
Collecting - Database Undocumented Parameters for vnadbqa database 
Collecting - Database Workload Services for vnadbqa database 
Collecting - Dataguard Status for vnadbqa database 
Collecting - Files not opened by ASM 
Collecting - Log Sequence Numbers for vnadbqa database 
Collecting - Percentage of asm disk  Imbalance 
Collecting - Process for shipping Redo to standby for vnadbqa database 
Collecting - Redo Log information for vnadbqa database 
Collecting - Standby redo log creation status before switchover for vnadbqa database 
Collecting - CPU Information
Collecting - CRS active version
Collecting - CRS oifcfg
Collecting - CRS software version
Collecting - CSS Reboot time
Collecting - CSS disktimout
Collecting - Cluster interconnect (clusterware)
Collecting - Clusterware OCR healthcheck 
Collecting - Clusterware Resource Status
Collecting - Huge pages configuration
Collecting - Kernel parameters
Collecting - Linux module config.
Collecting - Maximum number of semaphore sets on system
Collecting - Maximum number of semaphores on system
Collecting - Maximum number of semaphores per semaphore set
Collecting - Memory Information
Collecting - OS Packages
Collecting - Operating system release information and kernel version
Collecting - Oracle Executable Attributes
Collecting - Patches for Grid Infrastructure 
Collecting - Patches for RDBMS Home 
Collecting - Shared memory segments
Collecting - Table of file system defaults
Collecting - Voting disks (clusterware)
Collecting - number of semaphore operations per semop system call

Preparing to run root privileged commands  dalvna1.

Collecting - ACFS and ASM driver version comparison [ACFS] 
Collecting - Broadcast Requirements for Networks 
Collecting - CRS user time zone check 
Collecting - Custom rc init scripts (rc.local) 
Collecting - Generic ACFS health [ACFS] 
Collecting - Grid Infastructure user shell limits configuration 
Collecting - Health of the mounted ACFS file systems [ACFS] 
Collecting - Health of unmounted ACFS file systems [ACFS] 
Collecting - Interconnect interface config 
Collecting - Network interface stats 
Collecting - OCFS2 disks 
Collecting - Root Open File Limit 
Collecting - Verify ioctl to advm [ACFS] 
Collecting - Volume list for unmount ACFS file system [ACFS] 
Collecting - ocsf status 
Collecting - root time zone check 


Data collections completed. Checking best practices on dalvna1.
--------------------------------------------------------------------------------------


 INFO =>    ORA-00600 errors found in alert log for vnadbqa
 INFO =>    ORA-07445 errors found in alert log for vnadbqa
 WARNING => Some user sessions lack proper failover mode (BASIC) and method (SELECT) for vnadbqa
 INFO =>    Some data or temp files are not autoextensible for vnadbqa
 WARNING => Open file limit for root user (ulimit -n) is NOT >= 65536 or unlimited
 WARNING => NIC bonding is NOT configured for public network (VIP)
 WARNING => OSWatcher is not running as is recommended.
 INFO =>    Jumbo frames (MTU >= 8192) are not configured for interconnect
 FAIL =>    Database parameter DB_BLOCK_CHECKSUM is NOT set to recommended value on vnaqa1 instance
 FAIL =>    Database parameter DB_LOST_WRITE_PROTECT is NOT set to recommended value on vnaqa1 instance
 INFO =>    umask for RDBMS owner is not set to 0022
 WARNING => Database parameter DB_BLOCK_CHECKING on PRIMARY is NOT set to the recommended value. for vnadbqa
 INFO =>    Operational Best Practices
 INFO =>    Consolidation Database Practices
 INFO =>    Computer failure prevention best practices
 INFO =>    Data corruption prevention best practices
 INFO =>    Logical corruption prevention best practices
 INFO =>    Database/Cluster/Site failure prevention best practices
 INFO =>    Client failover operational best practices
 WARNING => fast_start_mttr_target has NOT been changed from default on vnaqa1 instance

 INFO =>    Information about hanganalyze and systemstate dump
 INFO =>    Validate Your Configuration is in Compliance with Oracle Security Alert for CVE-2012-1675 /u01/app/oracle/product/11203/db_1
 INFO =>    Validate Your Listener Configurations are in Compliance with Oracle Security Alert for CVE-2012-1675 /u01/app/grid/11203
 INFO =>    Database failure prevention best practices
 FAIL =>    Primary database is NOT protected with Data Guard (standby database) for real-time data protection and availability for vnadbqa
 WARNING => Redo log write time is more than 500 milliseconds for vnadbqa
 WARNING => ASM memory_target is < recommended value
 WARNING => TFA Collector is either not installed or not running
 INFO =>    Parallel Execution Health-Checks and Diagnostics Reports for vnadbqa
 FAIL =>    The data files should be recoverable for vnadbqa


Best Practice checking completed.Checking recommended patches on dalvna1.
---------------------------------------------------------------------------------


Collecting patch inventory on  CRS HOME /u01/app/grid/11203
Collecting patch inventory on ORACLE_HOME /u01/app/oracle/product/11203/db_1 
---------------------------------------------------------------------------------
1 Recommended CRS patches for 112030 from /u01/app/grid/11203 on dalvna1
---------------------------------------------------------------------------------
Patch#   CRS  ASM    RDBMS RDBMS_HOME                              Patch-Description                            
---------------------------------------------------------------------------------
16083653 yes          yes /u01/app/oracle/product/11203/db_1GRID INFRASTRUCTURE PATCH SET UPDATE 11      
---------------------------------------------------------------------------------


---------------------------------------------------------------------------------
35 Recommended RDBMS patches for 112030 from /u01/app/oracle/product/11203/db_1 on dalvna1
---------------------------------------------------------------------------------
Patch#   RDBMS    ASM     type                Patch-Description                       
---------------------------------------------------------------------------------
13819954  yes            N-APPLY             Patch description: "Database Patch Set U
16083653  yes            merge               GRID INFRASTRUCTURE PATCH SET UPDATE 11.
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------


---------------------------------------------------------------------------------
              Clusterware patches summary report
---------------------------------------------------------------------------------
Total patches  Applied on CRS Applied on RDBMS Applied on ASM 
---------------------------------------------------------------------------------
1              1              1                0              
---------------------------------------------------------------------------------


---------------------------------------------------------------------------------
              RDBMS homes patches summary report
---------------------------------------------------------------------------------
Total patches  Applied on RDBMS Applied on ASM ORACLE_HOME    
---------------------------------------------------------------------------------
 35             35             0                /u01/app/oracle/product/11203/db_1
---------------------------------------------------------------------------------



=============================================================
                    Node name - dalvna2                                
=============================================================
Collecting - CPU Information
Collecting - CRS active version
Collecting - CRS oifcfg
Collecting - CRS software version
Collecting - Cluster interconnect (clusterware)
Collecting - Huge pages configuration
Collecting - Kernel parameters
Collecting - Linux module config.
Collecting - Maximum number of semaphore sets on system
Collecting - Maximum number of semaphores on system
Collecting - Maximum number of semaphores per semaphore set
Collecting - Memory Information
Collecting - OS Packages
Collecting - Operating system release information and kernel version
Collecting - Oracle Executable Attributes
Collecting - Patches for Grid Infrastructure 
Collecting - Patches for RDBMS Home 
Collecting - Shared memory segments
Collecting - Table of file system defaults
Collecting - number of semaphore operations per semop system call

Preparing to run root privileged commands  dalvna2.

Collecting - ACFS and ASM driver version comparison [ACFS] 
Collecting - Broadcast Requirements for Networks 
Collecting - CRS user time zone check 
Collecting - Generic ACFS health [ACFS] 
Collecting - Grid Infastructure user shell limits configuration 
Collecting - Health of the mounted ACFS file systems [ACFS] 
Collecting - Health of unmounted ACFS file systems [ACFS] 
Collecting - Interconnect interface config 
Collecting - Network interface stats 
Collecting - OCFS2 disks 
/tmp/root_raccheck.sh: line 54: /sbin/mounted.ocfs2: No such file or directory
Collecting - Root Open File Limit 
Collecting - Verify ioctl to advm [ACFS] 
Collecting - Volume list for unmount ACFS file system [ACFS] 
Collecting - ocsf status 
/tmp/root_raccheck.sh: line 74: /etc/init.d/o2cb: No such file or directory
Collecting - root time zone check 


Data collections completed. Checking best practices on dalvna2.
--------------------------------------------------------------------------------------


 WARNING => Open file limit for root user (ulimit -n) is NOT >= 65536 or unlimited
 WARNING => NIC bonding is NOT configured for public network (VIP)
 WARNING => OSWatcher is not running as is recommended.
 INFO =>    Jumbo frames (MTU >= 8192) are not configured for interconnect
 FAIL =>    Database parameter DB_BLOCK_CHECKSUM is NOT set to recommended value on vnadbqa2 instance
 FAIL =>    Database parameter DB_LOST_WRITE_PROTECT is NOT set to recommended value on vnadbqa2 instance
 INFO =>    umask for RDBMS owner is not set to 0022
 WARNING => Database parameter DB_BLOCK_CHECKING on PRIMARY is NOT set to the recommended value. for vnadbqa
 WARNING => fast_start_mttr_target has NOT been changed from default on vnadbqa2 instance

 INFO =>    Validate Your Configuration is in Compliance with Oracle Security Alert for CVE-2012-1675 /u01/app/oracle/product/11203/db_1
 INFO =>    Validate Your Listener Configurations are in Compliance with Oracle Security Alert for CVE-2012-1675 /u01/app/grid/11203
 WARNING => Redo log write time is more than 500 milliseconds for vnadbqa
 WARNING => ASM memory_target is < recommended value
 WARNING => TFA Collector is either not installed or not running


Best Practice checking completed.Checking recommended patches on dalvna2.
---------------------------------------------------------------------------------


Collecting patch inventory on  CRS HOME /u01/app/grid/11203 
Collecting patch inventory on ORACLE_HOME /u01/app/oracle/product/11203/db_1 
---------------------------------------------------------------------------------
1 Recommended CRS patches for 112030 from /u01/app/grid/11203 on dalvna2
---------------------------------------------------------------------------------
Patch#   CRS  ASM    RDBMS RDBMS_HOME                              Patch-Description                            
---------------------------------------------------------------------------------
16083653 yes          yes /u01/app/oracle/product/11203/db_1GRID INFRASTRUCTURE PATCH SET UPDATE 11      
---------------------------------------------------------------------------------


---------------------------------------------------------------------------------
35 Recommended RDBMS patches for 112030 from /u01/app/oracle/product/11203/db_1 on dalvna2
---------------------------------------------------------------------------------
Patch#   RDBMS    ASM     type                Patch-Description                       
---------------------------------------------------------------------------------
13819954  yes            N-APPLY             Patch description: "Database Patch Set U
16083653  yes            merge               GRID INFRASTRUCTURE PATCH SET UPDATE 11.
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------


---------------------------------------------------------------------------------
              Clusterware patches summary report
---------------------------------------------------------------------------------
Total patches  Applied on CRS Applied on RDBMS Applied on ASM 
---------------------------------------------------------------------------------
1              1              1                0              
---------------------------------------------------------------------------------


---------------------------------------------------------------------------------
              RDBMS homes patches summary report
---------------------------------------------------------------------------------
Total patches  Applied on RDBMS Applied on ASM ORACLE_HOME    
---------------------------------------------------------------------------------
 35             35             0                /u01/app/oracle/product/11203/db_1
---------------------------------------------------------------------------------



=============================================================
                    Node name - dalvna3                                
=============================================================
Collecting - CPU Information
Collecting - CRS active version
Collecting - CRS oifcfg
Collecting - CRS software version
Collecting - Cluster interconnect (clusterware)
Collecting - Huge pages configuration
Collecting - Kernel parameters
Collecting - Linux module config.
Collecting - Maximum number of semaphore sets on system
Collecting - Maximum number of semaphores on system
Collecting - Maximum number of semaphores per semaphore set
Collecting - Memory Information
Collecting - OS Packages
Collecting - Operating system release information and kernel version
Collecting - Oracle Executable Attributes
Collecting - Patches for Grid Infrastructure 
Collecting - Patches for RDBMS Home 
Collecting - Shared memory segments
Collecting - Table of file system defaults
Collecting - number of semaphore operations per semop system call

Preparing to run root privileged commands  dalvna3.

Collecting - ACFS and ASM driver version comparison [ACFS] 
Collecting - Broadcast Requirements for Networks 
Collecting - CRS user time zone check 
Collecting - Generic ACFS health [ACFS] 
Collecting - Grid Infastructure user shell limits configuration 
Collecting - Health of the mounted ACFS file systems [ACFS] 
Collecting - Health of unmounted ACFS file systems [ACFS] 
Collecting - Interconnect interface config 
Collecting - Network interface stats 
Collecting - OCFS2 disks 
/tmp/root_raccheck.sh: line 54: /sbin/mounted.ocfs2: No such file or directory
Collecting - Root Open File Limit 
Collecting - Verify ioctl to advm [ACFS] 
Collecting - Volume list for unmount ACFS file system [ACFS] 
Collecting - ocsf status 
/tmp/root_raccheck.sh: line 74: /etc/init.d/o2cb: No such file or directory
Collecting - root time zone check 


Data collections completed. Checking best practices on dalvna3.
--------------------------------------------------------------------------------------


 WARNING => Open file limit for root user (ulimit -n) is NOT >= 65536 or unlimited
 WARNING => NIC bonding is NOT configured for public network (VIP)
 WARNING => OSWatcher is not running as is recommended.
 INFO =>    Jumbo frames (MTU >= 8192) are not configured for interconnect
 FAIL =>    Database parameter DB_BLOCK_CHECKSUM is NOT set to recommended value on vnadbqa3 instance
 FAIL =>    Database parameter DB_LOST_WRITE_PROTECT is NOT set to recommended value on vnadbqa3 instance
 INFO =>    umask for RDBMS owner is not set to 0022
 WARNING => Database parameter DB_BLOCK_CHECKING on PRIMARY is NOT set to the recommended value. for vnadbqa
 WARNING => fast_start_mttr_target has NOT been changed from default on vnadbqa3 instance

 INFO =>    Validate Your Configuration is in Compliance with Oracle Security Alert for CVE-2012-1675 /u01/app/oracle/product/11203/db_1
 INFO =>    Validate Your Listener Configurations are in Compliance with Oracle Security Alert for CVE-2012-1675 /u01/app/grid/11203
 WARNING => Redo log write time is more than 500 milliseconds for vnadbqa
 WARNING => ASM memory_target is < recommended value
 WARNING => TFA Collector is either not installed or not running


Best Practice checking completed.Checking recommended patches on dalvna3.
---------------------------------------------------------------------------------


Collecting patch inventory on  CRS HOME /u01/app/grid/11203 
Collecting patch inventory on ORACLE_HOME /u01/app/oracle/product/11203/db_1 
---------------------------------------------------------------------------------
1 Recommended CRS patches for 112030 from /u01/app/grid/11203 on dalvna3
---------------------------------------------------------------------------------
Patch#   CRS  ASM    RDBMS RDBMS_HOME                              Patch-Description                            
---------------------------------------------------------------------------------
16083653 yes          yes /u01/app/oracle/product/11203/db_1GRID INFRASTRUCTURE PATCH SET UPDATE 11      
---------------------------------------------------------------------------------


---------------------------------------------------------------------------------
35 Recommended RDBMS patches for 112030 from /u01/app/oracle/product/11203/db_1 on dalvna3
---------------------------------------------------------------------------------
Patch#   RDBMS    ASM     type                Patch-Description                       
---------------------------------------------------------------------------------
13819954  yes            N-APPLY             Patch description: "Database Patch Set U
16083653  yes            merge               GRID INFRASTRUCTURE PATCH SET UPDATE 11.
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------


---------------------------------------------------------------------------------
              Clusterware patches summary report
---------------------------------------------------------------------------------
Total patches  Applied on CRS Applied on RDBMS Applied on ASM 
---------------------------------------------------------------------------------
1              1              1                0              
---------------------------------------------------------------------------------


---------------------------------------------------------------------------------
              RDBMS homes patches summary report
---------------------------------------------------------------------------------
Total patches  Applied on RDBMS Applied on ASM ORACLE_HOME    
---------------------------------------------------------------------------------
 35             35             0                /u01/app/oracle/product/11203/db_1
---------------------------------------------------------------------------------





---------------------------------------------------------------------------------
                      CLUSTERWIDE CHECKS
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------
 
Detailed report (html) - /home/oracle/ck/raccheck/raccheck_dalvna1_vnadbqa_062713_142945/raccheck_dalvna1_vnadbqa_062713_142945.html


UPLOAD(if required) - /home/oracle/ck/raccheck/raccheck_dalvna1_vnadbqa_062713_142945.zip
Posted in RAC
Share this post, let the world know

Comments are closed