Tuesday, March 27, 2012

11gR2 new features (3) : voting disks in ASM

One of the new features in Clusterware 11.2.0.1 is that ocr and voting disk must be either on shared files system or in ASM, raw devices are only supported if you upgrade  from one version to the other.


Whereas in 10gR2 you could make use of raw devices for voting disks and ocr, in 11g it is only allowed/supported if you upgrade, since this is clean installation we cannot go that way.  In the 10.2 environment we had 3 voting disks and 2 OCR disks configured ..


Voting and ocr disks are now in ASM depending on the redundancy there are multiple copies. If you use external redundancy as we do for our datadisk and archive diskgroup, the voting disk is only stored once.

as shown here

crsctl query css votedisk## STATE File Universal Id File Name Disk group-- ----- ----------------- --------- ---------1. ONLINE 55b5a82167444ff3bfa0ad1bdc8f99fb (/dev/rdsk/c6t60060E80058DA50000008DA500000007d0s0) [DATADG1]Located 1 voting disk(s).



therefore we decided to create a seperate diskgroup with a higher redundancy to store voting disks.



$ ls -altr /dev/rdsk/*s5
crw-rw---- 1 grid asmdba 118, 5 Mar 21 16:00 /dev/rdsk/c6t60060E80058DA50000008DA50000000Dd0s5
crw-rw---- 1 grid asmdba 118, 13 Mar 21 16:00 /dev/rdsk/c6t60060E80058DA50000008DA50000000Cd0s5
crw-rw---- 1 grid asmdba 118, 21 Mar 21 16:00 /dev/rdsk/c6t60060E80058DA50000008DA50000000Bd0s5
crw-rw---- 1 grid asmdba 118, 29 Mar 21 16:00 /dev/rdsk/c6t60060E80058DA50000008DA50000000Ad0s5
crw-rw---- 1 grid asmdba 118, 37 Mar 21 16:00 /dev/rdsk/c6t60060E80058DA50000008DA500000009d0s5
crw-rw---- 1 grid asmdba 118, 45 Mar 21 16:00 /dev/rdsk/c6t60060E80058DA50000008DA500000008d0s5
crw-rw---- 1 grid asmdba 118, 53 Mar 21 16:00 /dev/rdsk/c6t60060E80058DA50000008DA500000007d0s5



in sqlplus as sysasm

create diskgroup dgquorum
normal redundancy
failgroup q1 disk '/dev/rdsk/c6t60060E80058DA50000008DA500000007d0s5',
'/dev/rdsk/c6t60060E80058DA50000008DA500000008d0s5'
failgroup q2 disk '/dev/rdsk/c6t60060E80058DA50000008DA500000009d0s5',
'/dev/rdsk/c6t60060E80058DA50000008DA50000000Ad0s5'
quorum failgroup q3 disk '/dev/rdsk/c6t60060E80058DA50000008DA50000000Bd0s5',
'/dev/rdsk/c6t60060E80058DA50000008DA50000000Cd0s5'
attribute 'compatible.asm' ='11.2.0.0.0'
/



bash-3.00$ id

uid=101(grid) gid=101(oinstall)
crsctl replace votedisk +DGQUORUM
          Successful addition of voting disk 07dda8a1db214fd1bfb6e49562115215.
          Successful addition of voting disk 609aab5c66b54f74bf46850dc171107f.     
     Successful addition of voting disk 98f7325dbdb14fefbf9c8d0bfc3f6d14.
          Successful deletion of voting disk  
                                    55b5a82167444ff3bfa0ad1bdc8f99fb.
     Successfully replaced voting disk group with +DGQUORUM.CRS-4266: 
     Voting file(s) successfully replaced-


bash-3.00$ crsctl query css votedisk
## STATE File Universal Id File Name Disk group-- ----- ----------------- --------- ---------1. 
ONLINE 07dda8a1db214fd1bfb6e49562115215 (/dev/rdsk/c6t60060E80058DA50000008DA50000000Bd0s5) [DGQUORUM]2. ONLINE 609aab5c66b54f74bf46850dc171107f (/dev/rdsk/c6t60060E80058DA50000008DA500000007d0s5) [DGQUORUM]ONLINE 98f7325dbdb14fefbf9c8d0bfc3f6d14 (/dev/rdsk/c6t60060E80058DA50000008DA500000009d0s5) [DGQUORUM]


Same thing for the OCR disk

this needs to be done as root ...
bash-3.00# /u01/app/11.2.0/grid/bin/ocrconfig -add +DGQUORUMbash-3.00# /u01/app/11.2.0/grid/bin/ocrconfig -add +DGQUORUMPROT-29: The Oracle Cluster Registry location is already configuredbash-3.00# /u01/app/11.2.0/grid/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :Version : 3Total space (kbytes) : 262120Used space (kbytes) : 2976Available space (kbytes) : 259144ID : 809788976Device/File Name : +DATADG1Device/File integrity check succeededDevice/File Name : +DGQUORUMDevice/File integrity check succeeded

Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded










No comments: