The project where I am currently working on involves a Sparc Super Cluster (SSC) and migrating databases from M9000 hardware to this nice machine.
A SSC is basically a SPARC based exadata, you get all the advantages of the exadata and a lot more ... lot of versataliy using SPARC; IO Domains , Zones, CPU Capping on the compute nodes ... You can assign CPU's to zones that don't use underlying Exadata storage cells as database storage, but just regular SAN or NAS storage ....
Several versions of SSC exist the customer has the version with 4 T4-4 that is 4 times 4 cpus with 8 cores each with 8 threads per core ....a lot of processing power.
The customer decided to make use of Data Guard and Rac One.
EM 12c R3 (probably R4 with go live)
For me Rac One is something new as is Data Guard Broker, on Rac Databases, I configured it on single instance databases years ago but always preferred the manual sql way to do switchovers etc ... however if you want to use EM 12c to do switchovers, etc, there is no alternative the broker must be used.
I will split the installation of RAC One and Data Guard over several blogposts, basically it will become a series on how to setup
The first part will discuss the setup of RAC one
The second part will discuss how to get the data copied over to the standby host.
The third part will discuss how to get this integrated in the data guard broker
So here we go
Ok you created your first RAC One database with the the database creation assistants as shown here under.
Sofar everything is the same however here we see some specifics to the SSC (don't know for exadata )
Logs.sql will add the redo logs for both threads
Create_bct.sql è put block change tracking on
Recreate_temp.sql è recreates a bigfile temporary tablespace
Cluster_interconnect.sql “tries” to set the interconnect but
fails to do so correctly, it bases itself on the gv$ tables and since only one
instance is up this doesn’t work as expected, more over a RAC One Instance can
run on every node and isn’t bound to a node you can end up with INST_1 running
on node2 and vice versa.
Set_use_large_pages.sql è
sets obligatory use of memory pages to false, and suggests to set it to TRUE
after checking the os, however I believe contrary to Linux on Solaris this is
done automagically, this should be translucent, excuse the phun internal joke with the c
Set_fra_size.sql èsets the fra to 90% of the diskgroup TO BE CHANGED if
running more then one instance from that DG, in our case there will be about 40 instances running, something I want to reduce significantly and make use of resource_manager and IORM
Exadata_miscellaneous.sql è
@/u01/app/oracle/product/11.2.0.4/dbhome_1/rdbms/admin/catbundle.sql exa apply
insert into resource_io_calibrate$ values (CURRENT_TIMESTAMP,CURRENT_TIMESTAMP, 0,0,200,0,0);
BEGIN DBMS_AUDIT_MGMT.set_audit_trail_location(audit_trail_type
=> DBMS_AUDIT_MGMT.AUDIT_TRAIL_AUD_STD,audit_trail_location_value =>
'SYSAUX'); END;
/
BEGIN DBMS_AUDIT_MGMT.set_audit_trail_location(audit_trail_type
=> DBMS_AUDIT_MGMT.AUDIT_TRAIL_FGA_STD,audit_trail_location_value =>
'SYSAUX'); END;
for the rest everything is the same as you can see here...
for future DG implementation we append _SSC01 to the db_unique_name
Wait a bit and the Rac One Db is ready
the highlighted template set some parameters that are specific to the super cluster
It looks like the cluster_interconnects_parameter set by
set_cluster_interconnects.sql is not working as expected, it makes use of the
gv$ tables and with RAC One information about the 2nd thread is only
there during a relocation … therefore the parameter is not set for the other
instance.
Following init.ora parameters were set for exadata :
_file_size_increase_increment=2143289344
_enable_numa_support=FALSE
This is how the init.ora looks like after the RAC One install
DGTEST_2.__db_cache_size= 3019898880
DGTEST_1.__db_cache_size=3019898880
DGTEST_2.__java_pool_size=67108864
DGTEST_1.__java_pool_size=67108864
DGTEST_2.__large_pool_size=33554432
DGTEST_1.__large_pool_size=33554432
DGTEST_1.__oracle_base='/u01/app/oracle'#ORACLE_BASE set from
environment
DGTEST_2.__pga_aggregate_target=2147483648
DGTEST_1.__pga_aggregate_target=2147483648
DGTEST_2.__sga_target=4294967296
DGTEST_1.__sga_target=4294967296
DGTEST_2.__shared_io_pool_size=0
DGTEST_1.__shared_io_pool_size=0
DGTEST_2.__shared_pool_size= 1006632960
DGTEST_1.__shared_pool_size=1006632960
DGTEST_2.__streams_pool_size=0
DGTEST_1.__streams_pool_size=0
*._enable_numa_support=FALSE
*._file_size_increase_increment=2143289344
*.archive_lag_target=0
*.audit_sys_operations=TRUE
*.audit_trail='db'
*.cluster_database=true
*.cluster_interconnects=''
DGTEST_1.cluster_interconnects=''
*.compatible='11.2.0.4.0'
*.control_files='+DATA_APRO/dgtest_ssc01/controlfile/current.261.850563521'
*.db_block_checking='false'
*.db_block_checksum='typical'
*.db_block_size=8192
*.db_create_file_dest='+DATA_APRO'
*.db_create_online_log_dest_1='+DATA_APRO'
*.db_domain=''
*.db_files=1024
*.db_lost_write_protect='typical'
*.db_name='DGTEST'
*.db_recovery_file_dest='+RECO_APRO'
*.db_recovery_file_dest_size=1102053376000#90% of Total Space in
FRA Disk Group *.db_unique_name='DGTEST_SSC01'
*.diagnostic_dest='/u01/app/oracle'
*.fal_client='DGTEST_SSC01'
*.fal_server='dgtest_ssc02_redo'
*.fast_start_mttr_target=300
*.filesystemio_options='setall'
*.global_names=TRUE
*.log_archive_config='dg_config=(DGTEST_SSC01,dgtest_ssc02)'
*.log_archive_dest_1='LOCATION=USE_DB_RECOVERY_FILE_DEST
VALID_FOR=(ALL_LOGFILES,ALL_ROLES)'
*.log_archive_dest_state_2='ENABLE'
DGTEST_2.log_archive_format='%t_%s_%r.dbf'
DGTEST_1.log_archive_format='%t_%s_%r.dbf'
*.log_archive_max_processes=4
*.log_archive_min_succeed_dest=1
DGTEST_2.log_archive_trace=0
DGTEST_1.log_archive_trace=0
*.log_buffer=134217728
*.open_cursors=1000
*.os_authent_prefix=''
*.parallel_adaptive_multi_user=FALSE
*.parallel_execution_message_size=16384
*.parallel_max_servers=240
*.parallel_min_servers=0
*.parallel_threads_per_cpu=1
*.pga_aggregate_target=2147483648
*.processes=1024
*.recyclebin='on'
*.remote_listener='ssc01scan01-orapro:1521'
*.remote_login_passwordfile='exclusive'
*.sessions=1131
*.sga_target=4294967296
*.sql92_security=TRUE
*.standby_file_management='AUTO'
*.use_large_pages='FALSE'#Change use_large_pages to ONLY, after
verifying the nr.hugepages requirement
