Sunday, November 5, 2017

ORA-39510 While Starting Cluster Health Monitor Repository (MGMTDB)

MGMTDB, also called Management Repository Database was introduced in 12c Grid Infrastructure. This repository database is used to store Cluster Health Monitor data so that this monitoring data can be used for Grid Infrastructure troubleshooting. This database resource is set to start automatically on the start of Grid Infrastructure, but, there could be some scenarios where MGMTDB might not start because of some issues. One of the similar problems I face because of which MGMTDB could not start automatically. When I tried to start Management Repository Database manually, it failed to start and threw following error messages.

ORA-39510: CRS error performing start on instance '-MGMTDB' on '_mgmtdb'
CRS-2527: Unable to start 'ora.mgmtdb' because it has a 'hard' dependency on 'ora.MGMTLSNR'
CRS-2525: All instances of the resource 'ora.MGMTLSNR' are already running; relocate is not allowed because the force option was not specified
CRS-0222: Resource 'ora.mgmtdb' has dependency error.
clsr_start_resource:260 status:222
clsrapi_start_db:start_asmdbs status:222

I realized that I was trying to start MGMTDB on a RAC node other than where MGMTLSNR (Oracle TNS Listener for Management Repository Database) was currently running. This actually means that we need to make sure that Management Listener To start MGMTDB, check on which node MGM Listener should be running on the RAC node where we are trying to start the MGMTDB. Highlighted in the following is the status of MGMT Listener
[grid@salman11 ~]$ crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       salman11                 STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       salman11      169.254.104.64 10.10  .10.10,   STABLE
ora.asm

Following is the command to start the MGMTDB on a particular node, and check the status.
[grid@salman11 ~]$ srvctl start mgmtdb -node salman11
[grid@salman11 ~]$ crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.MGMTLSNR
      1        ONLINE  ONLINE       salman11      169.254.104.64 10.10  .10.10,   STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       salman11                 Open,STABLE



No comments:

Post a Comment

Popular Posts - All Times