THE AGENT IS BLOCKED BY THE OMS. AGENT IS OUT-OF-SYNC WITH REPOSITORY

 
ISSUE

[oracle@dbpilot ~] emctl upload agent
Oracle Enterprise Manager Cloud Control 13c Release 1
Copyright (c) 1996, 2015 Oracle Corporation.  All rights reserved.
---------------------------------------------------------------
EMD upload error:full upload has failed: The agent is blocked by the OMS. Agent is out-of-sync with repository. This most likely means that the agent was reinstalled or recovered. Please contact an EM administrator to unblock the agent by performing an agent resync from the console. (AGENT_BLOCKED)

[oracle@dbpilot ~] emctl status agent
Oracle Enterprise Manager Cloud Control 13c Release 1
Copyright (c) 1996, 2015 Oracle Corporation.  All rights reserved.
---------------------------------------------------------------
Agent Version          : 13.1.0.0.0
OMS Version            : (unknown)
Protocol Version       : 12.1.0.1.0
Agent Home             : /agent13c/agent_inst
Agent Log Directory    : /agent13c/agent_inst/sysman/log
Agent Binaries         : /agent13c/agent_13.1.0.0.0
Core JAR Location      : /agent13c/agent_13.1.0.0.0/jlib
Agent Process ID       : 15031
Parent Process ID      : 14974
Agent URL              : https://dbpilot.net:3872/emd/main/
Local Agent URL in NAT : https://dbpilot.net:3872/emd/main/
Repository URL         : https://s001as-oem13c.net:4903/empbs/upload
Started at             : 2018-05-21 12:25:47
Started by user        : oracle
Operating System       : Linux version 3.10.0-514.el7.x86_64 (amd64)
Number of Targets      : 4
Last Reload            : (none)
Last successful upload                       : (none)
Last attempted upload                        : (none)
Total Megabytes of XML files uploaded so far : 0
Number of XML files pending upload           : 515
Size of XML files pending upload(MB)         : 0.56
Available disk space on upload filesystem    : 80.78%
Collection Status                            : Collections enabled
Heartbeat Status                             : Agent is blocked 
Blocked Reason         : Agent is out-of-sync with repository. This most likely means that the agent was reinstalled or recovered. Please contact an EM administrator to unblock the agent by performing an agent resync from the console.
Last attempted heartbeat to OMS              : 2018-05-21 12:43:52
Last successful heartbeat to OMS             : (none)
Next scheduled heartbeat to OMS              : 2018-05-21 12:46:53

---------------------------------------------------------------
Agent is Running and Ready

 
CHANGES

 
SOLUTION

Perform the Agent Resynchronization through Enterprise Manager Cloud Control Console

1. Targets => All Targets

2. Search for the agent name experiencing the problem and click on its name to open the Agent console

3. At the Agent console, you will see an error telling about your agent is blocked

Agent has been blocked due to Bounce Counter mismatch. If Agent has been restored from a backup perform an Agent Resync.

4. Click Agent -> Resynchronization

Click “Continue” to start the Agent Resynchronization

A new job is submitted to perform the Agent Resynchronization. Click “OK” to confirm

5. Find the job status by choosing Enterprise => Job => Activity

In Available Criteria field search for the job name. The job status must be as “Succeeded”

6. Confirm that the agent is unblocked now. The Agent Console must show the agent status is up (a green up arrow next to the agent name)

[oracle@dbpilot ~] emctl status agent
Oracle Enterprise Manager Cloud Control 13c Release 1
Copyright (c) 1996, 2015 Oracle Corporation.  All rights reserved.
---------------------------------------------------------------
Agent Version          : 13.1.0.0.0
OMS Version            : 13.1.0.0.0
Protocol Version       : 12.1.0.1.0
Agent Home             : /agent13c/agent_inst
Agent Log Directory    : /agent13c/agent_inst/sysman/log
Agent Binaries         : /agent13c/agent_13.1.0.0.0
Core JAR Location      : /agent13c/agent_13.1.0.0.0/jlib
Agent Process ID       : 15031
Parent Process ID      : 14974
Agent URL              : https://dbpilot.net:3872/emd/main/
Local Agent URL in NAT : https://dbpilot.net:3872/emd/main/
Repository URL         : https://s001as-oem13c.net:4903/empbs/upload
Started at             : 2018-05-21 12:25:47
Started by user        : oracle
Operating System       : Linux version 3.10.0-514.el7.x86_64 (amd64)
Number of Targets      : 4
Last Reload            : (none)
Last successful upload                       : 2018-05-21 13:47:35
Last attempted upload                        : 2018-05-21 13:47:35
Total Megabytes of XML files uploaded so far : 0.25
Number of XML files pending upload           : 0
Size of XML files pending upload(MB)         : 0
Available disk space on upload filesystem    : 80.79%
Collection Status                            : Collections enabled
Heartbeat Status                             : Ok
Last attempted heartbeat to OMS              : 2018-05-21 13:47:57
Last successful heartbeat to OMS             : 2018-05-21 13:47:57
Next scheduled heartbeat to OMS              : 2018-05-21 13:48:58

---------------------------------------------------------------
Agent is Running and Ready

 
 
NOTE : Also you can run the Resynchronization from the OMS console

## Login as sysman user
oracle@oms-server.com|08:25|~: emcli login -username=sysman
Enter password :

Login successful

## Perfrom the Resynchronization for the host in trouble
oracle@oms-server.com|08:25|~: emcli resyncAgent -agent="dbpilot.net:3872"
Resync job RESYNC_20200228082544416 successfully submitted

## Check a status of the job
oracle@oms-server.com|08:32|~: emcli get_jobs -name="RESYNC_20200228082544416" -owner="SYSMAN"
Name                      Type            Job ID                            Execution ID                      Scheduled            Completed            TZ Offset  Status     Status ID  Owner   Target Type  Target Name
RESYNC_20200228082544416  ResyncStateJob  9F9CFD428CC747CFE0530201040A30FD  9F9CFD428CCA47CFE0530201040A30FD  2020-02-28 08:25:44  2020-02-28 08:25:49  GMT+03:00  Succeeded  5          SYSMAN  oracle_emd   dbpilot.net:3872

 
 
In some cases the Agent Resynchronization won’t help. If the above plan failed to unblock an agent then the only option you have is to reinstall an agent.