Enabling competence

Main Menu

  • Home Page
  • Cloudera
  • HadoopAdmin
  • LinuxAdmin

logo

Enabling competence

  • Home Page
  • Cloudera
    • crytal miner virus on HDP

      Malware Targeting Internet-Connected HDP and CDH Clusters | crytal miner virus attack

      January 8, 2019
      0
    • Verify prerequisites for Hadoop packages on linux machines

      Solution: Verifying prerequisites on Linux system while configuring Hadoop packages.

      August 14, 2018
      0
    • Understand: How read operation occurs in HDFS?

      April 12, 2017
      0
    • Learn BIGDATA Cloudera Hadoop Administration Free Course

      January 1, 2017
      0
    • Upgrading CDH using Cloudera Manager

      July 16, 2016
      0
    • Backup Cloudera Manager database

      July 16, 2015
      0
  • HadoopAdmin
    • Verify prerequisites for Hadoop packages on linux machines

      Solution: Verifying prerequisites on Linux system while configuring Hadoop packages.

      August 14, 2018
      0
    • Verify prerequisites for Hadoop packages on linux machines

      How to Kill all YARN Applications in ACCEPTED state | Script solution

      July 19, 2018
      0
    • How to format your HA enabled Hadoop Cluster?

      July 16, 2018
      0
    • How to uninstall Ambari Hadoop cluster like a PRO.

      July 15, 2018
      0
    • Understand: How read operation occurs in HDFS?

      April 12, 2017
      0
    • Configure Linux OS with some prerequisites for Hadoop Installation.

      March 29, 2017
      0
    • Timeline of Hadoop

      February 25, 2017
      0
    • Learn BIGDATA Cloudera Hadoop Administration Free Course

      January 1, 2017
      0
    • Upgrading CDH using Cloudera Manager

      July 16, 2016
      0
  • LinuxAdmin
    • Configure Linux OS with some prerequisites for Hadoop Installation.

      March 29, 2017
      0
    • How to enable EPEL repo for operating system like Pro

      March 21, 2017
      0
    • How to : Get 30% disk performance for operating system.

      March 21, 2017
      0
    • Understanding CPU system topology and commands

      March 21, 2017
      0
    • Installation of OpenJDK8 on Cent OS /Red Hat Linux

      July 16, 2015
      0
  • Malware Targeting Internet-Connected HDP and CDH Clusters | crytal miner virus attack

  • Solution: Verifying prerequisites on Linux system while configuring Hadoop packages.

  • How to Kill all YARN Applications in ACCEPTED state | Script solution

  • How to format your HA enabled Hadoop Cluster?

  • How to uninstall Ambari Hadoop cluster like a PRO.

Uncategorized
Home›Uncategorized›Solution: Ambari Agent lost heartbeat after Java or JDK upgrade

Solution: Ambari Agent lost heartbeat after Java or JDK upgrade

By Hadoop master
July 17, 2018
756
0
Share:

Issue:

Ambari agent lost heartbeat after JDK upgrade OR while installing a new cluster using JDK 8 agent do not get registered.

COMPONENT: Apache Ambari

VERSION: All Ambari Versions

Details for Agent log:

INFO 2018-07-17 15:28:44,399 hostname.py:67 - agent:hostname_script configuration not defined thus read hostname 'machine1.cloud.com' using socket.getfqdn().
INFO 2018-07-17 15:28:44,463 PingPortListener.py:50 - Ping port listener started on port: 8670
INFO 2018-07-17 15:28:44,465 main.py:437 - Connecting to Ambari server at https://machine1.cloud.com:8440 (172.10.101.120)
INFO 2018-07-17 15:28:44,465 NetUtil.py:70 - Connecting to https://machine1.cloud.com:8440/ca
ERROR 2018-07-17 15:28:44,467 NetUtil.py:96 - EOF occurred in violation of protocol (_ssl.c:579)
ERROR 2018-07-17 15:28:44,467 NetUtil.py:97 - SSLError: Failed to connect. Please check openssl library versions. 
Refer to: https://bugzilla.redhat.com/show_bug.cgi?id=1022468 for more details.
WARNING 2018-07-17 15:28:44,467 NetUtil.py:124 - Server at https://machine1.cloud.com:8440 is not reachable, sleeping for 10 seconds...

PROBLEM: Recent JDK and Python updates have introduced behavior changes that can affect the Ambari Server to Ambari Agent registration process. The Ambari Server and Ambari Agent use TLS to register with each other securely. Recent changes have been made to the JDK and Python to increase security by eliminating the use of insecure cipher suites and protocols. These changes ensure that more secure protocols and cipher suites are used by the Ambari Server when setting up its TLS sockets. As a result, these changes also require the Ambari Agent’s Python client be configured to use later versions of the TLS protocol to communicate with the Ambari Server.

IMPACT: After upgrading your JDK to the latest Java 1.8 version, Ambari Agents may stop heart beating and registering themselves with the Ambari Server.

SOLUTION:

Solution For CentOS 7, Debian 7, Ubuntu 14 & 16, or SLES 12 (Python 2.7)
=======================================================
To solve this problem, simply configure the Ambari Agent to use TLSv1.2 when communicating with the Ambari Server by editing each Ambari Agent’s /etc/ambari-agent/conf/ambari-agent.ini file and adding the following configuration property to the security section:

[security]
force_https_protocol=PROTOCOL_TLSv1_2

After this configuration change has been made, the Ambari Agent must be restarted. After restarting, you should no longer see the ERROR’s in the Ambari Agent logs, and in the Ambari Server UI you’ll notice that all Ambari Agents are once again heartbeating.

Solution for CentOS 6, or SLES 11 (Python 2.6)
===============================================

In this scenario, the only way forward is to edit the java.security file in the JDK being used by the Ambari Server and make the following changes:

find the jdk.tls.disabledAlgorithms property and remove the 3DES_EDE_CBC reference
Save the file, and restart the Ambari Server

Other links:

https://blogs.oracle.com/java-platform-group/jdk-8-will-use-tls-12-as-default

https://access.redhat.com/articles/2039753

Tags3DES_EDE_CBCforce_https_protocoljdk upgradeshow_bug.cgi?id=1022468TLSv1.2upgrading your JDK
Previous Article

How to format your HA enabled Hadoop ...

Next Article

How to Kill all YARN Applications in ...

0
Shares
  • 0
  • +
  • 0
  • 0
  • 0
  • 0

Hadoop master

Welcome Cloudscoop knowledge Initiative, Learn free at https://cloudscoop.teachable.com Official Website: www.cloudscoop.net Facebook page: www.facebook.com/Cloudscoop Twitter: https://twitter.com/cloudscoopforu LinkedIn: https://www.linkedin.com/company/cloudscoop

Related articles More from author

  • Uncategorized

    Configure Hadoop Security using Kerberos for MapR Hadoop

    March 29, 2017
    By Hadoop master

You may be interested

  • ClouderaHadoopAdmin

    Learn BIGDATA Cloudera Hadoop Administration Free Course

  • LinuxAdmin

    Understanding CPU system topology and commands

  • HadoopHadoopAdminHDP

    Enabling Name node HA on HDP 2.3 platform

  • LATEST REVIEWS

  • TOP REVIEWS

Timeline

  • January 8, 2019

    Malware Targeting Internet-Connected HDP and CDH Clusters | crytal miner virus attack

  • August 14, 2018

    Solution: Verifying prerequisites on Linux system while configuring Hadoop packages.

  • July 19, 2018

    How to Kill all YARN Applications in ACCEPTED state | Script solution

  • July 17, 2018

    Solution: Ambari Agent lost heartbeat after Java or JDK upgrade

  • July 16, 2018

    How to format your HA enabled Hadoop Cluster?

Latest Comments

Find us on Facebook

logo of cloudscoop

Cloudscoop is a group of consultants in data-driven technologies who are working on a state of the art technologies came together to make knowledge available to other with their expertise on this platform.

Reach us

  • support@cloudscoop.net
  • support@cloudscoop.net
  • Recent

  • Popular

  • Comments

  • crytal miner virus on HDP

    Malware Targeting Internet-Connected HDP and CDH Clusters | crytal miner virus attack

    By Hadoop master
    January 8, 2019
  • Verify prerequisites for Hadoop packages on linux machines

    Solution: Verifying prerequisites on Linux system while configuring Hadoop packages.

    By Hadoop master
    August 14, 2018
  • How to Kill all YARN Applications in ACCEPTED state | Script solution

    By Hadoop master
    July 19, 2018
  • Solution: Ambari Agent lost heartbeat after Java or JDK upgrade

    By Hadoop master
    July 17, 2018
  • crytal miner virus on HDP

    Malware Targeting Internet-Connected HDP and CDH Clusters | crytal miner virus attack

    By Hadoop master
    January 8, 2019
  • Installation of OpenJDK8 on Cent OS /Red Hat Linux

    By Cloudscoop
    July 16, 2015
  • Enabling Name node HA on HDP 2.3 platform

    By Cloudscoop
    July 16, 2016
  • Upgrading CDH using Cloudera Manager

    By Cloudscoop
    July 16, 2016

Trending Now

/etc/fstab 5.4.2 10 years of hadoop Administration amabri-agent AMBARI Backup big data CDH centos Cloudera Cloudera Manager DATA database dfsadmin dmidecode -t processor EPEL ha Hadoop hdfs HDP hig availability Hortonworks Java Java for Hadoop kafka Linux Linux OS lscpu mount nameservice noatime nproc numactl postgresql processors REPOS scm_server software stop ambari-server Storm Timeline Uninstall Ambari upgrade vi

Follow us

  • Contact
  • About Us
  • Home
© Copyright www.cloudscoop.net. All rights reserved.