Configuring Hadoop cluster using Ansible

 🔰 11.1 Configure Hadoop and start cluster services using Ansible Playbook


- Configuring Hadoop cluster consumes a lot of time and each time when a new node has to be launched it requires more time and there is a chance for occurrence of human error.

- This use case can be easily solved withe the help of Ansible

- For configuring any type of node in hadoop cluster we need JDK and Hadoop installation files



These are the files I created for easy configuration of hadoop cluster with ansible

dcore-site.xml  -  core-site.xml file for data node

dhdfs-site.xml  -  hdfs.site.xml file for data node

ncore-site.xml  -  core-site.xml file for name node

nhdfs-site.xml  -  hdfs.site.xml file for name node

hadoop.yml - playbook for hadoop configuration


This ansible code is for configuring nodes

JDK and Hadoop files are transferred to the nodes and installed on each node



This is for configuring namenode and starting the namenode





This is for configuring datannode and starting daatanode




#vimaldaga #righteducation #educationredefine #rightmentor #worldrecordholder #linuxworld #makingindiafutureready #righeudcation #arthbylw #ansible #facts #inventory #webserver

Comments