Configuring Hadoop cluster using Ansible
🔰 11.1 Configure Hadoop and start cluster services using Ansible Playbook
- Configuring Hadoop cluster consumes a lot of time and each time when a new node has to be launched it requires more time and there is a chance for occurrence of human error.
- This use case can be easily solved withe the help of Ansible
- For configuring any type of node in hadoop cluster we need JDK and Hadoop installation files
These are the files I created for easy configuration of hadoop cluster with ansible
dcore-site.xml - core-site.xml file for data node
dhdfs-site.xml - hdfs.site.xml file for data node
ncore-site.xml - core-site.xml file for name node
nhdfs-site.xml - hdfs.site.xml file for name node
hadoop.yml - playbook for hadoop configuration
This ansible code is for configuring nodes
JDK and Hadoop files are transferred to the nodes and installed on each node
This is for configuring namenode and starting the namenode



Comments
Post a Comment