Friday, January 19, 2018

Hadoop Cluster SSH Configuration


hduser_@hadoopmaster:~$ rm -r ~/.ssh/
hduser_@hadoopmaster:~$ ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa

hduser_@hadoopmaster:~$ eval `ssh-agent -s`
Agent pid 6050
hduser_@hadoopmaster:~$ ssh-add

hduser_@hadoopmaster:~$ cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys


hduser_@hadoopslave1:~$ rm -r ~/.ssh/
hduser_@hadoopslave1:~$ eval `ssh-agent -s`
Agent pid 7080
hduser_@hadoopslave2:~$ ssh-add

hduser_@hadoopslave2:~$ rm -r ~/.ssh/
hduser_@hadoopslave2:~$ eval `ssh-agent -s`
Agent pid 8080
hduser_@hadoopslave2:~$ ssh-add


hduser_@hadoopmaster:~$ ssh-copy-id -i $HOME/.ssh/id_rsa.pub hduser_@yind.hadoopslave1.com

hduser_@hadoopmaster:~$ ssh hduser_@yind.hadoopslave1.com

hduser_@hadoopmaster:~$ ssh-copy-id -i $HOME/.ssh/id_rsa.pub hduser_@yind.hadoopslave2.com

hduser_@hadoopmaster:~$ ssh hduser_@yind.hadoopslave2.com



No comments:

Post a Comment

Recent Post

Databricks Delta table merge Example

here's some sample code that demonstrates a merge operation on a Delta table using PySpark:   from pyspark.sql import SparkSession # cre...