Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Symptoms¶
Caused by: java.lang.RuntimeException: Could not find any configured addresses for URI hdfs://clustername-router/
Possible Causes¶
This is due to missing clustername-router settings in the property dfs.nameservices in hdfs-site.xml.
It happens when HDFS migrates to router-based federation (RBF)
but the Hadoop client (which is used to submit the Spark application)
is not updated accordingly.
Possible Solutions¶
Ask Hadoop admin to fix the configuration issues.