Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

Spark Issue: AnalysisException: Cannot Resolve

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Symptom

org.apache.spark.sql.AnalysisException: cannot resolve ...

Cause

Miss-spell a column name or refer to a column which does not exist in the DataFrame.

Solution

Correct the column name or add the missing column in the select method before using it.