Ben Chuanlong Du's Blog

It is never too late to learn.

Spark Issue Libc Not Found

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Symptom

/lib64/libc.so.6: version `GLIBC_2.18' not found (required by ...)

Cause

The required version of GLIBC by the binary executor is not found on Spark nodes.

Solution

Recompile your binary executable with the right version of GLIBC. The recommended approach is build your binary executable in a Docker environment with the same OS installed in Spark nodes. For example, if CentOS 7.6 is the Linux distribution installed on Spark nodes, then build your binary executable in a Docker image with CentOS 7.6.

Comments