logo

Spark Trouble Shooting - UnsatisfiedLinkError

Last Updated: 2021-11-19

Error

UnsatisfiedLinkError:

ERROR GPLNativeCodeLoader: Could not load native gpl library
java.lang.UnsatisfiedLinkError: no gplcompression in java.library.path

Solution

GPLNativeCodeLoader is looking for a shared library called gplcompression, which is in libgplcompression.so. Make sure the file is in $HADOOP_HOME/lib/native