Spark Trouble Shooting - UnsatisfiedLinkError
Updated: 2020-06-29
Error
UnsatisfiedLinkError
:
ERROR GPLNativeCodeLoader: Could not load native gpl library
java.lang.UnsatisfiedLinkError: no gplcompression in java.library.path
Solution
GPLNativeCodeLoader
is looking for a shared library called gplcompression
, which is in libgplcompression.so
. Make sure the file is in $HADOOP_HOME/lib/native