Spark Trouble Shooting - UnsatisfiedLinkError

Error

UnsatisfiedLinkError:

ERROR GPLNativeCodeLoader: Could not load native gpl library
java.lang.UnsatisfiedLinkError: no gplcompression in java.library.path

Solution

GPLNativeCodeLoader is looking for a shared library called gplcompression, which is in libgplcompression.so. Make sure the file is in $HADOOP_HOME/lib/native