Spark
    Overview
    Getting Started
    Configuration
    DataFrame
    Aggregation
    Utilities
    YARN
    IO

Spark Trouble Shooting - UnsatisfiedLinkError

Updated: 2021-11-19

Error

UnsatisfiedLinkError:

ERROR GPLNativeCodeLoader: Could not load native gpl library
java.lang.UnsatisfiedLinkError: no gplcompression in java.library.path

Solution

GPLNativeCodeLoader is looking for a shared library called gplcompression, which is in libgplcompression.so. Make sure the file is in $HADOOP_HOME/lib/native