Today's Headline News

New Merger of airlines and hotel chains - a supply chain study

Search in Lee's Page

Monday, April 4, 2016

Unable to load native-hadoop library

WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable


Problem: when running a hadoop or Spark app we may encounter the message below
WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable


Solution: type following command in the command line (in Windows OS)

Set LD_LIBRARY_PATH=%HADOOP_HOME%/lib/native/Set HADOOP_OPTS="-Djava.library.path=%HADOOP_HOME%/lib"


PS, If you have a cluster host, you can install Linux 6.x managed by Cloudera Manager. Then you can use PuTTY and Hue to run your files.

No comments:

Post a Comment