Default

Default Hadoop Cluster

This widget indicates that a HADOOP_HOME environment variable is set, and Tweakstreet should use it to determine the location of your Hadoop installation.

Requirements

In order to interface with your Hadoop installation Tweakstreet needs to determine the locations of all relevant libraries in your Hadoop distribution.

Tweakstreet determines the location of the libraries by executing a diagnostic command asking your Hadoop installation for the locations of its libraries.

• On macOS and Linux: $HADOOP_HOME/bin/hadoop classpath
• On Windows: %HADOOP_HOME%\bin\hadoop.cmd classpath

You should run the above command yourself to verify that it completes without errors before trying to use your Hadoop installation with Tweakstreet.

Apache Hadoop on Windows

If you’re using a vanilla Apache distribution on windows, the following links might be helpful:

• See the Apache Windows Troubleshooting Page
• Make sure to set the HADOOP_HOME environment variable
• Make sure you’ve provided a suitable winutils binary. Some pre-built winutils binaries for Hadoop are available on Github.
• Winutils uses Microsoft VC++ libraries. If you don’t already have them installed, you can get the Microsoft Visual C++ Redistributable Package (x64)

Test Definition

You can test the definition from the context menu.