Generic
Generic Hadoop Installation
Settings
| Name | Type | Description |
|---|---|---|
Home |
string |
The home directory of your Hadoop installation. This folder is used as
|
Requirements
In order to interface with your Hadoop installation Tweakstreet needs to determine the locations of all relevant libraries in your Hadoop distribution.
Tweakstreet determines the location of the libraries by executing a diagnostic command asking your Hadoop installation for the locations of its libraries.
- On macOS and Linux:
$HADOOP_HOME/bin/hadoop classpath - On Windows:
%HADOOP_HOME%\bin\hadoop.cmd classpath
You should run the above command yourself to verify that it completes without errors before trying to use your Hadoop installation with Tweakstreet.
Apache Hadoop on Windows
If you’re using a vanilla Apache distribution on windows, the following links might be helpful:
- See the Apache Windows Troubleshooting Page
- Make sure to set the
HADOOP_HOMEenvironment variable - Make sure you’ve provided a suitable winutils binary. Some pre-built winutils binaries for Hadoop are available on Github.
- Winutils uses Microsoft VC++ libraries. If you don’t already have them installed, you can get the Microsoft Visual C++ Redistributable Package (x64)
Test Definition
You can test the definition from the context menu.