Prerequisites

Spark v2.2 or later
Java 8 or later
hivemall-all-<version>.jar that can be found in Maven central (or use packages built by bin/build.sh).
define-all.spark

Installation

First, you download a compiled Spark package from the Spark official web page and invoke spark-shell with a compiled Hivemall binary.

$ spark-shell --jars target/hivemall-all-<version>-incubating-SNAPSHOT.jar

In another way to install Hivemall, you can use a --packages option.

$ spark-shell --packages org.apache.hivemall:hivemall-all:<version>

You find available Hivemall versions on Maven repository.

Then, you load scripts for Hivemall functions.

scala> :load ~/workspace/incubator-hivemall/resources/ddl/define-all.spark