spark-service

spark-service provides a containerized solution for a quick setup of an Apache Spark infrastructure. It is designed to faciliate benchmarking and interoperability with scark-cli.

Spark

If you need an introduction to spark head over to Spark introduction.

Features

• spark-service offers docker containers for master, work and submit nodes
• All docker containers are integrated and connected via docker-compose
• Configurations and allocation parameters of master/worker nodes are easily changed through predefined variables
• Several runnable example scripts are already included
• spark-service is specifically designed to interoperate with scark-cli

Documentation

Please visit the Documentation.

Authors

spark-service was designed by Lukas Heumos.