This is an easy-to-run standalone spark cluster attached to a Jupyter notebook instance. Just run ./build-spark.sh to build the images, then run docker-compose up and navigate to localhost:8080(Spark UI) and localhost:8888 (Jupyter Notebook). You may need to configure the worker resources in docker-compose.yml to less than your machine.
-
Notifications
You must be signed in to change notification settings - Fork 0
Gingernaut/apache-spark-playground
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Apache Spark cluster connected to a Jupyter Notebook instance
Topics
Resources
Stars
Watchers
Forks
Releases
No releases published