raphaelauv / Spark-wikipedia-topRank Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Compute the top N viewed Wikipedia pages for a given date

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
src/exoETL		src/exoETL
.gitignore		.gitignore
README.md		README.md
build.gradle		build.gradle
settings.gradle		settings.gradle

Repository files navigation

Spark wikipedia topRank

Overview

TL;DR

cd src/exoETL
gradle shadowJar
cd build/libs
java -jar exo-all-0.0.1.jar --dateHour 20190815 10

Development

Core pre-requisites

If using local IDE:

Java 1.8
Scala 2.11
Spark 2.3.0

(IntelliJ IDEA 2019.2 (Community Edition))

About

Compute the top N viewed Wikipedia pages for a given date

apache-spark spark-sql windows-function

Report repository

Releases

No releases published

Packages

No packages published

Languages

Java 100.0%