Skip to content

A comparison of Flink and Spark Streaming in realtime processing scene and realtime data warehouse

Notifications You must be signed in to change notification settings

gonggongjohn/flink_spark_benchmark

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

分布式系统模型与系统 课程期末项目

本仓库存储了分布式系统模型与系统课程期末项目的相关实现代码和测试数据。

实验一:Spark Streaming 和 Flink 在去重任务中的性能差异比较

实验二:Spark Streaming 和 Flink 在随机实时消息流中的性能差异比较

所有项目源码均在/src/main/java/gonggongjohn/benchmark路径下。其中,FlinkUVRecorder是去重任务的Flink实现,SparkUVRecorder是去重任务的Spark Streaming实现,SocketDataProvider为流数据产生器。

About

A comparison of Flink and Spark Streaming in realtime processing scene and realtime data warehouse

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages