An end-to-end data engineering pipeline to collect, store, process, and analyze property and crime data using Hadoop, Docker, MySQL, Tailscale, and Selenium
-
Updated
Sep 5, 2024 - Python
An end-to-end data engineering pipeline to collect, store, process, and analyze property and crime data using Hadoop, Docker, MySQL, Tailscale, and Selenium
This project implements a distributed K-Means clustering algorithm using the MapReduce framework
Pure Python extensions library that includes Scala-like streams, Json with attribute access syntax, and other common use stuff
Iterable Java8 style Streams for Python
A project to solve a sudoku in a distributed way, using MapReduce
Big-Data with Apache Spark and Python.
K-means clustering algorithm using MapReduce.
Big data computing tasks conducted with PySpark. The problems involve MapReduce and Streaming algorithms.
Python implementation of the original MapReduce paper published by Google in 2004 simulated using Docker
This repository houses a naïve search engine utilising MapReduce technology which leverages a 5GB csv file as dataset. It makes use of the Vector Space Model for Information Retrieval. This was developed as part of an assignment for the course Fundamentals of Big Data Analytics (DS2004).
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
Python Data Processing library
PyDoop: Revolutionizing Big Data Processing 🚀
Add a description, image, and links to the mapreduce topic page so that developers can more easily learn about it.
To associate your repository with the mapreduce topic, visit your repo's landing page and select "manage topics."