Beginner data engineering project - batch edition
-
Updated
Sep 4, 2024 - HTML
Beginner data engineering project - batch edition
Terraform module to create AWS Redshift resources 🇺🇦
This checklist aims to be an exhaustive list of all elements you should consider when using Amazon Redshift.
Use AWS Lambda to Pull E-Scooter and E-Bike Location Data, store in S3 & Redshift using Data Vault Data Model, Server to Google Data Studio Dashboard
Data Warehouse with AWS Redshift and Visualizing data using Power BI
Simple getting started 1-node redshift cluster stack
The idea is how can we prepare data to be used by Business Intelligence applications like Tableu or even Jupyternotebook! 👍 In order to help the business see an overview of the data in a diagram of what important features of the product their customers might be using. Mainly, how can we improve the performance of these OLAP and OLTP transactions…
Building and executing end-to-end ELT pipeline and driving analytics using Amazon Redshift as the data warehouse solution.
Deploy an Amazon Redshift Cluster in AWS using Terraform
In this project, an ETL pipeline is built for a database hosted on Redshift. In this project, data from S3 is loaded to staging tables on Redshift and execute SQL statements that create the analytics tables from these staging tables.
Sparkify - Data Pipelines with Airflow - Udacity Data Engineering Expert Track.
Airflow orchestrated ETL (running in docker containers) that pulls batch data from an API to a local Postgres database, loads to AWS S3/Redshift provisioned by Terraform, and visualized in Quicksight.
Udacity Course, Data Engineering Nanodegree, 3rd Project, Data Warehouse with Amazon Redshift
Data Pipeline with Apache Airflow
Implement ETL data pipeline that reads data from S3 bucket and loads data into AWS redshift using Airflow
Udacity Data Engineering project: Data Warehouse
ETL Pipeline from AWS S3 to Redshift
A data warehouse on Amazon Redshift using a star schema to facilitate the analysis of user behaviour on a music streaming app.
Simplistic Terraform module for creating a AWS Redshift cluster to allow direct access programmatically or via a tool like DBeaver, pgAdmin, etc.
Add a description, image, and links to the redshift-cluster topic page so that developers can more easily learn about it.
To associate your repository with the redshift-cluster topic, visit your repo's landing page and select "manage topics."