This project implements a Lakehouse Medallion Architecture using modern Data Stack tools such as Fivetran, Snowflake and dbt. The ficticious organization is an e-commerce company.
-
Updated
Jan 24, 2024 - Python
This project implements a Lakehouse Medallion Architecture using modern Data Stack tools such as Fivetran, Snowflake and dbt. The ficticious organization is an e-commerce company.
This repository contains a comprehensive end-to-end Azure Data Engineering solution, covering the entire data lifecycle from ingestion to reporting. The project utilizes various Azure services and tools to achieve efficient data handling, transformation, and reporting.
Além de explorar boas práticas em python, o propósito é de aplicar conceitos de Arquitetura Medallion, programação orientada a objetos e ETL, utilizando dados públicos sociais dos municípios brasileiros. Este repositório utiliza ainda DuckDB e Streamlit para exibição dos resultados
Data Warehouse with ELT pipelines
Add a description, image, and links to the medallion-architecture topic page so that developers can more easily learn about it.
To associate your repository with the medallion-architecture topic, visit your repo's landing page and select "manage topics."