Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code

A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.

Great Expectations Airflow operator

Airflow Providers containing Deferrable Operators & Sensors from Astronomer

Airflow plugins for implementing data pipelines. | Plugins do Airflow para implementação de pipelines de dados.

🎵 LyricWave – AI Music Composer (Proof of Concept) 🎶 A personal project exploring automatic generation of unique MP4 songs. LyricWave blends lyrics with AI-generated melodies and synthetic vocals to experiment with new forms of musical expression. A creative testbed to push your ideas into sound. 🚀🎧

Debussy is an opinionated Data Architecture and Engineering framework, enabling data analysts and engineers to build better platforms and pipelines.

Apache Airflow Guide

Airflow operators, hooks, and sensors for interacting with the Hightouch API

Qlik Sense Cloud Provider for Apache Airflow

HDInsight provider for Airflow

An Apache Airflow provider for seamless integration with Anyscale.

Implemented Data Warehouse, Data Lake on AWS and Data modeling with Postgres and Apache Cassandra, Also used Apache Airflow to create data pipeline

All projects from Udacity Data Engineering Course

Common Airflow Operators / Tasks

A project of Airflow DAGs created using Airflow operators

Data Workflows with GCP Dataproc, Apache Airflow and Apache Spark

Airflow task & operator running python code in conda/mamba environments

Python package for the pysparkonk8s Apache Airflow provider.