This project demonstrates how to use Apache Airflow to submit jobs to Apache spark cluster in different programming laguages using Python, Scala and Java as an example.
-
Updated
Mar 14, 2024 - Java
This project demonstrates how to use Apache Airflow to submit jobs to Apache spark cluster in different programming laguages using Python, Scala and Java as an example.
Build Apache Airflow Dags by placing blocks in Minecraft!
End-to-end data & ML platform for P2P lending analytics.[1] Features medallion architecture, Spark ETL, Airflow orchestration, MLOps with MLflow, and BI dashboards with Superset.
A repository to learn Apache Airlfow by integrating it with other technologies.
📈 Build a real-time stock market data pipeline with Snowflake, Kafka, and Power BI for effective analytics and data engineering practices.
ELT pipeline with Apache Airflow + dbt + PostgreSQL, and a Spring Boot REST APIs to expose the processed data. All containerized with Docker Compose
Add a description, image, and links to the apache-airflow topic page so that developers can more easily learn about it.
To associate your repository with the apache-airflow topic, visit your repo's landing page and select "manage topics."