Exploring Kafka and Airflow Pipelines: Introduction
Introduction Welcome to the world of data pipelines, where efficiency is key to harnessing the power of data and gaining […]
Exploring Kafka and Airflow Pipelines: Introduction Read More »
airflow
Integrating YugaByte with Apache Airflow
Apache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows. YugaByteDB is a distributed SQL and NoSQL
Integrating YugaByte with Apache Airflow Read More »
Data Engineer’s Lunch #89: Machine Learning Orchestration with Airflow
In Data Engineer’s Lunch #89: Machine Learning Orchestration with Airflow, we discussed using Apache Airflow to manage and schedule machine
Data Engineer’s Lunch #89: Machine Learning Orchestration with Airflow Read More »
Data Engineer’s Lunch #76: Airflow and Google Dataproc
In Data Engineer’s Lunch #76, Arpan Patel covered how to connect Airflow and Dataproc with a demo using an Airflow
Data Engineer’s Lunch #76: Airflow and Google Dataproc Read More »
Data Engineer’s Lunch #66: Airflow and Presto
In Data Engineer’s Lunch #66, we discuss how to connect Airflow and Presto. The live recording of Data Engineer’s Lunch,
Data Engineer’s Lunch #66: Airflow and Presto Read More »
Airflow and Spark: Running Spark Jobs on Airflow (Docker-based Solution)
In this blog post, we set up Apache Spark and Apache Airflow using a Docker container, and in the end,
Airflow and Spark: Running Spark Jobs on Airflow (Docker-based Solution) Read More »
