Airflow and Spark: Running Spark Jobs in Apache Airflow
In this blog, we run and schedule Spark jobs on Apache Airflow, we built a Spark job that extracts data […]
Airflow and Spark: Running Spark Jobs in Apache Airflow Read More »
airflow
Airflow and Cassandra: Writing to Cassandra from Airflow
In this article, we are going to build a simple Extract, Transform, and Load (ETL) data pipeline using Apache Airflow,
Airflow and Cassandra: Writing to Cassandra from Airflow Read More »
Data Engineer’s Lunch #47: Airflow on Kubernetes
In Data Engineer’s Lunch #47, we will use Kubernetes to deploy Airflow. The live recording of the Data Engineer’s Lunch,
Data Engineer’s Lunch #47: Airflow on Kubernetes Read More »
Data Engineer’s Lunch #36: Amundsen/DSE with Airflow
In Data Engineer’s Lunch #36 Amundsen/DSE with Airflow, we will discuss the integration of Amundsen with DSE and Airflow. The
Data Engineer’s Lunch #36: Amundsen/DSE with Airflow Read More »
Data Engineer’s Lunch #27: Data Processing with Containers: Kubernetes Tools for Data Engineering
In Data Engineer’s Lunch #27 Data Processing with Containers: Kubernetes Tools for Data Engineering, we will discuss data processing with
Apache Cassandra Lunch #53: Cassandra ETL with Airflow and Spark
In Apache Cassandra Lunch #53: Cassandra ETL with Airflow and Spark, we discussed how we can do Cassandra ETL processes
Apache Cassandra Lunch #53: Cassandra ETL with Airflow and Spark Read More »
