In this blog post, we set up Apache Spark and Apache Airflow using a Docker container, and in the end, we ran and scheduled Spark jobs using Airflow which is […]
Airflow and Spark: Running Spark Jobs on Airflow (Docker-based Solution) Read More »
In this blog, we run and schedule Spark jobs on Apache Airflow, we built a Spark job that extracts data from an API, transforms the result JSON data, and loads
Airflow and Spark: Running Spark Jobs in Apache Airflow Read More »
In Data Engineer’s Lunch #25: Airflow and Spark, we discuss how we can use Airflow to manage Spark jobs. The live recording of the Data Engineer’s Lunch, which includes a
Data Engineer’s Lunch #25: Airflow and Spark Read More »
In Apache Cassandra Lunch #46: Apache Spark Jobs in Scala for Cassandra Data Operations, we discuss how we can do Apache Spark jobs in Scala Cassandra data operations. The live
Apache Cassandra Lunch #46: Apache Spark Jobs in Scala for Cassandra Data Operations Read More »
