In Data Engineer’s Lunch #76, Arpan Patel covered how to connect Airflow and Dataproc with a demo using an Airflow DAG to create a Dataproc cluster, submit an Apache Spark job to Dataproc, and destroy the Dataproc cluster upon completion.
Join us every Monday at 12 PM ET for our weekly Data Engineer’s Lunch. It’s a great opportunity to connect with other data professionals!
