Introduction Music streaming platforms play a crucial role in providing personalized music experiences to millions of users. Spotify, a global leader in music streaming, understands the significance of delivering relevant […]
Spark and Python at Spotify: Spotify Content Recommendations Read More »
In Data Engineer’s Lunch #41: Pygrametl, we discussed PygramETL, a python ETL tool. This is the end for now of our series on them. The live recording of the Data
Data Engineer’s Lunch #41: PygramETL Read More »
In Data Engineer’s Lunch #28: Petl for Data Engineering, we discussed Petl as part of our ongoing series on python ETL tools. The live recording of the Data Engineer’s Lunch,
Data Engineer’s Lunch #28: Petl for Data Engineering Read More »
In this blog post, we will discuss a number of ways of doing dependency management when running spark scripts. This particular post is not a part of any of our
Spark Script Dependency Management Read More »
In this blog post, the second in a series about Open Source Data Catalogs, we will be talking about the Open Source Data Discovery and Metadata Engine known as Amundsen.
Open Source Data Catalog Overview: Amundsen Read More »
In Data Engineer’s Lunch #25: Airflow and Spark, we discuss how we can use Airflow to manage Spark jobs. The live recording of the Data Engineer’s Lunch, which includes a
Data Engineer’s Lunch #25: Airflow and Spark Read More »
