In Data Engineer’s Lunch #24: Pandas for Data Engineering, we discussed using Pandas for performing Data Engineering tasks in Python. This topic is part of our ongoing series on Python ETL […]
Data Engineer’s Lunch #24: Pandas for Data Engineering Read More »
In Data Engineer’s Lunch #21: Python ETL Tools, we discussed, compared, and contrasted a number of python tools that assist in running ETL pipelines. The live recording of the Data
Data Engineer’s Lunch #21: Python ETL Tools Read More »
In Data Engineer’s Lunch #18: Luigi for Scheduling, we discussed using Luigi as a workflow scheduler. We then compared its utility vs our previously discussed schedulers, Airflow and Jenkins. The
Data Engineer’s Lunch #18: Luigi for Scheduling Read More »
This post will cover the installation of TableAnalyzer and the use of the tool for data model review. TableAnalyzer is useful for troubleshooting problems with Cassandra tables. We can then
Using TableAnalyzer for Data Model Review Read More »
TableAnalyzer is a tool for analyzing Cassandra (CFStats/TableStats) output that visualizes variance in metrics between nodes. We use TableAnalyzer to generate a conditionally-formatted spreadsheet that can be used to perform
Using TableAnalyzer – Anant’s Tool for Analysis of Cassandra Tables Read More »
In Data Engineer’s Lunch #13: Introduction to Airflow, we discussed the scheduling too, Airflow. The live recording of the Data Engineer’s Lunch, which includes a more in-depth discussion, is also
Data Engineer’s Lunch #13: Introduction to Airflow Read More »
