In Data Engineer’s Lunch #45: Apache Livy, we discussed Apache Livy, a REST API for interacting with Spark Clusters. It also helps with submitting jobs and managing Spark Contexts and […]
Data Engineer’s Lunch #45: Apache Livy Read More »
In Apache Cassandra Lunch #65: Spark Cassandra Connector Pushdown, we discussed Spark predicate pushdown in the context of the Spark Cassandra connector. The live recording of Cassandra Lunch, which includes
Apache Cassandra Lunch #65: Spark Cassandra Connector Pushdown Read More »
In this blog post, the first in a series about Open Source Data Catalogs, we will be talking about an Open Source Data Catalog known as CKAN. We will be
Open Source Data Catalog Overview: CKAN Read More »
In Data Engineer’s Lunch #15: Introduction to Jenkins, we discussed Jenkins the automation platform. The live recording of the Data Engineer’s Lunch, which includes a more in-depth discussion, is also
Data Engineer’s Lunch #15: Introduction to Jenkins Read More »
TableAnalyzer is a tool for analyzing Cassandra (CFStats/TableStats) output that visualizes variance in metrics between nodes. We use TableAnalyzer to generate a conditionally-formatted spreadsheet that can be used to perform
Using TableAnalyzer – Anant’s Tool for Analysis of Cassandra Tables Read More »
Data lakes are a tool for long term data storage. They can be implemented on-premises for use cases requiring high security or in the cloud for more accessible solutions. The
Apache Spark Companion Technologies: Data Lakes Read More »
