In Data Engineer’s Lunch #59: Spark Tasks and Distribution, we discussed using a machine learning example to investigate the way that Spark distributes work between nodes. . The live recording […]
Data Engineer’s Lunch #59: Spark Tasks and Distribution Read More »
In Data Engineer’s Lunch #54: dbt and Spark, we discussed the data build tool, a tool for managing data transformations with config files rather than code. We connected it to
Data Engineer’s Lunch #54: dbt and Spark Read More »
In Apache Cassandra Lunch #95: Spark Graph Operations with DSEGraphFrames Scala API, we discussed methods for processing Graph database data using Apache Spark. Specifically, we discussed the DSEGraphFrames library which
Apache Cassandra Lunch #95: Spark Graph Operations with DSEGraphFrames Scala API Read More »
In Apache Cassandra Lunch #79: Cassandra API in Cosmos DB, we discussed Cosmos DB and it’s relationship to Cassandra. Specifically, we discussed the Cosmos DB Cassandra API, and how it
Apache Cassandra Lunch #79: Cassandra API in Cosmos DB Read More »
In Data Engineer’s Lunch #45: Apache Livy, we discussed Apache Livy, a REST API for interacting with Spark Clusters. It also helps with submitting jobs and managing Spark Contexts and
Data Engineer’s Lunch #45: Apache Livy Read More »
In Apache Cassandra Lunch #65: Spark Cassandra Connector Pushdown, we discussed Spark predicate pushdown in the context of the Spark Cassandra connector. The live recording of Cassandra Lunch, which includes
Apache Cassandra Lunch #65: Spark Cassandra Connector Pushdown Read More »
