In Apache Cassandra Lunch #72: Databricks and Cassandra, we discussed how we can connect Databricks and Cassandra. The live recording of Cassandra Lunch, which includes a more in-depth discussion and a demo, is embedded below in case you were not able to attend live. If you would like to attend Apache Cassandra Lunch live, it is hosted every Wednesday at 12 PM EST. Register here now!
In Apache Cassandra Lunch #72: Databricks and Cassandra, we discussed how we can connect Databricks and Cassandra. We also included a live demo to show you how you can use a Databricks notebook to talk to a Cassandra instance in the cloud. We used DataStax Astra as our Cassandra instance so that way you can try this demo yourself without having to install anything to your local environment. The live demo is embedded below so be sure to check it out!
If you are not familiar with Databricks, it is a unified data analytics platform in the cloud for massive-scale data engineering and collaborative data science. Databricks does provide a free community edition, but there are some limits on features (more on that here). Databricks allows for large-scale data processing for batch and streaming workloads, enabling analytics on the most complete and recent data, simplifying and accelerating data science on large datasets, and standardizing ML lifecycle from experimentation to production.
Databricks adds enterprise-grade functionality to the innovations of the open-source community. As a fully managed cloud service, they handle your data security and software reliability; as well as, have unmatched scale and performance of the cloud. Databricks is rooted in open-source as their platform includes technologies such as Apache Spark, Delta Lake, and MLflow, which were originally created by the founders of Databricks. The Databricks platform also includes TensorFlow, Redash, and R.
If you are interested in any of our other talks on Databricks, they can be found here:
- Databricks and Apache Spark
- Data Engineer’s Lunch #42: Introduction to Databricks
- Databricks and DataStax Astra: Connecting Databricks and DataStax Astra
- Databricks and DataStax Astra: Running a Databricks Notebook Against Astra
If you missed Apache Cassandra Lunch #72: Databricks and Cassandra live, it is embedded below! Additionally, all of our live events can be rewatched on our YouTube channel, so be sure to subscribe and turn on your notifications!
Cassandra.Link is a knowledge base that we created for all things Apache Cassandra. Our goal with Cassandra.Link was to not only fill the gap of Planet Cassandra but to bring the Cassandra community together. Feel free to reach out if you wish to collaborate with us on this project in any capacity.
We are a technology company that specializes in building business platforms. If you have any questions about the tools discussed in this post or about any of our services, feel free to send us an email!