Search
Close this search box.
Contact Us

Share your passion for data!

Build your confidence, strenghten your network business connections and exchange best practice knowledge in the community by being a public speaker in your field!

 

We are looking for guest speakers at #DataEngineersLunch and #CassandraLunch!

 

If you are experienced in #ETL, #datawrangling, etc, and are interested in joining our events, please fill out this form and we will reach out to you ASAP!

Data Engineer’s Lunch

Speak at Data Engineer’s Lunch happening every Monday!

Apache Cassandra Lunch

Speak at Apache Cassandra Lunch happening every Thursday!

Become a guest speaker at Data Engineer’s Lunch!

Become a
guest speaker at
Data Engineer’s Lunch!

If you want to submit to speak at Cassandra Lunch, please check the following requirements:
Step 1: Please check the following requirements:
The session must be in English.
Session length will be 60 minutes.
Sessions will be online (via Zoom).
Step 2: Please fill out the form below:

Become a guest speaker at Cassandra Lunch!

Become a
guest speaker at
Cassandra Lunch!!

If you want to submit to speak at Cassandra Lunch, please check the following requirements:
Step 1: Please check the following requirements:
The session must be in English.
Session length will be 60 minutes.
Sessions will be online (via Zoom).
Step 2: Please fill out the form below:

« All Events

  • This event has passed.

Automating Data Operations for Apache Cassandra with Apache Airflow

December 7, 2022 @ 11:00 am - 12:00 pm

We’ll go over automating Data Operations/Spark Processes with Cassandra with Airflow and provide a hands-on demonstration on Gitpod.

Most Cassandra administrators have to import / export data as part of their Database Administrator role. Being Cassandra Admin, this means at least knowing Spark, DSBulk, etc. Wouldn’t it be cool to automate these processes and allow a self-service option? This talk will go over automating Data Operations / Spark Processes with Cassandra with Airflow and provide a hands-on demonstration on Gitpod with Astra so everyone can try it out.

Take Aways:

  • Learn how Apache Airflow, Apache Spark, and Apache Cassandra can be used together for DataOps
  • Learn how Airflow can wrap complex Import/Export/ETL Spark jobs in a GUI for users
  • Learn how to delete data in Cassandra with Apache Spark
  • Hands-on: Create Tables/Keyspaces in Cassandra/Astra
  • Hands-on: Extract / Load data from a CSV file into Cassandra table
  • Hands-on: Transform data from Cassandra table into another Cassandra table

Ref:

  • https://github.com/Anant/example-cassandra-etl-with-airflow-and-spark
  • https://github.com/Anant/example-cassandra-presto-airflow

Details

Date:
December 7, 2022
Time:
11:00 am - 12:00 pm
Website:
https://www.eventbrite.com/e/automating-data-operations-for-apache-cassandra-with-apache-airflow-tickets-469243268247

Organizer

Anant

Anant Corp

Anant inspires Chief Officers with best practices & patterns.

Helps them make decisions through evaluations & profiles.

Empowers them with plans & tools to take action to build their business platforms.

Anant Corp
In this comprehensive session, we dive deep into DuckDB, a cutting-edge, open-source analytical database that operates in-process, making it incredibly fast and efficient for data wrangling tasks. DuckDB stands out in the world of databases due to its unique architecture, which allows it to function without the need for a traditional client-server setup. This talk begins with an overview of DuckDB’s capabilities and then transitions into a hands-on exploration of how it can be used to wrangle complex datasets with ease. We'll discuss the advantages and limitations of using an embedded SQL database like DuckDB compared to more traditional client-server architectures, helping you understand when and why DuckDB might be the best tool for your data processing needs. The session culminates in a live demonstration where we put DuckDB to the test, benchmarking its performance against other popular data processing systems. Whether you're a data professional looking to streamline your workflows or simply curious about emerging database technologies, this talk offers valuable insights and practical knowledge. Bio: Will Angel is the Data Analytics Capability Lead at Excella, where he spearheads data teams to help clients navigate and solve their most complex data challenges. He is the author of Virtual Power: The Future of Energy Flexibility and plays a pivotal role in the data community as an organizer for the Data Visualization DC and Full Stack Data Science DC Meetups. Additionally, Will serves as the executive director of Data Community DC, a nonprofit dedicated to advancing data education in the national capital area. Outside of his professional endeavors, Will indulges in wildlife photography, gardening, reading, cooking, art, DIY electronics, and traveling. Learn more about his work at www.williamangel.net. Accompanying Slides: coming soon Sign Up For Our Newsletter: http://eepurl.com/grdMkn Join Data Engineer’s Lunch Weekly at 12 PM EST Every Monday: https://www.meetup.com/Data-Wranglers-DC/events/ Cassandra.Link: https://cassandra.link/ Follow Us and Reach Us At: Anant: https://www.anant.us/ Awesome Cassandra: https://github.com/Anant/awesome-cassandra Email: solutions@anant.us LinkedIn: https://www.linkedin.com/company/anant/ Twitter: https://twitter.com/anantcorp Eventbrite: https://www.eventbrite.com/o/anant-1072927283 Facebook: https://www.facebook.com/AnantCorp/ Join The Anant Team: https://www.careers.anant.us #data #dataengineering #graphql #supergraph
Data Engineer's Lunch: Wrangling Data with DuckDB
In this illuminating talk, "What are Semantic Layers and How Dremio's Semantic Layer Empowers Data Lakehouses," Dremio Senior Evangelist, Alex Merced, will delve into the concept of the Semantic Layer and its transformative impact on data management. Alex will explain how a Semantic Layer can be utilized to define views and metrics that encapsulate your business logic, ensuring consistency and clarity across your data ecosystem. Attendees will learn about the integration of Semantic Layers within data lakehouse platforms, focusing on how Dremio's Semantic Layer enhances data accessibility and usability. By coupling a Semantic Layer with a powerful data lakehouse platform like Dremio, organizations can achieve unparalleled efficiency and insight, transforming raw data into actionable intelligence effortlessly. Alex will provide practical examples and strategies for leveraging Dremio's Semantic Layer to simplify data workflows, promote data governance, and empower business users with self-service analytics. This talk is a must for data professionals aiming to elevate their data lakehouse capabilities and drive business success through sophisticated data strategies. Accompanying Slides: coming soon Sign Up For Our Newsletter: http://eepurl.com/grdMkn Join Data Engineer’s Lunch Weekly at 12 PM EST Every Monday: https://www.meetup.com/Data-Wranglers-DC/events/ Cassandra.Link: https://cassandra.link/ Follow Us and Reach Us At: Anant: https://www.anant.us/ Awesome Cassandra: https://github.com/Anant/awesome-cassandra Email: solutions@anant.us LinkedIn: https://www.linkedin.com/company/anant/ Twitter: https://twitter.com/anantcorp Eventbrite: https://www.eventbrite.com/o/anant-1072927283 Facebook: https://www.facebook.com/AnantCorp/ Join The Anant Team: https://www.careers.anant.us #data #dataengineering #graphql #supergraph
Data Engineer's Lunch: Semantic Layers and How Dremio's Semantic Layer Empowers Data Lakehouses
In this session, learn about Amazon managed database services and their capability to build resilient data architecture with Amazon Senior Database Solutions Architect Saikat Banerjee and integration partner Sujan Kumar Ghosh. Amazon Relational Database Service (Amazon RDS) is an easy-to-manage relational database service optimized for total cost of ownership. It is simple to set up, operate, and scale with demand. Amazon RDS automates the undifferentiated database management tasks, such as provisioning, configuring, backups, and patching. Amazon Aurora provides unparalleled high-performance and availability at global scale with full MySQL and PostgreSQL compatibility, at 1/10th the cost of commercial databases. Aurora has 5x the throughput of MySQL and 3x of PostgreSQL. Amazon DynamoDB is a serverless, NoSQL database service that enables you to develop modern applications at any scale. As a serverless database, you only pay for what you use and DynamoDB scales to zero, has no cold starts, no version upgrades, no maintenance windows, no patching, and no downtime maintenance. The AWS Shared Responsibility Model for resilience is a critical concept defining the distribution of responsibilities between AWS and customers. In this session, dive deep into the fault tolerance and disaster recovery capabilities available in the above mentioned database services. Leveraging these and following best practices you can reduce outage to your mission critical applications, improve customer experience and keep your applications available during various planned and unplanned downtime scenarios. Join us to learn how you can meet your RTO/RPO requirements by effectively designing your database architecture. Accompanying Slides: coming soon Sign Up For Our Newsletter: http://eepurl.com/grdMkn Join Data Engineer’s Lunch Weekly at 12 PM EST Every Monday: https://www.meetup.com/Data-Wranglers-DC/events/ Cassandra.Link: https://cassandra.link/ Follow Us and Reach Us At: Anant: https://www.anant.us/ Awesome Cassandra: https://github.com/Anant/awesome-cassandra Email: solutions@anant.us LinkedIn: https://www.linkedin.com/company/anant/ Twitter: https://twitter.com/anantcorp Eventbrite: https://www.eventbrite.com/o/anant-1072927283 Facebook: https://www.facebook.com/AnantCorp/ Join The Anant Team: https://www.careers.anant.us #data #dataengineering #graphql #supergraph
Data Engineer's Lunch: Build Resilient Data Architecture with Amazon RDS, Aurora and DynamoDB
Join Dremio Senior Evangelist, Alex Merced, for a deep dive into the innovative world of Dremio's Apache Iceberg powered Reflections in his talk, "Dremio's Apache Iceberg Powered Reflections: Query Acceleration Deep Dive." In this session, Alex will unravel the mechanics behind Dremio's reflections, a groundbreaking feature that transcends traditional materialized views and cubes to deliver seamless and transparent query acceleration. Alex will explain how Reflections leverage the power of Apache Iceberg to optimize data queries, significantly enhancing performance without the complexities usually associated with query optimization. Attendees will gain insights into the inner workings of Reflections, understanding how they automatically adapt to changing data and workloads to provide consistent, lightning-fast query responses. This talk is essential for data engineers, analysts, and architects looking to harness the full potential of Dremio and Apache Iceberg for efficient and effective data querying. Discover how to simplify your data infrastructure and accelerate your analytics with Dremio's innovative approach to query optimization. Accompanying Slides: coming soon Sign Up For Our Newsletter: http://eepurl.com/grdMkn Join Data Engineer’s Lunch Weekly at 12 PM EST Every Monday: https://www.meetup.com/Data-Wranglers-DC/events/ Cassandra.Link: https://cassandra.link/ Follow Us and Reach Us At: Anant: https://www.anant.us/ Awesome Cassandra: https://github.com/Anant/awesome-cassandra Email: solutions@anant.us LinkedIn: https://www.linkedin.com/company/anant/ Twitter: https://twitter.com/anantcorp Eventbrite: https://www.eventbrite.com/o/anant-1072927283 Facebook: https://www.facebook.com/AnantCorp/ Join The Anant Team: https://www.careers.anant.us #data #dataengineering #graphql #supergraph
Data Engineer's Lunch: Dremio's Apache Iceberg Powered Reflections: Query Acceleration Deep Dive
Enterprise Architect Nicholas Brackley discusses the function of Generative AI systems under the hood. We often treat LLMs as though they are black boxes. We give the LLM a prompt and we get it a response. LLMs are just like any other software system. They are composed of discrete elements that we need to understand in order to bring the most benefit to our enterprises. In this talk, we’ll discuss some intermediate patterns for Generative AI systems and address what the LLM actually is, and how that knowledge matters for more complicated use cases. We’ll provide some clear definitions for some of the most critical terms in Gen AI; we’ll provide some discussion about the current environment of the Gen AI ecosystem. If you want to better understand the world of LLMs - not just what they do, but what they are, this is the right talk for you! Accompanying Slides: Sign Up For Our Newsletter: http://eepurl.com/grdMkn Join Data Engineer’s Lunch Weekly at 12 PM EST Every Monday: https://www.meetup.com/Data-Wranglers-DC/events/ Cassandra.Link: https://cassandra.link/ Follow Us and Reach Us At: Anant: https://www.anant.us/ Awesome Cassandra: https://github.com/Anant/awesome-cassandra Email: solutions@anant.us LinkedIn: https://www.linkedin.com/company/anant/ Twitter: https://twitter.com/anantcorp Eventbrite: https://www.eventbrite.com/o/anant-1072927283 Facebook: https://www.facebook.com/AnantCorp/ Join The Anant Team: https://www.careers.anant.us #data #dataengineering
Data Engineer's Lunch 113: GenAI Under the Hood: How it Works
0:00 - Anant intro 3:14 - Alex intro 5:52 - What is a Data Lakehouse 11:09 - Apache Iceberg 15:43 - The Role of a Data Catalog 21:06 - Iceberg REST Catalog Spec 27:00 - REST Catalog Spec Ecosystem 29:09 - Exercises and Resources 31:05 - Q+A and wrap up In this insightful session, "Apache Iceberg REST Catalog: Making Catalog Interoperability Happen," Dremio Senior Evangelist Alex Merced takes you on a journey through the evolution of Apache Iceberg catalogs. Alex will explore the transformative impact of the Apache Iceberg REST Catalog specification, detailing how it fosters greater compatibility and interoperability with various tools across the data ecosystem. Attendees will comprehensively understand the challenges associated with disparate catalog systems and how the REST Catalog Interface effectively addresses these issues. By standardizing catalog interactions, the REST Catalog specification enhances the robustness and flexibility of the Iceberg ecosystem, enabling seamless integration and management of diverse data sources. Alex will also discuss real-world applications and best practices for leveraging the REST Catalog to optimize data workflows and improve operational efficiency. This talk is a must-attend for data engineers, architects, and practitioners eager to enhance their Iceberg implementations and drive forward the capabilities of their data platforms. Accompanying Slides: https://drive.google.com/drive/folders/16xtuqsY7L4qqxhizOyYoKSnR-nHlWZTf Sign Up For Our Newsletter: http://eepurl.com/grdMkn Join Data Engineer’s Lunch Weekly at 12 PM EST Every Monday: https://www.meetup.com/Data-Wranglers-DC/events/ Cassandra.Link: https://cassandra.link/ Follow Us and Reach Us At: Anant: https://www.anant.us/ Awesome Cassandra: https://github.com/Anant/awesome-cassandra Email: solutions@anant.us LinkedIn: https://www.linkedin.com/company/anant/ Twitter: https://twitter.com/anantcorp Eventbrite: https://www.eventbrite.com/o/anant-1072927283 Facebook: https://www.facebook.com/AnantCorp/ Join The Anant Team: https://www.careers.anant.us #data #dataengineering #graphql #supergraph
Data Engineer's Lunch: Apache Iceberg REST Catalog: Making Catalog Interoperability Happen
We continue our investigation into the latest advancements in language model technology with our upcoming talk, "QLoRA vs RAG: an Evaluation." In this session, we compare outcomes from two cutting-edge techniques used in enhancing the capabilities of the Llama 2 model we fine-tuned in the last few talks and Retrieval Augmented Generation (RAG). Obioma Anomnachi will continue to explore how each method connects to the Llama 2 model, emphasizing their respective impacts on performance through the lens of industry-standard statistical measures. Attendees will gain an understanding of: The fundamentals of QLoRA and RAG: Learn how each technique functions, their applications, and their theoretical foundations. Check out our earlier talks in this series for a more in-depth description of this talk. Performance Evaluation: We will dissect the performance of our fine-tuned Llama 2 model with QLoRA against its performance with RAG, utilizing robust statistical methods to assess accuracy, relevance, and efficiency. Practical Implications: Discover the real-world implications of each method in various applications, from academic research to industry deployments. Future Directions: Discuss potential advancements and how these technologies could shape the future of natural language processing and AI. This talk is designed for data scientists, AI researchers, and anyone interested in the technical aspects of language model development and performance enhancement. Whether you're looking to implement these techniques or simply curious about the state of AI technology, this session will provide valuable insights into two important and common deployments in the field. Slides: https://www.slideshare.net/slideshow/llm-fine-tuning-with-qlora-cassandra-lunch-4-presented-by-anant/269651985 Repo: https://github.com/Anant/llm-fine-tuning-qlora Check out the previous videos in this series below: https://www.youtube.com/live/qVYa0GFAvzI?si=-VA7dtwIFo1N4c2G https://www.youtube.com/live/0nwIjnk3VEo?si=4FSkZnjCLopX3GxV https://www.youtube.com/live/2obLB7OYn8c?si=0NooTV-fR1c0-5L9
Cassandra Lunch #140: QLoRA vs RAG - an Evaluation
In this talk, we are excited to welcome Ryan Day, an An Advanced Data Scientist with the Conference of State Bank Supervisors who'll be talking to us about developing APIs for Data Scientists. Data scientists and machine learning engineers are an important and growing API user base. But they’re not just another set of software developers – they have unique goals and tools. Ryan Day, author of O’Reilly’s Hands-On APIs for AI and Data Science (May 2025), will share practical tips for making APIs that data scientists will love. Ryan will give a tour of the tasks that data scientists perform and the tools they use, with an emphasis on the Python ecosystem. Then he will demonstrate how to implement a data scientist-friendly API using the Python frameworks FastAPI, SQLAlchemy, and Pydantic. We are also thrilled to be able to offer an exclusive giveaway to 10 attendees at the event. If your name is selected, you will receive a free O-Reilly e-book of your choice! Many thanks to Ryan for this opportunity! Check out the upcoming book at: https://hands-on-api-book.com/ ! Accompanying Slides: coming soon Sign Up For Our Newsletter: http://eepurl.com/grdMkn Join Data Engineer’s Lunch Weekly at 12 PM EST Every Monday: https://www.meetup.com/Data-Wranglers-DC/events/ Cassandra.Link: https://cassandra.link/ Follow Us and Reach Us At: Anant: https://www.anant.us/ Awesome Cassandra: https://github.com/Anant/awesome-cassandra Email: solutions@anant.us LinkedIn: https://www.linkedin.com/company/anant/ Twitter: https://twitter.com/anantcorp Eventbrite: https://www.eventbrite.com/o/anant-1072927283 Facebook: https://www.facebook.com/AnantCorp/ Join The Anant Team: https://www.careers.anant.us #data #dataengineering #graphql #supergraph
Data Engineer's Lunch 111: How to build an api that data scientists love
In this hands-on workshop, participants will embark on a journey to construct their very own data lakehouse platform using their laptops. The workshop is designed to introduce and guide through the setup and utilization of three pivotal tools in the data lakehouse architecture: Dremio, Nessie, and Apache Iceberg. Each of these tools plays a crucial role in enabling the flexibility of data lakes with the efficiency and ease of use of data warehouses, aiming to simplify and economize data management. Participants will start by setting up a Docker environment to run all necessary services, including a notebook server, Nessie for catalog tracking with Git-like versioning, Minio as an S3-compatible storage layer, and Dremio as the core lakehouse platform. The workshop will provide a practical, step-by-step guide to federating data sources, organizing and documenting data, and performing queries with Dremio; tracking table changes and branching with Nessie; and creating, querying, and managing Apache Iceberg tables for an ACID-compliant data lakehouse. Prerequisites for the workshop include having Docker installed on your laptop. Attendees will be taken through the process of creating a docker-compose file to spin up the required services, configuring Dremio to connect with Nessie and Minio, and finally, executing SQL queries to manipulate and query data within their lakehouse. This immersive session aims not just to educate but to empower attendees with the knowledge and tools needed to experiment with and implement their data lakehouse solutions. By the end of the workshop, participants will have a functional data lakehouse environment on their laptops, enabling them to explore further and apply what they have learned to real-world scenarios. Whether you're looking to improve your data management strategies or curious about the data lakehouse architecture, this workshop will provide a solid foundation and practical experience. Accompanying Slides: coming soon! Sign Up For Our Newsletter: http://eepurl.com/grdMkn Join Data Engineer’s Lunch Weekly at 12 PM EST Every Monday: https://www.meetup.com/Data-Wranglers-DC/events/ Cassandra.Link: https://cassandra.link/ Follow Us and Reach Us At: Anant: https://www.anant.us/ Awesome Cassandra: https://github.com/Anant/awesome-cassandra Email: solutions@anant.us LinkedIn: https://www.linkedin.com/company/anant/ Twitter: https://twitter.com/anantcorp Eventbrite: https://www.eventbrite.com/o/anant-1072927283 Facebook: https://www.facebook.com/AnantCorp/ Join The Anant Team: https://www.careers.anant.us #data #dataengineering #datalakehouse #workshop #handson
Data Engineer's Lunch 110: Building a Data Lakehouse on your Laptop Workshop
Load More... Subscribe

Join Our Newsletter!

Sign up below to receive email updates and see what’s going on with our company.

CONTACT INFO

  • 3 Washington Circle NW Suite 301 - Washington, D.C. 20037
  • support@anant.us
  • (855) 262-6826

RESOURCES

PROPERTIES

FOLLOW US

2022 Anant Corporation, All Rights Reserved.
All logos, trademarks and registered trademarks are the property of their respective owners.