Search
Close this search box.

Asynchronous Data Processing

The state of the world’s information systems are changing and so should your data processing habits. As the cloud takes precedence in IT environments, different systems that run the modern enterprise are not on the same network or system. These systems have data that business users need to leverage on a day to day and sometimes on an immediate basis.

As big data evolves, we have seen movements from batch processing to micro-batches, to stream processing. All of this is great but folks still need to connect the internet together somehow to access the data.

 

2016-07-13 19.21.22

This presentation was delivered by CEO, Rahul Singh, at The George Washington University to the Data Wranglers DC Meetup on data processing. It outlines the challenge of the current state of business and explains that asynchronous processing is the way to manage the growing sources and volume of business information.

The discussion outlined four main points:

• Thoughts of why “Asynchronous” is the Future

• Discussion about Batch, Micro-Batch, Streaming

• Difference between a Queue / Enterprise Service Bus

• Proposed Architecture for Asynchronous Data Processing

 

Take a look at the slide presented below.

 

Data Wranglers DC is a professional group that meets monthly to discuss topics including open data, data gathering, data munging, and the creation, storage and maintenance of datasets. We combine presentations with hands-on workshops, always seeking to make our data munging lives easier. No experience necessary – just bring your interest.