Distributed and replicated for high traffic and availability. Queues or streams are distributed or sharded for high traffic and availability. Stream processing should be distributed for
computational scale, speed, and availability.
Data storage should respond to all read and write requests at high speeds.
Queues should respond to all read and write requests at high speeds, without bottlenecks.
Stream processing should handle queue processing and data storage/retrieval at high speeds, without bottlenecks
Cloud native software, platforms, and infrastructures should be leveraged if and only if they can be extended through APIs or modules.
Alternatively commercial open source software or platforms should be leveraged for ultimate portability and no vendor lockin.
Pure open source should be used if no commercial or cloud options are available either as a managed service or as a commercially supported offering.
Development Operations (DevOps) should be implemented for continuous integration and continuous delivery (CICD).
Data Operations (DataOps) should be implemented for automated data pipeline management.
All infrastructure, software configuration, and software maintenance should be automated.
All systems should have baseline service levels that are monitored as metrics.
All systems should emit logs that are configurable at different levels.
All systems logs should be aggregated and retained in an index for quick correlation and investigation.
We are a technology company that specializes in building business platforms. If you have any questions about the tools discussed in this post or about any of our services, feel free to send us an email!