We are a DevOps and Amazon Web Services (AWS) Professional Services Consultancy based in London. We build secure bespoke automated big data platforms on AWS using open source tooling, helping businesses to extract value from their data in the most cost effective and agile way. We provide self service tooling to enable business workflows to make data driven decisions.
To help you understand and harness the power of event driven architectures, we propose to deliver a 2 day workshop to cover the architecture, data model and roadmap for the secure deployment of Kafka. The workshop is not purely a technical exercise. It will cover people and process aspects of how Kafka can be consumed at scale throughout the organisation. Documentation is a large part of the workshop and will be delivered after the engagement.
Following the workshop, recommendations will be provided, adding depth to the findings where requested by senior stakeholders. By applying OSO DevOps proven agile methodology, the overall risk will be reduced to a clear set of deliverables, drawing on our high performing team of experts.
| Day 1 | ||
|---|---|---|
| Time | Topic | Output |
| 09:30 - 10:00 | Introduction to Apache Kafka and event-driven architectures. | |
| 10:00 - 12:00 | Capture current architecture practices, standards:
|
Captured line items, weighted in terms of relevance to following activities. A list of assumptions together with priorities and timeframes. |
| 12:00 - 12:45 | Lunch break. | |
| 12:45 - 15:00 | Enumerate Kafka ecosystems pros / cons and features required.
|
Capture scoring and the qualified recommended solution (and gaps) for production and pre-prod. Implement a high level plan proposal / steps / timelines with dependency tracking. |
| 15:00 - 15:30 | Break. | |
| 15:30 - 16:30 | Identify high level requirements:
|
High level strawman deployment architecture for all none-production and production environments |
| Day 2 | ||
|---|---|---|
| Time | Topic | Output |
| 09:30 - 10:00 | Review of Day 1, the outputs and assumptions captured. | |
| 10:00 - 10:30 | Educational session on Kafka in production:
|
|
| 10:30 - 11:00 | Education session on DevOps in distributed architecture:
|
|
| 11:00 - 12:00 | Capture operational infrastructure and processes:
|
Map onto the recommended Kafka ecosystem. Recommended operational tooling implementation plan proposal / steps / timeline. |
| 12:00 - 12:45 | Lunch break. | |
| 12:45 - 13:15 | Identify and scoping development requirements:
|
Strawman development architecture and tooling. Recommended operational tooling & implementation plan proposal / steps / timeline. |
| 13:15 - 15:45 | Use case modeling:
|
Capture and document findings. Provide high-level data-flow model. Recommended deployment and implementation plan proposal / steps / timeline for testing and productionisation. |
| 15:45 - 16:00 | Break. | |
| 16:00 - 17:00 | Initial planning activity dependency mapping and feedback:
|
Dependency flow of activities broken down as work package activities |
OSO DevOps can typically initiate a full workshop team within 1-2 weeks, but can often mobilise teams faster. OSO DevOps will select the following resources for this project:
Neil Avery has over 25 years of commercial software development. Recently he worked at the Office of the CTO within Confluent to help shape the future direction of Kafka and Streaming in general. He has been instrumental in developing KSQL and Kafka Streams as well as helping large organisations understand how Kafka is adopted at scale. His blog series Journey to event driven has helped shape mindset and understanding of what Kafka adoption means. Recently, authoring the Kafka Transport binding for CloudEvents 1.0 and also has a keen interest in Cloud, serverless and the next generation of technology (quarkus).
Sion Smith has over 18 years of commercial software development experience and twelve years experience with Java and the Spring Framework. His focus and experience are predominantly in the financial services sector, gaining expert knowledge of the Spring Boot and Kafka framework. Experienced in event-driven programming principles, using a mixture of open source and Confluent Kafka.
The 2 day workshop provides a strategic advantage and increases the successful adoption of Kafka at scale. We tailor each workshop to the needs of the client, in our experience, 90% of organisations participating in the workshop proceed with the recommendations.
Have any questions? Require a sample of the workshop outputs? Email us [email protected] or schedule a call