Migration - AMQ to Kafka

sector:
Finance

A live system with an ActiveMQ message provider was struggling with high volumes and reliability.  The Architectural preference from the company was to upgrade to Kafka. 

Two goals: Firstly demonstrate that Kafka could overcome the current system limitations. Secondly, the system was to be upgraded without any disruption to the user experience.

How Lydtech Helped

A rigorous evaluation of Kafka to determine correct fit. Researching the client’s requirements for the event driven system in order to ascertain whether Kafka would be the right technology choice.

Parallel execution of messaging technologies.    Performance testing.  Validation of resilience capabilities during failure scenarios.

Successfully demonstrated zero message loss and successful message deduplication.  Confirmed that the resilience and performance non-functional requirements would be satisfied.

Outcomes
  • Comprehensive Migration Plan - Clear communication with project stakeholders re scope, timescales and impact of the work. 
  • Testing Driven - A comprehensive testing approach throughout the project ensured no unexpected surprises.  
  • Zero Downtime - The messaging broker was successfully migrated. No downtime in Production. No message loss. No disruption to system users