Covid 19 response - NIAXO & JBC

Lydtech

Sector

Government

The Client

NIAXO working on behalf of the Joint Biosecurity Centre (JBC) Data analytics science hub Covid-19 pandemic

Deliverables

    CI/CD, Infrastructure as Code (IAC), AWS, Lambda, Automated test harness, Event Driven Consistency - Resilience changes to ensure strict ordering and predictability in event flow

The Challenge

To develop a reproducible deployment capability for a system which was key to navigating through the pandemic

The Covid-19 pandemic caught everyone by surprise, and the initial scramble to monitor and predict the impacts on our society led to a rapidly evolving situation with fluid requirements. The goal was to identify the critical data feeds and sub-systems, and ensure these could be recreated in the event of a failure. It was also a goal that new requirements would be captured and applied to the systems using the same processes as the recovery mechanism

Our brief was to ensure that systems essential to the data scientists could be quickly and reliably recreated via an automated recovery process that would minimise operational disruptions in the event of a disaster

Experienced Agile and Test Driven Approach

Creation of a test harness derived from live system functionality, treating the system as a black box allowed the existing system to be validated, but equally important is that this test harness was integrated into the development pipelines

As the IAC capability increased, more sections of the test suite were enabled. Project visibility - progress comparable against live systems test framework

Each environment was created and updated using the same IAC under development. Adding a new environment to facilitate parallel development was a simple configuration exercise

Simulators were created for the more complex 3rd party systems. Simulators offer lightweight and flexible alternatives to the real implementations, making them ideal for development and exercising failure scenarios. The use of simulators facilitated the parallel and iterative delivery of the pipeline, allowing an experience of the final solution prior to the completion of the project, removing obstacles which would otherwise block development. Such are the benefits of simulators they remain fundamental pieces of the development process

Incremental Delivery

No big bang deployment. Completed features were integrated into the live pipelines. Lambda deployments, system configurations, permission changes, dataset input validation and scanning

Team Integration

Establishing successful teams requires the right blend of personnel and skills. The ask from the end client was multi-faceted so we created agile pods to form teams from Lydtech and client. The pods empower the teams to make progress and facilitate parallel development. The fast, productive, and highly collaborative relationship formed within these teams meant that there was a seamless integration with the NIAXO team, this contributed to a productive and friendly working relationship, increasing learning and education for all involved


What they said

Threat Intelligence Lead

Just wanted to say thank you for providing all the info and the attack maps for us. It’s rare we get this level of info back and its clear you’ve put a lot of effort into the attack maps, so just wanted to say a genuine thank you from me! This is really useful stuff!

The Outcomes

System Restoration

System recreation was achieved when provided with an environment. Operational environment updates applied via automation

System Validation and Verification to ensure reliable data

The resulting automated systems resulted in the creation, repair, and updates to the live systems relied upon by Data scientists during the Covid-19 pandemic

Parallel Development Enabler

Multiple environments running in parallel became the norm during and after the project