Data Engineer - Contractor

Company Description

Civica's Central Government & Defence (CGD) business helps government organisations transform the services that matter most. We design, build and manage secure digital services, data platforms and modern applications that improve outcomes for citizens and public servants. Combining public sector expertise with capabilities in digital, data, AI and cloud, we work alongside our clients to deliver intelligent solutions and lasting impact.

Travel Requirements:

• 4 days per week in London

Requirements

Key Responsibilities

Data engineering and product delivery

• Design, build and deliver new data products in response to operational needs in DV cleared environment
• Develop, maintain and improve data pipelines.
• Use predominantly open-source technologies to create practical data solutions.
• Build solutions from the ground up within short and potentially changing delivery timescales.
• Contribute to data cataloguing and the effective organisation of data assets.
• Adapt designs and engineering priorities when operational requirements change.

Platforms and engineering practices

• Contribute to the platform and infrastructure supporting data products.
• Work in Linux or Unix environments.
• Apply continuous integration and continuous delivery practices.
• Use containerisation and orchestration technologies when developing and deploying solutions.
• Support engineering within an Azure Stack Hub environment.
• Evaluate or work with emerging technologies where relevant, including pipeline orchestration and graph database tools.

Collaboration and assurance

• Work closely with colleagues across data architecture, governance and data quality.
• Explain technical solutions clearly to both technical and non-technical audiences.
• Communicate what has been developed, why it has been developed and how it works.
• Provide appropriate assurance that builds trust in the team’s data products.
• Report progress, risks and delivery information clearly and concisely.
• Contribute accurate and timely information to team reporting.

Delivery and professional responsibility

• Work effectively in a fast-paced environment where priorities may change.
• Meet firm deadlines and take ownership of agreed deliverables.
• Remain calm, composed and credible when working under pressure.
• Apply sound judgement to work that may have operational consequences.
• Engage constructively with the purpose and context of defence-related work.

Essential Competencies

• Demonstrable experience building data products and data pipelines.
• Strong experience using open-source technologies in data engineering.
• Understanding of platform or infrastructure considerations relevant to data engineering.
• Experience with continuous integration and continuous delivery practices.
• Ability to work successfully in a fast-changing environment and alter direction when priorities change.
• Ability to deliver against short, firm deadlines.
• Clear, concise written and verbal communication.
• Ability to explain technical solutions to non-technical stakeholders.
• Ability to communicate the rationale, approach and assurance behind an engineering solution.
• Calmness, composure and sound judgement under pressure.
• Proactive approach and willingness to learn unfamiliar technologies.
• Previous experience working in defence, national security, intelligence or a sufficiently similar environment.
• Familiarity with defence terminology and ways of working, sufficient to operate credibly without extensive introductory training.
• Willingness to work in a role whose outputs may have operational consequences.

Technologies, Methodologies and Frameworks

Essential

• Python
• Open-source data engineering technologies
• Data pipeline development
• Linux or Unix
• Continuous integration and continuous delivery
• Containerisation
• Kubernetes

Preferred

• Apache Airflow
• OpenSearch
• Azure
• Azure Stack Hub
• Apache Kafka
• Data cataloguing tools and practices
• Apache NiFi
• Graph databases

Benefits

As a company, we're passionate about what we do and the citizens we serve. If you, too, want to champion the use of

At Civica, we are committed to building an inclusive and diverse workplace where everyone feels valued and supported. We believe that a variety of perspectives drives innovation and excellence, and we welcome applicants from all backgrounds, cultures, and experiences.

We are an equal opportunity employer. We do not discriminate based on race, ethnicity, religion, gender, sexual orientation, disability, age, or any other legally protected characteristic. Our recruitment process is designed to ensure fairness and transparency, so every candidate has an equal chance to contribute to our mission.

If you need any adjustments or accommodations to participate in our recruitment process, please let us know. We are here to support you.