Data Engineer

Description & Requirements

On behalf of Department of Business and Trade, we are looking for a Data Engineer Inside IR35 for a 6 month contract based Hybrid London, Cardiff, Edinburgh, Belfast , Manchester, Birmingham, Darlington

As a Data Engineer , your main responsibilities will be:

SC/DV Clearance is an essential requirement for this role, as a minimum you must be willing & eligible to undergo checks. Please note, due to the exceptional requirements of this position (short-term nature of this role and speed at which we require a postholder in situ) preference may be given to candidates who meet all of the essential criteria and hold active security clearance.

Key Responsibilities

• Assess and define requirements for data engineering activities across the MoG programme
• Design and develop scalable ETL/ELT data pipelines
• Support the implementation and enhancement of data platform components
• Deliver and maintain data integrations and APIs
• Build and optimise AI data feeds and training data pipelines
• Improve and maintain data quality, validation, and trust frameworks
• Develop automation scripts to support engineering and operational processes
• Create monitoring solutions and operational dashboards
• Implement data security, governance, and compliance controls
• Produce high-quality technical documentation and reusable engineering assets
• Contribute to discovery activities, technical assessments, and effort estimation

Essential Skills & Experience

• Strong commercial experience as a Data Engineer
• Excellent knowledge of ETL/ELT pipeline development
• Strong Python and SQL skills
• Experience working with cloud-based data platforms
• Proven experience designing and building large-scale data solutions
• Experience integrating systems through APIs and data services
• Strong understanding of data quality, governance, and security principles
• Experience creating technical documentation and engineering standards
• Ability to work within complex transformation or migration programmes

Desirable Experience

• Experience with Azure Data Factory, Databricks, Synapse Analytics, and Data Lake technologies
• Experience of large-scale data migration projects
• Knowledge of AI/ML data preparation and training pipelines
• Experience working within government, public sector, or highly regulated environments
• Familiarity with monitoring, observability, and operational reporting tools

What You'll Bring

• Strong stakeholder engagement and communication skills
• Ability to work independently within fast-paced delivery environments
• Experience translating business requirements into technical solutions
• A proactive and collaborative approach to problem-solving
• Strong analytical and documentation skills

Please be aware that this role can only be worked within the UK and not Overseas.

In applying for this role, you acknowledge the following "this role falls in scope of the Off Payroll Working in the Public Sector legislation. Any rates of payment quoted will reflect the gross rate per day for the assignment and will be subject to appropriate taxes and statutory costs. As such the payment to the intermediary and your income resulting from this contract will be different".

General information

Posting ID

PIP11595

Type of employment

Contract

Organisation

Department for Business, Energy & Industrial Strategy

Contract duration

6 months

Location

London

Workplace Type

Hybrid