UK Health Security Agency

Data Engineer

Information:

This job is now closed

Job summary

Job title - Data Engineer

Profession- Digital Data & Technology

Directorate - Data Operations

Full Time equivalent - 37.5 hours

No of Roles - 3

Contract Type - Permanent

Location - Hybrid

UKHSA operates a hybrid working model where business needs allow. This provides us with greater flexibility about how and where we work, to get the best from our workforce. As a hybrid worker, you will be expected to spend a minimum of 60% of your contractual working hours (approximately 3 days a week pro rata, (averaged over a month) working at one of UKHSA's locations (Birmingham, Leeds, Liverpool, and London). Specialist or regional roles will be based at the appropriate UKHSA site. For certain roles, some additional flexibility may be possible, which will be agreed upon with the hiring manager based on individual requirements and business needs.

Working Pattern - Full Time / Part Time / Job Share / Flexible Working / Hybrid Working

Grade & Salary - Grade 7. National banding -£51,824- £61,414 per annum. Outer London -£53,812- £63,252 per annum. Inner London - £55,799- £65,089 per annum.

This role comes with a Market Pay Supplement of up to £10,000

New entrants to the Civil Service are expected to start on the minimum of the pay band.

Main duties of the job

You will draw from an extensive background of experience in core data engineering. Your skills will enable and deliver data and analytical solutions on our analytics and data platforms. You will be able to act as a senior technical expert in all aspects of delivery and be prepared to provide leadership and guidance to small project teams/resources in a collaborative way.

You will develop and maintain the technology infrastructure that is integrating new and existing sources of data into Data Analytics and Surveillance processes and workflows, so that it can be exploited with maximum efficiency and efficacy. Key skills required include: data engineering, data architecture, data analysis, security architecture, DevOps and business partnering.

About us

You will work in the Data Engineering and Enablement Division that reports into the Data Operations Directorate. It's an exciting time to join as we seek to create leading Health Protection data capabilities that enable data scientists and data analysts to develop insights that inform public health decisions with resilience platforms and curated data assets.

The role requires the ingestion of a wide range of data assets, building acquisition, orchestration, data pipelines and curated data marts and data egresses. We are seeking to mature our advanced capabilities with standardised practices, machine learning and agility needed to pro-actively detect and respond to new public health issues.

You will be involved in the delivery life cycle from engaging with stakeholders on new initiatives, analysing use cases, developing optimal designs that where possible re-use and extend capabilities, and implement and operate the design. Our teams work collaboratively in an agile multi-disciplinary team mode and we are looking for engineers who have the ability to operate in feature teams, data operations and DevSecOps models. We are developing our engineering community of practice to share knowledge, enhance our standards and processes to provide a strong foundation to develop individuals, teams and innovation.

Details

Date posted

10 January 2024

Pay scheme

Other

Salary

£59,824 to £65,089 a year per annum

Contract

Permanent

Working pattern

Full-time, Part-time, Job share, Flexible working, Compressed hours, Term time hours

Reference number

UKHSA01111

Job locations

hybrid

hybrid

NW9 5EQ


Job description

Job responsibilities

  • Programming and build You can design, write and iterate code from prototype to production-ready. You understand security, accessibility and version control. You can use a range of coding tools and languages. You can develop code that self-generates documentation that supports Data Scientists and Data Analysts.
  • Technical understanding You know about the specific technologies that underpin your ability to deliver the responsibilities and tasks of the role. You can apply the required breadth and depth of technical knowledge.
  • Testing You can plan, design, manage, execute and report tests, using appropriate tools and techniques, and work within regulations. You know how to ensure that risks associated with deployment are adequately understood and documented
  • Problem resolution You know how to log, analyse and manage problems in order to identify and implement the appropriate solution. You can ensure that the problem is fixed.

Essential Criteria

  • Extensive knowledge/experience at an enterprise scale (5+ years) of python programming language, including unit testing (pytest) and pep8 standards
  • Pandas data validation, manipulation, merging, joining and at times visualisation
  • Extensive knowledge/experience at an enterprise scale (5+ years) using Python, SQL, Spark and AWS
  • Hands on ETL development experience utilizing Microsoft enterprise stack / Azure and AWS Glue
  • Extensive knowledge/experience at an enterprise scale (5+ years) of data management platforms and development with SQL Server
  • Writing robust data pipeline code that can run unattended
  • Unix environment, server health and management of ongoing running processes
  • Github, git, pull requests, CI and code review
  • Ability to work as part of a team to develop and deliver end-to-end data warehouse solutions
  • Analytical skill set with an ability to understand data requirements and support the development of data solutions
  • Experience with publishing data sets for visualisation and analysis
  • Experience with supporting design of data models / data flows
  • Logging and reporting pragmatically
  • Ability to troubleshoot and solve numerical and technical problems
  • High attention to detail
  • Excellent communication and facilitation skills evidenced through verbal and written means to a wide range of stakeholders
  • Experience with or knowledge of Agile software development methodologies

Desirable Criteria

  • Machine learning for engineering practices, such as meta driven intelligent ETL and pipeline processes
  • Experience of working with JIRA (or Azure DevOps or similar tools) within an Agile/Scrum environment
  • Experience/Understanding of software and data lifecycle management
  • Educated to degree level (not essential, experience is key). Relevant numerate, technical or computer science discipline would be an advantage

We pride ourselves as being an employer of choice, where Everyone Matters promoting equality of opportunity to actively encourage applications from everyone, including groups currently underrepresented in our workforce.

UKHSA ethos is to be an inclusive organisation for all our staff and stakeholders. To create, nurture and sustain an inclusive culture, where differences drive innovative solutions to meet the needs of our workforce and wider communities. We do this through celebrating and protecting differences by removing barriers and promoting equity and equality of opportunity for all.

Selection Process

Stage 1: Application & Sift

This vacancy is using Success Profiles, and will assess your Behaviours and Experience.

As part of the application process you will be asked to provide a Personal Statement / Statement of Suitability 750 words. This should outline your skills, experience, and achievements, providing evidence of your suitability for the role, with particular reference to the Experience criteria or the essential criteria (outlined in the person specification section).

You will also be asked to provide information within the Employer/ Activity history section of the application form. This is equivalent to the information you would provide on a CV, setting out your career history. This will be used in the sifting process and will be scored.

If you are successful at this stage, you will progress to interview

Stage 2: Panel Interview

All applicants that progress to interview will be assessed on behaviours, experience and technical through Success Profiles.

When assessing strengths, we want to find out whether you and the job role are a good fit. We will look at what you enjoy doing and what you do well and often. By ensuring that the role is the right fit for you, you are more likely to enjoy it and perform well.

The Behaviours tested during the interview stage will be:

  • Communicating and Influencing
  • Delivering at Pace
  • Managing a Quality Service
  • Making effective decisions
  • Changing and Improving

Reserve List:

Candidates who pass the interview criteria but are not offered a post will be kept on a reserve list for 12 months and may be contacted if similar roles become available.

If you are interviewed for the post and do not meet the required threshold for the specified grade, your application may be assessed against a similar, lower grade role and you may be offered the post should one be available.

Benefits

  • Alongside your salary of £51,824, UK Health Security Agency contributes £13,992 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.- https://www.civilservicepensionscheme.org.uk/joining-the-pension-scheme/benefits-of-the-pension-scheme/
  • Learning and development tailored to your role
  • An environment with flexible working options
  • A culture encouraging inclusion and diversity
  • Range of health and wellbeing support

Any move to UKHSA from another employer will mean you can no longer access childcare vouchers. This includes moves between government departments. You may however be eligible for other government schemes, including Tax Free Childcare.

DBS - People working with government systems must complete Basic Personnel Security Standard (BPSS) checks which includes a disclosure and barring security check. Successful candidates must meet the security requirements before they can be appointed. The level of security needed for this role is BPSS however there may be a requirement for this role to be SC cleared and you should familiarise yourself with the criteria of security clearance.

This role is Open to all external applicants (anyone) from outside the Civil Service (including by definition internal applicants. Appointments to roles within UKHSA will be made in accordance with the Civil Service nationality rules. These can be found athttps://www.gov.uk/government/publications/nationality-rulesThis job is broadly open to the following groups:

  • UK nationals
  • Nationals of Commonwealth countries who have the right to work in the UK
  • Nationals of the Republic of Ireland
  • Nationals from the EU, EEA or Switzerland with settled or pre-settled status or who apply for either status by the deadline of theEuropean Union Settlement Scheme (EUSS)
  • Relevant EU, EEA, Swiss or Turkish nationals working in the Civil Service
  • Relevant EU, EEA, Swiss or Turkish nationals who have built up the right to work in the Civil Service
  • Certain family members of the relevant EU, EEA, Swiss or Turkish nationals

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's Recruitment Principles.

The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.

The Civil Service welcomes applications from people who have recently left prison or have an unspent conviction. Read more about prison leaver recruitment.

Once this job has closed, the job advert will no longer be available. You may want to save a copy for your records.

Government baseline personnel security standard

Its important to note that there are currently exceptions to applications being considered if your conviction relates to any of the following:

  • life sentences
  • arson
  • sexual offences
  • hate and terror offences

Some departments will also consider the specific offence against the nature of the business, i.e., a conviction for fraud may rule you out for a finance role

Complaint process:

The law requires that selection for appointment to the Civil Service is on merit on the basis of fair and open competition as outlined in the Civil Service Commission's Recruitment Principles. If you feel your application has not been treated in accordance with the Recruitment Principles, and you wish to make a complaint, in the first instance, you should contact UKHSA Public Accountability Unit via email: Complaints1@ukhsa.gov.uk. If you are not satisfied with the response you receive from the Department, you can contact the Civil Service Commission: Visit the Civil Service Commission website.

Job description

Job responsibilities

  • Programming and build You can design, write and iterate code from prototype to production-ready. You understand security, accessibility and version control. You can use a range of coding tools and languages. You can develop code that self-generates documentation that supports Data Scientists and Data Analysts.
  • Technical understanding You know about the specific technologies that underpin your ability to deliver the responsibilities and tasks of the role. You can apply the required breadth and depth of technical knowledge.
  • Testing You can plan, design, manage, execute and report tests, using appropriate tools and techniques, and work within regulations. You know how to ensure that risks associated with deployment are adequately understood and documented
  • Problem resolution You know how to log, analyse and manage problems in order to identify and implement the appropriate solution. You can ensure that the problem is fixed.

Essential Criteria

  • Extensive knowledge/experience at an enterprise scale (5+ years) of python programming language, including unit testing (pytest) and pep8 standards
  • Pandas data validation, manipulation, merging, joining and at times visualisation
  • Extensive knowledge/experience at an enterprise scale (5+ years) using Python, SQL, Spark and AWS
  • Hands on ETL development experience utilizing Microsoft enterprise stack / Azure and AWS Glue
  • Extensive knowledge/experience at an enterprise scale (5+ years) of data management platforms and development with SQL Server
  • Writing robust data pipeline code that can run unattended
  • Unix environment, server health and management of ongoing running processes
  • Github, git, pull requests, CI and code review
  • Ability to work as part of a team to develop and deliver end-to-end data warehouse solutions
  • Analytical skill set with an ability to understand data requirements and support the development of data solutions
  • Experience with publishing data sets for visualisation and analysis
  • Experience with supporting design of data models / data flows
  • Logging and reporting pragmatically
  • Ability to troubleshoot and solve numerical and technical problems
  • High attention to detail
  • Excellent communication and facilitation skills evidenced through verbal and written means to a wide range of stakeholders
  • Experience with or knowledge of Agile software development methodologies

Desirable Criteria

  • Machine learning for engineering practices, such as meta driven intelligent ETL and pipeline processes
  • Experience of working with JIRA (or Azure DevOps or similar tools) within an Agile/Scrum environment
  • Experience/Understanding of software and data lifecycle management
  • Educated to degree level (not essential, experience is key). Relevant numerate, technical or computer science discipline would be an advantage

We pride ourselves as being an employer of choice, where Everyone Matters promoting equality of opportunity to actively encourage applications from everyone, including groups currently underrepresented in our workforce.

UKHSA ethos is to be an inclusive organisation for all our staff and stakeholders. To create, nurture and sustain an inclusive culture, where differences drive innovative solutions to meet the needs of our workforce and wider communities. We do this through celebrating and protecting differences by removing barriers and promoting equity and equality of opportunity for all.

Selection Process

Stage 1: Application & Sift

This vacancy is using Success Profiles, and will assess your Behaviours and Experience.

As part of the application process you will be asked to provide a Personal Statement / Statement of Suitability 750 words. This should outline your skills, experience, and achievements, providing evidence of your suitability for the role, with particular reference to the Experience criteria or the essential criteria (outlined in the person specification section).

You will also be asked to provide information within the Employer/ Activity history section of the application form. This is equivalent to the information you would provide on a CV, setting out your career history. This will be used in the sifting process and will be scored.

If you are successful at this stage, you will progress to interview

Stage 2: Panel Interview

All applicants that progress to interview will be assessed on behaviours, experience and technical through Success Profiles.

When assessing strengths, we want to find out whether you and the job role are a good fit. We will look at what you enjoy doing and what you do well and often. By ensuring that the role is the right fit for you, you are more likely to enjoy it and perform well.

The Behaviours tested during the interview stage will be:

  • Communicating and Influencing
  • Delivering at Pace
  • Managing a Quality Service
  • Making effective decisions
  • Changing and Improving

Reserve List:

Candidates who pass the interview criteria but are not offered a post will be kept on a reserve list for 12 months and may be contacted if similar roles become available.

If you are interviewed for the post and do not meet the required threshold for the specified grade, your application may be assessed against a similar, lower grade role and you may be offered the post should one be available.

Benefits

  • Alongside your salary of £51,824, UK Health Security Agency contributes £13,992 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.- https://www.civilservicepensionscheme.org.uk/joining-the-pension-scheme/benefits-of-the-pension-scheme/
  • Learning and development tailored to your role
  • An environment with flexible working options
  • A culture encouraging inclusion and diversity
  • Range of health and wellbeing support

Any move to UKHSA from another employer will mean you can no longer access childcare vouchers. This includes moves between government departments. You may however be eligible for other government schemes, including Tax Free Childcare.

DBS - People working with government systems must complete Basic Personnel Security Standard (BPSS) checks which includes a disclosure and barring security check. Successful candidates must meet the security requirements before they can be appointed. The level of security needed for this role is BPSS however there may be a requirement for this role to be SC cleared and you should familiarise yourself with the criteria of security clearance.

This role is Open to all external applicants (anyone) from outside the Civil Service (including by definition internal applicants. Appointments to roles within UKHSA will be made in accordance with the Civil Service nationality rules. These can be found athttps://www.gov.uk/government/publications/nationality-rulesThis job is broadly open to the following groups:

  • UK nationals
  • Nationals of Commonwealth countries who have the right to work in the UK
  • Nationals of the Republic of Ireland
  • Nationals from the EU, EEA or Switzerland with settled or pre-settled status or who apply for either status by the deadline of theEuropean Union Settlement Scheme (EUSS)
  • Relevant EU, EEA, Swiss or Turkish nationals working in the Civil Service
  • Relevant EU, EEA, Swiss or Turkish nationals who have built up the right to work in the Civil Service
  • Certain family members of the relevant EU, EEA, Swiss or Turkish nationals

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's Recruitment Principles.

The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.

The Civil Service welcomes applications from people who have recently left prison or have an unspent conviction. Read more about prison leaver recruitment.

Once this job has closed, the job advert will no longer be available. You may want to save a copy for your records.

Government baseline personnel security standard

Its important to note that there are currently exceptions to applications being considered if your conviction relates to any of the following:

  • life sentences
  • arson
  • sexual offences
  • hate and terror offences

Some departments will also consider the specific offence against the nature of the business, i.e., a conviction for fraud may rule you out for a finance role

Complaint process:

The law requires that selection for appointment to the Civil Service is on merit on the basis of fair and open competition as outlined in the Civil Service Commission's Recruitment Principles. If you feel your application has not been treated in accordance with the Recruitment Principles, and you wish to make a complaint, in the first instance, you should contact UKHSA Public Accountability Unit via email: Complaints1@ukhsa.gov.uk. If you are not satisfied with the response you receive from the Department, you can contact the Civil Service Commission: Visit the Civil Service Commission website.

Person Specification

Experience

Essential

  • oExtensive knowledge/experience at an enterprise scale (5+ years) of python
Person Specification

Experience

Essential

  • oExtensive knowledge/experience at an enterprise scale (5+ years) of python

Disclosure and Barring Service Check

This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.

Certificate of Sponsorship

Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).

From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).

Additional information

Disclosure and Barring Service Check

This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.

Certificate of Sponsorship

Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).

From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).

Employer details

Employer name

UK Health Security Agency

Address

hybrid

hybrid

NW9 5EQ


Employer's website

https://www.gov.uk/government/organisations/uk-health-security-agency (Opens in a new tab)

Employer details

Employer name

UK Health Security Agency

Address

hybrid

hybrid

NW9 5EQ


Employer's website

https://www.gov.uk/government/organisations/uk-health-security-agency (Opens in a new tab)

Employer contact details

For questions about the job, contact:

lead recruiter

sophie rigney

sophie.rigney@reed.com

Details

Date posted

10 January 2024

Pay scheme

Other

Salary

£59,824 to £65,089 a year per annum

Contract

Permanent

Working pattern

Full-time, Part-time, Job share, Flexible working, Compressed hours, Term time hours

Reference number

UKHSA01111

Job locations

hybrid

hybrid

NW9 5EQ


Supporting documents

Privacy notice

UK Health Security Agency's privacy notice (opens in a new tab)