Humber and North Yorkshire Integrated Care Board (857)

Lead Data Engineer

Information:

This job is now closed

Job summary

This is an exciting opportunity to join Humber and North Yorkshire Integrated Care Board as a Lead Data Engineer. In this role, you'll utilise your expertise to provide a range of data engineering, modelling and evaluation support to ICB and ICS data programmes.

This will require working with staff at a range of levels within the organisation such as information staff, service users and leads, other relevant stakeholders including heads of services/directors.

The successful candidate is required to be able to demonstrate the organisations values, the responsibilities of the job description and person specification.

The ideal candidate will have an awareness of a range of data engineering techniques, methods and a sound knowledge of health care data and the business of health. The Lead Data Engineer will identify opportunities on available technology (Microsoft Fabric and associated technology), reuse of existing data flows, lead the development of the ICBs data warehouse, optimise code to ensure processes perform optimally and take the lead in management and creation of data views and models for a variety of purposes.

Main duties of the job

This position will support the Business Intelligence Team, various internal partners including the ICBs Population Health Management team, Innovation Research and Improvement Service, and Place teams along with playing a crucial role in the development of the Secure Data Environment for the area.

Core Responsibilities Include:

Working collaboratively with the Strategic Business Intelligence Lead and supplier support on the development of the ICBs data warehouse strategy to have a single data source of core data for the purpose of decision support, improving productivity and population health intelligence.

Coordination and leading the data engineering team, to a set of best practice and standards, to achieve seamless data flows between partners.

  • Ensuring a high level of information governance and confidentiality is always in mind in the creation of data flows

About us

The ICB welcomes all applicants, however, we must remind applicants that we currently do not hold a Tier 2 sponsorship license (now called Skilled Worker visa sponsorship). Can we politely ask this is considered before applying for this position.

NHS Humber and North Yorkshire Integrated Care Board (ICB) is responsible for planning and arranging the provision of NHS services to meet the diverse health needs of a population of 1.7 million people. Our area reaches over 1,500 square miles and includes the cities of Hull and York and the large rural areas across East Yorkshire, North Yorkshire and Northern Lincolnshire. The ICB is part of the Humber and North Yorkshire Health and Care Partnership, one of 42 Integrated Care Systems (ICS) across England to meet health and care needs, coordinate services and plan in a way that improves population health and reduces inequality between groups. The Health and Care Partnership comprises of NHS organisations, local councils, health and care providers and voluntary, community and social enterprise (VCSE) organisations.

Details

Date posted

17 May 2024

Pay scheme

Agenda for change

Band

Band 8a

Salary

£50,952 to £57,349 a year Indicative banding subject to Job Evaluation

Contract

Permanent

Working pattern

Full-time, Flexible working

Reference number

D9857-24-0020

Job locations

Vale of York Place

West Offices, Station Rise

York

YO1 6GA


East Riding Place

Health House, Grange Park Lane

Willerby

HU10 6DT


North Lincolnshire Place

Health Place, Wrawby

Brigg

DN20 8GS


North East Lincolnshire Council

Town Hall Square

Grimsby

DN31 1HU


Hull City Council

Guildhall Road

Hull

HU1 1HJ


North Yorkshire Place

1 Grimbald Crag Court

Knaresborough

HG5 8QB


Job description

Job responsibilities

To be responsible for the development of the ICB Data Warehouse Architecture, data modelling and wider data engineering team, using Azure Data Lake and various Business Intelligence systems within the Microsoft stack.

Communication between the technical and non-technical

listen to the needs of technical and business stakeholders, and interpret them

effectively manage stakeholder expectations

manage active and reactive communication

support or host difficult discussions within the team or with diverse senior stakeholders

Data analysis and synthesis

understand and help teams to apply a range of techniques for data profiling

source system analysis from a complex single source

bring multiple data sources together in a conformed model for analysis

Data development process

establish enterprise-scale data integration procedures across the data development life cycle, and ensure that teams adhere to them

manage resources to ensure that data services work effectively at an enterprise level

Data innovation

identify areas of innovation in data tools and techniques, and recognise appropriate timing for adoption

Data integration design

establish standards, keep them up to date and ensure adherence to them

keep abreast of best practice in industry and across health

Data modelling

understand the concepts and principles of data modelling and can produce relevant data models

work across government and industry, recognising opportunities for the reuse and alignment of data models in different organisations

design the method to categorise data models within an organisation

Metadata management

design an appropriate metadata repository and present changes to existing metadata repositories

understand a range of tools for storing and working with metadata

provide oversight and advice to more inexperienced members of the team

Problem resolution (data)

ensure that the most appropriate actions are taken to resolve complex problems as they occur

co-ordinate teams to resolve problems and to implement solutions and preventative measures

Programming and build (data engineering)

use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations

collaborate with others to review specifications where appropriate

Technical understanding

show a thorough understanding of the technical concepts required for the role, and can explain how these fit into the wider technical landscape

Testing

review requirements and specifications, and define test conditions

identify issues and risks associated with work

analyse and report test activities and results

Managing third parties (e.g. sub-contractors, interims) to ensure deliverables are met in a timely manner and within budget.

Leading on the technical management and planning with providers of data management services.

Will provide training in own area of work to other professionals from a range of backgrounds as required.

Will be required to manage staff aligned to various programmes of work as required.

Contribute to the strategic planning of new pathways of care, through provision of accurate and timely performance data and development of data flows, ensuring close alignment of data strategies across the organisation and wider system.

Plan and organise a range of complex projects including data management, data modelling, data governance and data flows across the organisation.

Plan and organise a broad range of complex activities, formulates and adjusts plans/strategies.

To represent the programme in relevant technical forums, both internally and externally of the HNY partnership.

To be responsible for managing and prioritising own workload, and that of the data engineering team, to meet internal and external demands.

Job description

Job responsibilities

To be responsible for the development of the ICB Data Warehouse Architecture, data modelling and wider data engineering team, using Azure Data Lake and various Business Intelligence systems within the Microsoft stack.

Communication between the technical and non-technical

listen to the needs of technical and business stakeholders, and interpret them

effectively manage stakeholder expectations

manage active and reactive communication

support or host difficult discussions within the team or with diverse senior stakeholders

Data analysis and synthesis

understand and help teams to apply a range of techniques for data profiling

source system analysis from a complex single source

bring multiple data sources together in a conformed model for analysis

Data development process

establish enterprise-scale data integration procedures across the data development life cycle, and ensure that teams adhere to them

manage resources to ensure that data services work effectively at an enterprise level

Data innovation

identify areas of innovation in data tools and techniques, and recognise appropriate timing for adoption

Data integration design

establish standards, keep them up to date and ensure adherence to them

keep abreast of best practice in industry and across health

Data modelling

understand the concepts and principles of data modelling and can produce relevant data models

work across government and industry, recognising opportunities for the reuse and alignment of data models in different organisations

design the method to categorise data models within an organisation

Metadata management

design an appropriate metadata repository and present changes to existing metadata repositories

understand a range of tools for storing and working with metadata

provide oversight and advice to more inexperienced members of the team

Problem resolution (data)

ensure that the most appropriate actions are taken to resolve complex problems as they occur

co-ordinate teams to resolve problems and to implement solutions and preventative measures

Programming and build (data engineering)

use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations

collaborate with others to review specifications where appropriate

Technical understanding

show a thorough understanding of the technical concepts required for the role, and can explain how these fit into the wider technical landscape

Testing

review requirements and specifications, and define test conditions

identify issues and risks associated with work

analyse and report test activities and results

Managing third parties (e.g. sub-contractors, interims) to ensure deliverables are met in a timely manner and within budget.

Leading on the technical management and planning with providers of data management services.

Will provide training in own area of work to other professionals from a range of backgrounds as required.

Will be required to manage staff aligned to various programmes of work as required.

Contribute to the strategic planning of new pathways of care, through provision of accurate and timely performance data and development of data flows, ensuring close alignment of data strategies across the organisation and wider system.

Plan and organise a range of complex projects including data management, data modelling, data governance and data flows across the organisation.

Plan and organise a broad range of complex activities, formulates and adjusts plans/strategies.

To represent the programme in relevant technical forums, both internally and externally of the HNY partnership.

To be responsible for managing and prioritising own workload, and that of the data engineering team, to meet internal and external demands.

Person Specification

Qualifications

Essential

  • Educated to Masters level or equivalent level
  • In depth specialist knowledge of information analysis and the use of information across the NHS acquired through a degree or equivalent.
  • Evidence of continued further professional development
  • Extensive experience in data engineering within the healthcare sector, with a focus on NHS data systems
  • In-depth knowledge of data modelling, database design, and data warehousing principles

Desirable

  • A relevant qualification in information management
  • Knowledge of NHS strategies, policies and plans.
  • Good knowledge of Python for data engineering purposes

Experience

Essential

  • Experience of exporting data from various source data systems, transforming data against required business rules and data models, or data storage and analysis requirements, and loading data in various storage platforms.
  • Experience of working within and/or with multi-disciplinary teams, a proven track record of successful transformative and innovative working within health or health related settings
  • Extensive experience in data engineering within the healthcare sector, with a focus on NHS data systems
  • Proven track record of designing, developing, and maintaining large-scale data pipelines and ETL processes
  • Familiarity with healthcare data standards and compliance regulations
  • Significant experience of extracting data, manipulating, understanding, transforming, wrangling and cleaning NHS datasets
  • Experience with ICD, SNOMED codes and the NHS Data Dictionary
  • Experience in an data integration role with the ability to apply logical thinking using a wide range of data processing tools and techniques to build and integrations solution in a highly complex environment
  • Experience working with open source technologies

Skills/Competencies

Essential

  • Ability to write well-designed, testable, efficient SQL code which follows good coding standards
  • Proven ability to transform data from raw into a usable format for users implementing highly complex rules
  • Self-starter, able to work effectively within a team to tight deadlines
  • Fluent in SQL-based systems.
  • Proficiency in programming languages commonly used in data engineering
  • Ability to optimise and troubleshoot complex data pipelines for performance and reliability
  • Excellent problem-solving skills and the ability to work collaboratively in a multidisciplinary team
  • Communicate effectively with technical and non-technical stakeholders to support and host discussions within a multidisciplinary team, with potentially difficult dynamics, and be an advocate for the team externally to can manage differing perspectives
  • Excellent analytical, IT Keyboard and numerical skills - confident with statistics and their presentation
  • Excellent verbal and written communication (including presentation) skills
Person Specification

Qualifications

Essential

  • Educated to Masters level or equivalent level
  • In depth specialist knowledge of information analysis and the use of information across the NHS acquired through a degree or equivalent.
  • Evidence of continued further professional development
  • Extensive experience in data engineering within the healthcare sector, with a focus on NHS data systems
  • In-depth knowledge of data modelling, database design, and data warehousing principles

Desirable

  • A relevant qualification in information management
  • Knowledge of NHS strategies, policies and plans.
  • Good knowledge of Python for data engineering purposes

Experience

Essential

  • Experience of exporting data from various source data systems, transforming data against required business rules and data models, or data storage and analysis requirements, and loading data in various storage platforms.
  • Experience of working within and/or with multi-disciplinary teams, a proven track record of successful transformative and innovative working within health or health related settings
  • Extensive experience in data engineering within the healthcare sector, with a focus on NHS data systems
  • Proven track record of designing, developing, and maintaining large-scale data pipelines and ETL processes
  • Familiarity with healthcare data standards and compliance regulations
  • Significant experience of extracting data, manipulating, understanding, transforming, wrangling and cleaning NHS datasets
  • Experience with ICD, SNOMED codes and the NHS Data Dictionary
  • Experience in an data integration role with the ability to apply logical thinking using a wide range of data processing tools and techniques to build and integrations solution in a highly complex environment
  • Experience working with open source technologies

Skills/Competencies

Essential

  • Ability to write well-designed, testable, efficient SQL code which follows good coding standards
  • Proven ability to transform data from raw into a usable format for users implementing highly complex rules
  • Self-starter, able to work effectively within a team to tight deadlines
  • Fluent in SQL-based systems.
  • Proficiency in programming languages commonly used in data engineering
  • Ability to optimise and troubleshoot complex data pipelines for performance and reliability
  • Excellent problem-solving skills and the ability to work collaboratively in a multidisciplinary team
  • Communicate effectively with technical and non-technical stakeholders to support and host discussions within a multidisciplinary team, with potentially difficult dynamics, and be an advocate for the team externally to can manage differing perspectives
  • Excellent analytical, IT Keyboard and numerical skills - confident with statistics and their presentation
  • Excellent verbal and written communication (including presentation) skills

Employer details

Employer name

Humber and North Yorkshire Integrated Care Board (857)

Address

Vale of York Place

West Offices, Station Rise

York

YO1 6GA


Employer's website

https://humberandnorthyorkshire.icb.nhs.uk/ (Opens in a new tab)


Employer details

Employer name

Humber and North Yorkshire Integrated Care Board (857)

Address

Vale of York Place

West Offices, Station Rise

York

YO1 6GA


Employer's website

https://humberandnorthyorkshire.icb.nhs.uk/ (Opens in a new tab)


Employer contact details

For questions about the job, contact:

Deputy Director of Data, BI and Analytics

Alex Bell

alex.bell1@nhs.net

Details

Date posted

17 May 2024

Pay scheme

Agenda for change

Band

Band 8a

Salary

£50,952 to £57,349 a year Indicative banding subject to Job Evaluation

Contract

Permanent

Working pattern

Full-time, Flexible working

Reference number

D9857-24-0020

Job locations

Vale of York Place

West Offices, Station Rise

York

YO1 6GA


East Riding Place

Health House, Grange Park Lane

Willerby

HU10 6DT


North Lincolnshire Place

Health Place, Wrawby

Brigg

DN20 8GS


North East Lincolnshire Council

Town Hall Square

Grimsby

DN31 1HU


Hull City Council

Guildhall Road

Hull

HU1 1HJ


North Yorkshire Place

1 Grimbald Crag Court

Knaresborough

HG5 8QB


Supporting documents

Privacy notice

Humber and North Yorkshire Integrated Care Board (857)'s privacy notice (opens in a new tab)