Data Engineer

Job description

Job responsibilities

Design, implement, and optimise data storage systems, including databases, data warehouses, and data lakes, to efficiently handle large volumes of structured and unstructured data. Develop and maintain scalable ETL pipelines to extract, transform, and load data from various sources into the target data systems. Create and manage data schemas, data models, and data dictionaries to facilitate data governance and ensure data consistency and standardization. Develop data integration solutions to enable seamless and secure data flow between different systems. Implement data cleansing, validation, and enrichment processes to ensure data accuracy, completeness, and quality. Work with analysts and software engineers to understand requirements and provide data engineering report. Identify and resolve performance bottlenecks in data pipelines and optimise data processing and query performance. Implement monitoring systems and processes to track data pipeline health, identify issues and ensure timely resolution. Document data engineering processes, data flows, and system configurations to facilitate knowledge sharing and maintain a robust knowledge base. Collaborate with key stakeholders to understand data requirements and provide them with necessary reports, dashboards, and data visualisations. Participate in code reviews, provide construction feedback, and contribute to improving data engineering best practices and standards.

Person Specification

Experience

Essential

• Some previous experience as a Data Engineer in a fast-paced business or as a Software Engineer with strong database or data platform experience.
• Experience handling large datasets and complex data pipelines.
• Experience with big data processing frameworks and technologies.
• Experience with data modelling and designing efficient data structures.
• Experience with data integration and ETL (Extract, Transform, Load) processes.
• Experience in data cleansing, validation, and enrichment processes.
• Strong programming skills in languages such as Python, Java, or Scala.
• Knowledge of data warehousing concepts and dimensional modelling.
• Understanding of data security, privacy, and compliance requirements
• Proficiency in data integration and ETL tools
• Strong analytical skills and the ability to understand complex data structures.
• Capable of identifying data quality issues, troubleshooting problems, and implementing effective solutions.
• Experience using Microsoft Azure
• Software Engineering specifically Python

Disclosure and Barring Service Check

This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.

Employer details

Employer name

CHEC

Address

Broughton Business Park, 1-6 Star Building, Oliver's Pl, Fulwood

Preston

PR2 9WT

Employer's website

https://www.communityhealthservices.co.uk (Opens in a new tab)