Job summary
We are looking for a Specialist Data Engineer to join our growing data engineering team at Somerset Foundation Trust. The Data Engineer will bring an in-depth knowledge of data and wider data solutions to help solve some of the key challenges around a programme of work at industrial scale.
Our data engineers work with many systems from across the Trust and build pipelines to process it, control quality and present it for analysis and effective use. You'll take a lead on developing specific pipelines related to these systems and help to modernise the Data flows around the trust.
This role is Monday - Friday and offers a hybrid model of work with a minimum of 1 day per week in the Taunton or Yeovil office.
Main duties of the job
Your key responsibilities will include but not be limited to:
- Support the design and build of data pipelines from clinical systems to our BI and Data warehouse, using languages such as SQL and Python.
- Support in the development of New ways to store and present data
- Produce logic for data transformation steps as code, meeting the requirements for our end users.
- Communicate between technical and non-technical stakeholders as well as facilitate discussions within a multidisciplinary team.
- Keep abreast of best practice in data engineering across industry, research and Government and facilitating the adoption of standards.
About us
As an organisation, the NHS offers a wide range of benefits including flexible working, pension contributions, market leading annual leave allowance, career progression, and regular conversations, not to mention our Blue Light Card and NHS exclusive discounts.
The benefits of working in Somerset include the idyllic countryside, with our areas of outstanding beauty and stunning coastlines. You will get to enjoy these perks whilst still only being a stone's throw away from bustling city centres like Bristol, Bath and Exeter and only two hours away from London.
There are excellent educational facilities in the area and, when compared to other regions, house prices are reasonable. You will experience the best of both in Somerset, the countryside and the cosmopolitan - there is truly something for everyone!
Job description
Job responsibilities
The successful Data Engineer can listen to the needs of technical and business stakeholders, interpret them and effectively manage stakeholder expectations. To succeed in this role, you will also have some of the following skills:
- Understanding and working knowledge of information governance and data security approaches appropriate for sensitive health data.
- Detailed knowledge and understanding of NHS data sets
- Knowledge of health record coding systems and data standards (e.g., ICD, READ and SNOMED codes).
- Familiarity with a range of data structures and standards, with experience with OMOP and FHIR being desirable.
- Experience with the design and deployment of complex data schemas.
- Experience in validating and cleaning complex datasets.
- Experience building and maintaining robust, scalable and efficient pipelines capable of processing very large amounts of data from one or multiple systems.
- Familiarity with NHS RAP and NHS R
Technical requirements:
- Highly proficient in SQL, SSIS, Python.
- Familiar with version control and Git/GitHub.
- Follow best practices like code review, clean code and unit tests.
- Experience working with data lakes; Knowledge or experience with Spark, Databricks
- Understanding of common data transformation and storage formats
- An understanding of cloud environments and workflow management systems would also be beneficial
Monitor the extraction, transformation and loading of Trust data from a range of clinical and business systems into the Trusts Data Insight Warehousing solution and ensure that the processes developed for these flows maintain data integrity and can function efficiently in their allotted processing slots
Job description
Job responsibilities
The successful Data Engineer can listen to the needs of technical and business stakeholders, interpret them and effectively manage stakeholder expectations. To succeed in this role, you will also have some of the following skills:
- Understanding and working knowledge of information governance and data security approaches appropriate for sensitive health data.
- Detailed knowledge and understanding of NHS data sets
- Knowledge of health record coding systems and data standards (e.g., ICD, READ and SNOMED codes).
- Familiarity with a range of data structures and standards, with experience with OMOP and FHIR being desirable.
- Experience with the design and deployment of complex data schemas.
- Experience in validating and cleaning complex datasets.
- Experience building and maintaining robust, scalable and efficient pipelines capable of processing very large amounts of data from one or multiple systems.
- Familiarity with NHS RAP and NHS R
Technical requirements:
- Highly proficient in SQL, SSIS, Python.
- Familiar with version control and Git/GitHub.
- Follow best practices like code review, clean code and unit tests.
- Experience working with data lakes; Knowledge or experience with Spark, Databricks
- Understanding of common data transformation and storage formats
- An understanding of cloud environments and workflow management systems would also be beneficial
Monitor the extraction, transformation and loading of Trust data from a range of clinical and business systems into the Trusts Data Insight Warehousing solution and ensure that the processes developed for these flows maintain data integrity and can function efficiently in their allotted processing slots
Person Specification
Qualifications
Essential
- Degree Level Qualification or Experience
Desirable
- Evidence of continuous Learning
- Applicable Technical Qualifications
Experience
Essential
- MS SQL Server or equivalent Experience
- Project Lead or Supervisor
Desirable
- Supervisory experience
- Data Governance Experience
- Working with Data Warehouse
- Working with Cloud
- NHS Experience
Knowledge
Essential
- SQL Stack
- GitHub
- Warehouse Development
- Analytics and Problem solving
- Team Worker
Desirable
- Demonstrates Managerial Skill
- OMOP Standard and NHS R A P or similar Methodology
- DAX / MDX or other Analytical Language
- Presentation of Technical Information to non-technical audience
Person Specification
Qualifications
Essential
- Degree Level Qualification or Experience
Desirable
- Evidence of continuous Learning
- Applicable Technical Qualifications
Experience
Essential
- MS SQL Server or equivalent Experience
- Project Lead or Supervisor
Desirable
- Supervisory experience
- Data Governance Experience
- Working with Data Warehouse
- Working with Cloud
- NHS Experience
Knowledge
Essential
- SQL Stack
- GitHub
- Warehouse Development
- Analytics and Problem solving
- Team Worker
Desirable
- Demonstrates Managerial Skill
- OMOP Standard and NHS R A P or similar Methodology
- DAX / MDX or other Analytical Language
- Presentation of Technical Information to non-technical audience
Disclosure and Barring Service Check
This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.
Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).
From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).
Additional information
Disclosure and Barring Service Check
This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.
Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).
From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).
