Data Engineer

Job description

Job responsibilities

Job Summary

Develop, test & implement solutions built in the SQL Server Environment and business intelligence (BI) reporting software ensuring that it meets the requirements of the end users and the Data Engineering teams development standards.

Supporting the development of technical BI skills across the wider Insight & Analytics department including, but not limited to T-SQL, ETL (SSIS and/or DTS) and Tableau.

Work with the analytical teams and business users to develop high-quality data models for reporting and dashboarding purposes.

Establish and manage metadata repositories to support development pipelines and processes.

Ensure data quality across the SQL platform by managing assurance and providing guidance to resolve data quality issues with regional partners and divisional teams.

Information Management

Take lead responsibility for ensuring that the key mandatory NHS national returns (CSDS, CDS, IAPT and MHSDS) are submitted in line with the requirements and timescales of NHS England.

Manage the Trusts NHS Dataset Change Notice (DSCN) Procedure and ensure that all relevant parties are notified as to the nature, impact and timetable for any changes.

Keep abreast of all national reporting developments and respond appropriately to new and/or revised statutory reporting requirements.

Reviewing the NHS England website for changes to dataset requirements regularly and ensuring that these changes are reflected appropriately in the Trusts reporting.

Planning and Organisation

Demonstrate and champion how the new the data engineering tools can be used to develop and run intelligent information reports that draw upon, integrate, analyse and make links between different information sources to support more effective service planning, monitoring and delivery.

Design, build, and maintain scalable data pipelines to ingest, transform, and load data from various sources (e.g., clinical systems, external data feeds) into the Trust's data platforms.

a. To develop and extend expertise in database design concepts and SQL server language, including T-SQL, ETL (SSIS and/or DTS) and Tableau.

b. To ensure high quality data warehouse security, putting in place robust security measures to allow adequate access for the required users whilst protecting sensitive patient-identifiable data.

Develop expert understanding of the IT systems operated by CNWL with regard to data models and structures so as to facilitate work to develop new and more complex reporting objects that require effective and intelligent linkage between sources of information held on different systems.

Ongoing requirement to act with minimum guidelines, setting standards for others, establishing how professional and administrative policies should be interpreted and implemented

To provide training and demonstration and ensure provision and translation of complex analytical information to non-specialist users and provision of support in their understanding of the analysis

Provision of technical support to business intelligence managers for the purpose of developing release schedules of required data items

Ensure all documentation relating to own area is complete and fit for purpose and all releases are controlled.

Lead in the development and maintenance of a culture of service provision and continuous improvement for own areas.

Supporting team members to maintain an up to date knowledge and understanding of NHS information requirements and IT developments as they apply to Trust systems.

Contribute to the strategic planning of team projects, identifying interdependencies across projects/functions, potential impacts on wider organisation, resource requirements and building in contingency and adjustments as necessary.

Collaboration

Create strong and sustainable business relationships with senior colleagues both internally and externally. Establish and use a network of peers to ensure consistent and accurate information and approaches are used. Share and promote the sharing of information and knowledge.

Coordinate discussion within the team to solve a problem and utilise the knowledge and experience of team colleagues.

Participate and present in meetings as directed by BI colleagues, providing information advice and support where requested.

Seek out development opportunities for you to learn, both as an individual and as a team, sharing your knowledge with your peers

Working with and assisting Data Base Administrators (DBAs) ,to design and develop thestructure, procedures and functions of the Trusts data warehouse data models.Including data security, responsibility for the administration of permissions to the Trustsdata warehouse datasets.

Learning and Development

Provide ongoing support, training and guidance to key internal stakeholders (and, potentially, some external stakeholders) so that they are able to use the new BI system to build and run their own information reports, adjusting the information content, parameters and presentation so as best to meet their needs.

Proactively identify appropriate training / development opportunities that could enhance the skills of the team to the benefit of the teams stakeholders.

Plan, develop and evaluate methods and processes for gathering, analysing, interpreting and presenting data and information.

Management and Leadership Responsibilities

Develop and empower all members of your team to perform to high standards and innovate.

Proactively participate in monthly 1:1 management supervision, annual objective setting and PDR / appraisal processes.

Develop staff knowledge and skills to promote equality and diversity and address inequalities both in employment and service delivery. Ensure specific equality objective is included in PDRs.

Develop a culture that ensures that the standards of Improving Working Lives and Investors in People are achieved and maintained for all staff and that staffs perception about their working lives are measured and improvements made.

Coordinate and ensure all aspects of work within the team (or project team) are well managed and delivered on time, helping to resolve day-to-day issues and provide immediate and detailed support to all levels within the team.

Provide relevant and timely specialist advice and guidance on own portfolio of projects and analytical areas.

Rider Clause

This is an outline of the post holders duties and responsibilities. It is not intended as an exhaustive list and may change from time to time to meet the changing needs of the Trust and Department.

Each application will be reviewed by the interview committee and carefully shortlisted within two weeks of the submission deadline. We aim to review every application manually, without the use of ATS software so if we shortlist a sufficient number of candidates, we may close this posting before the deadline. If your application is shortlisted, you will be invited for a face-to-face interview, which may be followed by a coding test on the same day. Successful candidates will be contacted within a week of the interview date.

Person Specification

Education & Qualifications

Essential

• Educated to master's level in relevant subject or equivalent level qualification.
• Significant experience of working at a similar level in specialist area.

Experience & Knowledge

Essential

• Significant experience in using common SQL-based query tools.
• Proven experience in data engineering, with expertise in designing, building, and maintaining data pipelines, data warehouses, and/or data lakes.
• Experience of Using ETL tools like SQL Server Integration Services (SSIS) or an equivalent ETL/ELT tool.
• Knowledge of data modelling, database design, and data integration patterns.
• Familiarity with DevOps practices and tools for collaborative development, testing, and deployment.

Desirable

• Knowledge of data governance principles, data quality practices, and data security measures.
• Experience in the use of cloud based BI tools including Microsoft Azure BI solutions (e.g. Azure Data Factory, MS SQL server, Databricks/Snowflake or equivalent tool)
• Experience with other programming languages such as Python and 'R'
• Experience of using any reporting tool preferably Tableau
• Previous experience of working within the NHS or social care services and/or Knowledge of the key performance indicators for NHS and social care mental health services.
• Previous experience of working within mental health or substance misuse services

Communication Skills

Essential

• Clear communicator with excellent writing, report writing and presentation skills; capable of constructing and delivering clear ideas and concepts concisely and accurately for diverse audiences.
• Engaging and comprehensive presentational skills for conveying complex concepts to a varied audience

Analytical Skills

Essential

• Excellent analytical skills with a proven ability to analyse and interpret information, pre-empt and evaluate issues, and recommend appropriate course of action to address the issues using complex, conflicting data from multiple sources.
• Excellent numeric, critical reasoning, analytical skills - able to interpret, analyse, integrate and effectively communicate data and information from a range of sources using tables, graphs and text.
• Ability to understand a broad range of complex information quickly and making decisions where opinions differ/no obvious solution

Planning & Organisation Skills

Essential

• Experience of the successful, implementation, use and maintenance of data warehouse solutions to support an organisation
• Experience of setting up and implementing internal processes and procedures.
• Able to influence junior staff team members -setting, communicating and demonstrating clear standards and supporting personal development.
• Able to plan and coordinate the work of self and others to achieve agreed team objectives and meet tight and often conflicting deadlines.

Desirable

• Evidence (using agile & other methods) of planning and delivering programmes and projects and services on time.

Disclosure and Barring Service Check

This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.

Certificate of Sponsorship

Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).

From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).

Employer details

Employer name

Central and North West London NHS Foundation Trust

Address

CNWL HQ

350 Euston Road

London

NW1 3AX

Employer's website

https://www.cnwl.nhs.uk/work (Opens in a new tab)