Data Engineer

Job responsibilities

DUTIES AND RESPONSIBILITIES

Develop and maintain complex data transfer pipelines from source systems to the Trust Data Warehouse and Data Marts.

Analyse and interpret requirements and specifications from the Business Intelligence Analysts to inform data construct design, development and assurance processes.

Support the appropriate data warehousing design and software development methodologies agreed for use within the team.

Produce detailed technical specifications and documentation for the support, maintenance, monitoring and quality assurances of ETL processes.

Investigate, support, correct and prevent issues relating to existing Trust developed data reporting systems and processes, identifying issues and implementing resolutions in a timely manner.

Participate in the sprint planning process to determine durations and any dependencies with planned development work.

Develop test plans, and supporting test data, for the developed services in order to validate their stable and maintainable operation against requirements.

Ensure that skills and knowledge are kept up-to-date through professional development.

Make recommendations on new tools, technologies and techniques that can be adopted by the team.

Participate in regular exercises to test business continuity and disaster recovery plans.

Human Resources

Line manage (if applicable) in line with appropriate policies, procedures, working practices and guidelines, ensuring all resources are deployed to maximise an efficient and effective delivery of support services to patients and users.

As requested, provide reports on progress, status and achievements for own work.

Undertake and support the development of staff/placements in line with personal development reviews and other associated guidance.

Provide guidance for staff from own or other disciplines on own subject area, when required.

On limited occasions, by exception, the post holder may be required to work unsociable hours to support and/or enable the delivery of key programmes or projects.

Financial/Physical Resources

Be responsible for the safe and efficient use of hardware, software and financial resources.

Where required, liaise with external agencies, suppliers and contractors ensuring delivery of service is in line with agreed contracts and value for money.

Ensure the post holder adheres to Trust Standing Financial Instructions (SFIs) and procurement guidelines.

Project Management

Advise and participate in the development and implementation of projects as part of planned development sprint cycles.

Ensure project tasks, where required, are successfully delivered in line with agreed timescales and budgets.

Work with line manager to ensure any project management documentation or reports are delivered in line with agreed standards and timescales.

Policy/Service Development/Governance

Act as an ambassador for Digital Services by developing and maintaining excellent working relationships with users across the organisation to deliver a high quality professional service as part of the a development team.

Pro-actively participate in ensuring that Digital services delivered within the Trust reflect best practice with respect to organisational, NHS and legislative requirements and guidelines including IT Infrastructure Library (ITIL), Data Protection Act 2018, Information Standards, Information Security and compliance with NHS Information Governance.

Ensure all documentation relating to own area is complete and fit for purpose and all releases relating to hardware, software and documentation is controlled.

Ensure there is a proactive and comprehensive approach to risk management and be responsible for service continuity for own area.

Contribute to Root Cause Analysis (RCA) for allocated incidents and problems; instigating action when required, liaising with other team members and managers, as appropriate.

Business Continuity Management

Be familiar with the Trust and Department level Business Continuity Plan and personal responsibilities within, where applicable.

Qualifications

Essential

• University Degree in a related subject or demonstrable equivalent experience in developing Business Intelligence Solutions.

Desirable

• UK Council for Health Informatics Professionals (UKCHIP) registration or equivalent.
• Agile development qualification
• Microsoft certifications or equivalent technical qualifications.

Experience

Essential

• Substantial experience of design, build and deployment of Business Intelligence functions in a large/complex organisation.
• Substantial experience of SQL Server database/data warehouse development maintenance and support.
• Substantial experience of handling ETL solutions and issues across a range of systems.
• Substantial experience of delivering complex data and reporting projects.
• Experience in task resource estimation for sprint planning.
• Experience in creating and updating system documentation relating to Business Intelligence processes.
• Experience in developing data interchange processes using XML and JSON.
• Experience of successfully managing a number of equally important tasks to completion.

Desirable

• Previous experience of working in the NHS.
• Database table partitioning.
• Data transfer using a web API.
• Transferring data using SFTP.

Skills

Essential

• Creating well-structured SQL Server Integration Services packages for data transfer and Data Warehouse ETL processes.
• Designing and implementing SQL Server Reporting Services reports.
• Data transfer using XML and JSON.
• Developing custom SSIS Script Tasks/Components using C# to add non-standard functionality to SSIS Packages.
• Using Visual Studio for database and business intelligence development.
• Advanced T-SQL query writing.
• Microsoft Excel.
• Ability to use own initiative, coach individuals and lead a project team engendering enthusiasm and commitment.
• Able to work to deadlines, prioritise and manage workload in a busy and changing environment.q
• Strong problem solving approach.
• Ability to work under pressure.
• Influencing and negotiating skills
• Ability to think creatively.
• Ability to explain complex technical issues to a non-technical audience.

Desirable

• Azure DevOps.
• Tableau.
• Power BI.
• SQL Server Analysis Services.
• MDX.
• R.
• Python.
• Source control using Visual Studio.
• Master Data Services.
• Business Intelligence Markup Language and BIML Express.

Knowledge

Essential

• Good knowledge of industry standard Data Warehouse design methodologies, i.e., Kimball.
• SQL Server query optimisation techniques.
• SSIS package performance optimisation.
• Best practices relating to the Microsoft SQL Server stack.

Desirable

• NHS data dictionary and standards.

Values

Essential

• Ability to demonstrate the organisational values and behaviours

Other

Essential

• Evidence of continuing professional and personal development.
• Ability to travel to Christie managed sites as necessary.
• Ability to undertake shift working including out-of-hours, weekend and Public Holidays as required

Disclosure and Barring Service Check

This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.

Certificate of Sponsorship

Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).

From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).