Job summary
We have an exciting opportunity for a Data Engineer within the Business Intelligence team.
This role within the team will support existing projects and the development and implementation of new cloud-based technologies. You will support and lead on exciting and always interesting projects using your technical expertise as a key member of the development team and have the opportunity to shape and guide existing work and new projects.
This is an exciting opportunity to join a great team with opportunity to develop skills and implement new technologies as we look to develop the data platform and support national developments.
You will have experience working with large datasets and experience of working with a range of data products and platforms.
Midlands and Lancashire Commissioning Support Unit recognises the value serving personnel, reservists, veterans, and military families bring to our business and would encourage people from the armed forces community to apply for our vacancies.
Main duties of the job
You will be working with Senior and Lead Data Engineers in the Development team as well as colleagues across the wider Business Intelligence Team. You will provide technical advice and support and the opportunity to implement and improve processes and methodology where necessary.
You will have experience working in a similar data environment and delivering ETL/ELT processes. You will be able to manage the workload of yourself and support the team and be able to communicate issues to a range of audience as required.
You will be a valuable member of the Business Intelligence team, supporting the development of the work the being delivered and maintaining our reputation for excellence.
You will be provided with all the opportunities you require to develop your skills and build your career, both through formal training and hands-on experience.
MLCSU is committed to our process of redeployment of at risk members of our existing workforce to new roles. As such, all job adverts are subject to this policy and we reserve the right to close, delay or remove adverts while this process is completed. If you do experience a delay in the shortlisting stage of the recruitment cycle, please bear with us while this process is completed, and contact the named contact if you have any questions.
About us
NHS Midlands and Lancashire is one of the biggest and best-performing commissioning support units in the country, with among the highest levels of staff and customer satisfaction. We work together as a team of over 1,600 expert staff based across the Midlands and North West to make a difference - for our customers, patients and communities.
Offering a full range of professional services to hospital trusts, local authorities, integrated care systems (ICSs) and other public bodies across the country, our NHS values underpin everything we do.
The development team are a small team within the wider Business Intelligence team responsible for ensuring the data flows and data pipelines operate effectively and efficiently to support onward analysis.
The team is based in various locations, mostly working from home with the ability to utilise desk space at various offices.
In return, we provide a supportive environment in which to learn and develop, with the opportunity to further your skills and career within an exciting and evolving environment.
Joining our inclusive and innovative team comes with a range of benefits including flexible & agile working arrangements, pension scheme and generous annual leave allowance.
Job description
Job responsibilities
Design, Implementation, and Testing: Support in the design, implementation, testing, deployment, and support of various BI solutions. This involves working on specific components or modules of the solutions under the guidance of the senior data engineer.
ETL/ELT and Delta Processing: Contribute to the design and improvement of ETL/ELT and Delta processing models, helping to implement data integration processes efficiently and effectively.
Data Quality and Integrity: Assist in developing and maintaining data quality, integrity, validation, and monitoring processes, ensuring that data remains accurate, consistent, and reliable.
Debugging and Troubleshooting: Assist in debugging and troubleshooting complex SQL queries, BI tools, systems, and software, working alongside the senior data engineer to identify and resolve issues.
SSIS Packages and Data Factory Pipelines: Collaborate on the design and development of SSIS packages and Azure Data Factory pipelines, potentially assisting in building and maintaining these components.
Data Pipelines: Participate in building and maintaining data pipelines, ensuring they are robust, performant, secure, and cost-effective.
Security Implementation: Support in incorporating security and data protection protocols into solution designs, ensuring compliance with relevant regulations and best practices.
Upgrades and Migrations: Assist in upgrades, migrations, and enhancements of the data warehouse to new platforms and solutions, working alongside the senior data engineer and other team members.
Explore New Technologies: Participate in the continuous exploration and experimentation of new technologies to improve existing designs, solutions, and platforms, contributing ideas and insights to the team.
Source Code Repository Maintenance: Responsible for maintaining solutions within source code repositories, ensuring version control and proper documentation.
Support Deployment Processes: Assist in deploying solutions into operational environments following appropriate release and change control processes.
Documentation: Contribute to fully documenting all reports and systems developed, ensuring comprehensive and accurate documentation.
Policy: Ensure all activity adheres to a strict change control process to minimise any adverse effects to the working environment and its end users. And ensure processes and policy are adhered to.
Collaboration and Testing: Work collaboratively with colleagues, including other data engineers and business intelligence analysts, in carrying out testing activities, sharing insights and findings.
Provide Support and Leadership: Provide support and insight in solving complex issues and developing innovative solutions, under the guidance of the senior data engineer. This will include proposing changes to procedures and working practices to improve service delivery.
Assist in Recruitment and Management: Assist in the recruitment and selection of Graduates/Apprentices and provide management support and supervision as part of their overall development plan, potentially taking on specific mentoring or supervisory roles as needed.
Job description
Job responsibilities
Design, Implementation, and Testing: Support in the design, implementation, testing, deployment, and support of various BI solutions. This involves working on specific components or modules of the solutions under the guidance of the senior data engineer.
ETL/ELT and Delta Processing: Contribute to the design and improvement of ETL/ELT and Delta processing models, helping to implement data integration processes efficiently and effectively.
Data Quality and Integrity: Assist in developing and maintaining data quality, integrity, validation, and monitoring processes, ensuring that data remains accurate, consistent, and reliable.
Debugging and Troubleshooting: Assist in debugging and troubleshooting complex SQL queries, BI tools, systems, and software, working alongside the senior data engineer to identify and resolve issues.
SSIS Packages and Data Factory Pipelines: Collaborate on the design and development of SSIS packages and Azure Data Factory pipelines, potentially assisting in building and maintaining these components.
Data Pipelines: Participate in building and maintaining data pipelines, ensuring they are robust, performant, secure, and cost-effective.
Security Implementation: Support in incorporating security and data protection protocols into solution designs, ensuring compliance with relevant regulations and best practices.
Upgrades and Migrations: Assist in upgrades, migrations, and enhancements of the data warehouse to new platforms and solutions, working alongside the senior data engineer and other team members.
Explore New Technologies: Participate in the continuous exploration and experimentation of new technologies to improve existing designs, solutions, and platforms, contributing ideas and insights to the team.
Source Code Repository Maintenance: Responsible for maintaining solutions within source code repositories, ensuring version control and proper documentation.
Support Deployment Processes: Assist in deploying solutions into operational environments following appropriate release and change control processes.
Documentation: Contribute to fully documenting all reports and systems developed, ensuring comprehensive and accurate documentation.
Policy: Ensure all activity adheres to a strict change control process to minimise any adverse effects to the working environment and its end users. And ensure processes and policy are adhered to.
Collaboration and Testing: Work collaboratively with colleagues, including other data engineers and business intelligence analysts, in carrying out testing activities, sharing insights and findings.
Provide Support and Leadership: Provide support and insight in solving complex issues and developing innovative solutions, under the guidance of the senior data engineer. This will include proposing changes to procedures and working practices to improve service delivery.
Assist in Recruitment and Management: Assist in the recruitment and selection of Graduates/Apprentices and provide management support and supervision as part of their overall development plan, potentially taking on specific mentoring or supervisory roles as needed.
Person Specification
Experience
Essential
- Experience of working across a full range of Business Intelligence technologies. Including in the development of Azure or other cloud-based technologies, the full set of Microsoft Business Intelligence technologies, working with datasets of varying complexity.
Skills
Essential
- Able to provide and receive complex, sensitive information, identify, and grasp highly complex technical issues arising from business plans and user specifications and able to communicate these issues to technical and non-technical staff in a clear and unambiguous way.
- Knowledge of a full range of Business Intelligence technologies as described in the person specification.
Personal Qualities
Essential
- Ability to work without supervision, providing specialist advice across BI functions. Manages own time, working flexibly to prioritise responses to wide range of competing demands.
- Self-motivated, good self-management with an eye for detail and ability to track issues and prioritise when under pressure.
Person Specification
Experience
Essential
- Experience of working across a full range of Business Intelligence technologies. Including in the development of Azure or other cloud-based technologies, the full set of Microsoft Business Intelligence technologies, working with datasets of varying complexity.
Skills
Essential
- Able to provide and receive complex, sensitive information, identify, and grasp highly complex technical issues arising from business plans and user specifications and able to communicate these issues to technical and non-technical staff in a clear and unambiguous way.
- Knowledge of a full range of Business Intelligence technologies as described in the person specification.
Personal Qualities
Essential
- Ability to work without supervision, providing specialist advice across BI functions. Manages own time, working flexibly to prioritise responses to wide range of competing demands.
- Self-motivated, good self-management with an eye for detail and ability to track issues and prioritise when under pressure.
Disclosure and Barring Service Check
This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.
Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).
From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).
Additional information
Disclosure and Barring Service Check
This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.
Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).
From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).
