Job summary
Are you a data engineer with a passion for public service? Then maybe you're looking for us!
We are seeking an experienced and skilled Advanced Data Engineer to be part of a growing team that delivers on our mission of protecting and improving the health and wellbeing of the people of Wales. You'll be involved in improving our data practices, cataloguing our data, automating our data processing, analytical pipelines and developing our overall data maturity.
Working with us you'll collaborate with other technical specialists (such as developers, database administrators, data analysts and data scientists) on the development, implementation, maintenance, and improvement of robust, efficient, secure, and scalable data infrastructure. You'll play a key role in communicating between technical and non-technical; listening to, interpreting and translating the needs of technical and business stakeholders to ensure shared understanding and effective solutions.
Main duties of the job
You'll be a champion for data engineering as a profession, agile development practices and methods such as CI/CD. You'll support the development of the team's reporting capabilities, making use of the Microsoft Stack (SQL Server, SSMS, SSIS & SSRS), Power BI and Azure DevOps.
By building robust data platforms, pipelines, and catalogues and by defining the metadata, models and schema that underpin our data decision-making, you'll be right at the heart of modernising and improving the way we do things.
Accountabilities
- Implement enterprise data models, pipelines, and metadata management
- Develop and maintain data platform components (e.g. data catalogue, data lake, warehouse, ETL frameworks)
- Follow best practice in data security, compliance, and the ethical use of data in accordance with standards and requirements such as GDPR and Cyber Essentials Plus
- Implement robust data ingestion and integration frameworks that ensure data consistency, accuracy, and timeliness across our systems.
Collaborate with business, product, and engineering teams to understand data needs and translate them into functional data products, aligning our data architecture with wider organisational digital strategies and priorities
- Provide technical guidance to other specialists, fostering a culture of engineering excellence and continuous learning and following engineering standards
- Support the delivery of strategic projects
Please refer to the attached job profile for more details.
About us
We are Public Health Wales - the national public health agency in Wales. Our purpose is 'Working together for a healthier Wales'. We exist to help everyone in Wales live longer, healthier, happier lives. Together with our partners, we work to increase healthy life expectancy, improve health and well-being, and reduce inequalities for everyone in Wales, now and for future generations.
Our teams work to prevent disease, protect health, and provide leadership, specialist services and public health expertise. We are the leading source of public health information, research and innovation in Wales. In a world facing complex health challenges, our work has never been so important.
We are guided by our Values, 'Working together, with trust and respect, to make a difference'. We are committed to building an inclusive workplace that values equality and diversity. We welcome applications which represent the rich diversity of the communities we serve and are supportive of flexible working arrangements, including part time roles and job sharing.
To find out more about working for us and the benefits we offer please visit https://phw.nhs.wales/careers/
For guidance on the application process, please visithttps://phw.nhs.wales/working-for-us/applicant-information-and-guidance/
Job description
Job responsibilities
Key Skills, Knowledge and Experience:
- Advanced SQL and scripting skills (e.g., TSQL, PowerShell[LN1][FB2]) for data engineering, automation and orchestration tasks.
- Advanced database manipulation and administration skills, particularly T-SQL, Azure SQL, as well as capacity with unstructured and unlinked data management languages.
- Experience using and implementing schema and metadata design (e.g., star schema, snowflake, normal forms), with strong understanding of master and reference data management.
- Experience working with Azure/GCP building and managing data solutions such as data lakes or data warehouses, Azure Data Factory, Data Bricks and so forth
- Skilled in using cloud tools such DataFlow, Cloud Composer and Big Query
- Experience with data visualisation tools, particularly on the Microsoft Stack or GCP.
- Knowledge of data integration patterns and technologies (e.g., ETL, ELT, API-first), including near real-time and event-driven approaches.
- Experience in on-prem to Cloud migration and greenfield projects.
- Experience collaborating with business stakeholders, analysts, and developers to translate business needs into technical solutions.
What you'll bring to the team:
- Proven experience as a Data Engineer in a hands-on role, with communication and collaboration skills to match your technical expertise.
- Proven experience in cloud platforms such Azure and GCP.
- Strong proficiency in automation of data processes, particularly ETL/ELT at scale.
- Advanced programming skills in SQL and Python [LN3][FB4]and a collaborative, CI/CD approach to pushing code; experience with orchestration and data pipeline tools.
A user-focused approach to data delivery, ensuring that outputs are accessible, actionable and grounded in real-world context
- Effective communication and stakeholder engagement skills, with the ability to influence at all levels of the organization.
- A collaborative mindset, coupled with a passion for delivering in a high-performing team environment.
You will be able to find a full Job description and Person Specification attached within the supporting documents or please click "Apply now" to view on Trac.
The ability to speak Welsh is desirable for this post; Welsh and/or English speakers are equally welcome to apply.
Job description
Job responsibilities
Key Skills, Knowledge and Experience:
- Advanced SQL and scripting skills (e.g., TSQL, PowerShell[LN1][FB2]) for data engineering, automation and orchestration tasks.
- Advanced database manipulation and administration skills, particularly T-SQL, Azure SQL, as well as capacity with unstructured and unlinked data management languages.
- Experience using and implementing schema and metadata design (e.g., star schema, snowflake, normal forms), with strong understanding of master and reference data management.
- Experience working with Azure/GCP building and managing data solutions such as data lakes or data warehouses, Azure Data Factory, Data Bricks and so forth
- Skilled in using cloud tools such DataFlow, Cloud Composer and Big Query
- Experience with data visualisation tools, particularly on the Microsoft Stack or GCP.
- Knowledge of data integration patterns and technologies (e.g., ETL, ELT, API-first), including near real-time and event-driven approaches.
- Experience in on-prem to Cloud migration and greenfield projects.
- Experience collaborating with business stakeholders, analysts, and developers to translate business needs into technical solutions.
What you'll bring to the team:
- Proven experience as a Data Engineer in a hands-on role, with communication and collaboration skills to match your technical expertise.
- Proven experience in cloud platforms such Azure and GCP.
- Strong proficiency in automation of data processes, particularly ETL/ELT at scale.
- Advanced programming skills in SQL and Python [LN3][FB4]and a collaborative, CI/CD approach to pushing code; experience with orchestration and data pipeline tools.
A user-focused approach to data delivery, ensuring that outputs are accessible, actionable and grounded in real-world context
- Effective communication and stakeholder engagement skills, with the ability to influence at all levels of the organization.
- A collaborative mindset, coupled with a passion for delivering in a high-performing team environment.
You will be able to find a full Job description and Person Specification attached within the supporting documents or please click "Apply now" to view on Trac.
The ability to speak Welsh is desirable for this post; Welsh and/or English speakers are equally welcome to apply.
Person Specification
Qualifications and Knowledge
Essential
- oUndergraduate degree or equivalent knowledge and skills in data engineering or related discipline, for example (but not limited to) computer science, data science, information technology, software engineering, or other discipline with a substantial data engineering component
- oEvidence of continuing professional development and practical application of learning in data engineering
Experience
Essential
- oGood technical skills and experience in Python / R, Power BI and Power Apps, Google Cloud Platform, Azure, cloud-to-on-prem engineering, SQL, NoSQL, dashboards, databases and visualisation, APIs, including understanding and application of good practice in these areas
- oEvidence of developing and delivering effective data engineering projects, including data architecture, data modelling, ETL processes, and metadata management concepts
- oEvidence of using tools such as Git, GitHub and / or Azure DevOps to effectively manage work flow, version control, and collaborative development, and use of Agile delivery methodologies
- oEvidence of understanding and application of data security, governance, and compliance regulations
- oEvidence of successful delivery of data engineering products in a complex organisational environment
Skills and Attributes
Essential
- oCommunicating between the technical and non-technical. You can communicate effectively with technical and non-technical stakeholders. You can support and host discussions within a multidisciplinary team, with potentially difficult dynamics. You can be an advocate for the team externally and can manage differing perspectives. (Skill level: working)
- oData analysis and synthesis. You can undertake data profiling and source system analysis. You can present clear insights to colleagues to support the end use of the data. (Skill level: working)
- oData development process. You can design, build, and test data products that are complex or large scale. You can build teams to complete data integration services. (Skill level: practitioner)
- oData innovation. You can understand the impact on the organisation of emerging trends in data tools, analysis techniques and data usage. (Skill level: working)
- oData integration design. You can select and implement the appropriate technologies to deliver resilient, scalable, and future -proofed data solutions. (Skill level: practitioner)
- oData modelling. You can produce relevant data models across multiple subject areas. You can explain which models to use for which purpose. You can understand industry -recognised data modelling patterns and standards, and when to apply them. You can compare and align different data models. (Skill level: practitioner)
- oMetadata management. You can design an appropriate metadata repository and present changes to existing metadata repositories. You can understand a range of tools for storing and working with metadata. You can provide oversight and advice to more inexperienced members of the team. (Skill level: practitioner)
- oProblem resolution (data). You can respond to problems in databases, data processes, data products and services as they occur. You can initiate actions, monitor services, and identify trends to resolve problems. You can determine the appropriate remedy and assist with its implementation, and with preventative measures. (Skill level: working)
- oProgramming and build (data engineering). You can use agreed standards and tools to design, code, test, correct and document moderate-tocomplex programs and scripts from agreed specifications and subsequent iterations. You can collaborate with others to review specifications where appropriate. (Skill level: practitioner)
- oTechnical understanding. You can understand the core technical concepts related to the role and apply them with guidance. (Skill level: working)
- oTesting. You can review requirements and specifications and define test conditions. You can identify issues and risks associated with work. You can analyse and report test activities and results. (Skill level: working)
- oA demonstrated ability to embrace, drive, and lead change, to lead others to achieve organisational goals and objectives, with an enthusiasm for improving performance and services
- oThe ability to flexibly adjust plans and workloads to meet the requirements of the role, such as planning and organising broad range of complex activities; formulates, adjusts plans or strategies
- oPlans specialist projects which impact across clinical and non clinical areas
- oAbility to demonstrate understanding and application of our workplace valsues, together with the underpinning behaviours identified for success in this role
Desirable
- oWelsh Language Skills are desirable at levels 1 to 5 in understanding, speaking, reading, and writing in Welsh
Other
Essential
- oWillingness and ability to travel between sites in a timely manner to meet the needs of the service
Person Specification
Qualifications and Knowledge
Essential
- oUndergraduate degree or equivalent knowledge and skills in data engineering or related discipline, for example (but not limited to) computer science, data science, information technology, software engineering, or other discipline with a substantial data engineering component
- oEvidence of continuing professional development and practical application of learning in data engineering
Experience
Essential
- oGood technical skills and experience in Python / R, Power BI and Power Apps, Google Cloud Platform, Azure, cloud-to-on-prem engineering, SQL, NoSQL, dashboards, databases and visualisation, APIs, including understanding and application of good practice in these areas
- oEvidence of developing and delivering effective data engineering projects, including data architecture, data modelling, ETL processes, and metadata management concepts
- oEvidence of using tools such as Git, GitHub and / or Azure DevOps to effectively manage work flow, version control, and collaborative development, and use of Agile delivery methodologies
- oEvidence of understanding and application of data security, governance, and compliance regulations
- oEvidence of successful delivery of data engineering products in a complex organisational environment
Skills and Attributes
Essential
- oCommunicating between the technical and non-technical. You can communicate effectively with technical and non-technical stakeholders. You can support and host discussions within a multidisciplinary team, with potentially difficult dynamics. You can be an advocate for the team externally and can manage differing perspectives. (Skill level: working)
- oData analysis and synthesis. You can undertake data profiling and source system analysis. You can present clear insights to colleagues to support the end use of the data. (Skill level: working)
- oData development process. You can design, build, and test data products that are complex or large scale. You can build teams to complete data integration services. (Skill level: practitioner)
- oData innovation. You can understand the impact on the organisation of emerging trends in data tools, analysis techniques and data usage. (Skill level: working)
- oData integration design. You can select and implement the appropriate technologies to deliver resilient, scalable, and future -proofed data solutions. (Skill level: practitioner)
- oData modelling. You can produce relevant data models across multiple subject areas. You can explain which models to use for which purpose. You can understand industry -recognised data modelling patterns and standards, and when to apply them. You can compare and align different data models. (Skill level: practitioner)
- oMetadata management. You can design an appropriate metadata repository and present changes to existing metadata repositories. You can understand a range of tools for storing and working with metadata. You can provide oversight and advice to more inexperienced members of the team. (Skill level: practitioner)
- oProblem resolution (data). You can respond to problems in databases, data processes, data products and services as they occur. You can initiate actions, monitor services, and identify trends to resolve problems. You can determine the appropriate remedy and assist with its implementation, and with preventative measures. (Skill level: working)
- oProgramming and build (data engineering). You can use agreed standards and tools to design, code, test, correct and document moderate-tocomplex programs and scripts from agreed specifications and subsequent iterations. You can collaborate with others to review specifications where appropriate. (Skill level: practitioner)
- oTechnical understanding. You can understand the core technical concepts related to the role and apply them with guidance. (Skill level: working)
- oTesting. You can review requirements and specifications and define test conditions. You can identify issues and risks associated with work. You can analyse and report test activities and results. (Skill level: working)
- oA demonstrated ability to embrace, drive, and lead change, to lead others to achieve organisational goals and objectives, with an enthusiasm for improving performance and services
- oThe ability to flexibly adjust plans and workloads to meet the requirements of the role, such as planning and organising broad range of complex activities; formulates, adjusts plans or strategies
- oPlans specialist projects which impact across clinical and non clinical areas
- oAbility to demonstrate understanding and application of our workplace valsues, together with the underpinning behaviours identified for success in this role
Desirable
- oWelsh Language Skills are desirable at levels 1 to 5 in understanding, speaking, reading, and writing in Welsh
Other
Essential
- oWillingness and ability to travel between sites in a timely manner to meet the needs of the service
Disclosure and Barring Service Check
This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.
Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).
From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).
Additional information
Disclosure and Barring Service Check
This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.
Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).
From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).
