Data Engineer

Responsibilities Champion Data Access and User Experience Evaluate and coordinate data requests from business users, serving as their trusted advisor to understand requirements and recommend the most suitable datasets for their objectives. Transform complex data availability assessments into clear, actionable guidance, helping users navigate HPB's data ecosystem with confidence. Collaborate seamlessly with requestors, data operations team, and domain data engineers to ensure swift and effective fulfilment of approved data requests. Deliver Excellence in Data Engineering andService Design and implement robust data extraction and delivery processes that meet diverse business needs whilst maintaining high standards of accuracy and security. Orchestrate recurring data contributions to government partners, ensuring seamless coordination from ingestion through to compliant, timely delivery. Ensure all data services comply with established governance framework and access control standards, maintaining trust and reliability. Enhance Data Discovery and OrganisationalIntelligence Curate and maintain comprehensive metadata for HPB's data discovery platform, ensuring datasets are accurately described and easily discoverable for informed decision-making. Collaborate with data owners and engineering team to elevate metadata quality, creating comprehensive catalogues that empower users to find and utilise data effectively. Continuously improve dataset descriptions, classifications, and catalogue information to enhance the user experience across the organisation. Provide Expert Support and ContinuousInnovation Deliver exceptional Level-1 support through the CDOO service management system, providing triaging and guidance that keeps operations running smoothly. Identify and champion process improvements that enhance service quality, reduce turnaround times, and elevate user satisfaction across all data service touchpoints. Maintain comprehensive documentation and knowledge systems that support operational excellence and team development. Qualifications Experience: Minimum 2 years in data engineering, operations, analytics support, integration, or metadata management roles at Associate consultant level. Public health experience is advantageous. Education: Bachelor’s degree in Computer Science, Computer Engineering, Information Systems, Data Analytics, or related discipline from a recognised institution. Alternatively, professional certifications in data engineering, data analytics or data science from accredited bodies, combined with relevant experience, are acceptable for Bachelor’s degree in Engineering or Science. Technical Proficiency: SQL (Structured Query Language) and PySpark and/or Python with hands-on experience in structured datasets and data transformation processes Cloud-based data platforms, preferably Microsoft Azure, including Databricks and enterprise data warehouse environments Data governance, metadata management, and data catalogue concepts Core Competencies: Exceptional stakeholder management and communication abilities Strong analytical and problem-solving mindset with service-oriented approach Process-oriented thinking with ability to translate business requirements into actionable data solutions Attention to detail and commitment to operational excellence Advantageous Skills: Microsoft Purview and Unity Catalog experience Professional certifications in cloud, data engineering, data governance, or analytics domains