Data Engineer (Cloud Data Platform & AI)

About the Role We are partnering with a leading public sector organisation to hire a Data Engineer to support the design, development, and optimisation of enterprise-scale cloud data platforms. This role offers the opportunity to work on modern Data & AI platforms , designing scalable data architectures, building high-performance data pipelines, and enabling advanced analytics and AI capabilities. You'll collaborate with cross-functional teams to deliver cloud-native data solutions that support business intelligence, machine learning, and data-driven decision-making. If you enjoy solving complex data engineering challenges and working with cloud technologies, this is an excellent opportunity to contribute to large-scale digital transformation initiatives. Key Responsibilities Data Architecture & Platform Engineering Design and implement scalable, secure, and highly available cloud-based data architectures. Develop and maintain enterprise Data Lakehouse solutions to support analytics and AI workloads. Collaborate with business and technical stakeholders to gather requirements and translate them into scalable technical solutions. Develop architectural documentation and technical specifications for enterprise data platforms. Data Pipeline Development Design, build, and maintain robust ETL/ELT data pipelines using modern data engineering frameworks. Optimise data processing workflows for scalability, reliability, and cost efficiency. Implement automated data quality validation, monitoring, and alerting mechanisms. Ensure data integrity and operational excellence across production environments. Cloud Data & AI Solutions Design and implement cloud-native Data & AI solutions aligned with business and technical objectives. Support cloud migration initiatives and modernisation of enterprise data platforms. Integrate AI and machine learning capabilities into enterprise data architectures. Evaluate emerging technologies and recommend modern cloud-native solutions. Cloud Infrastructure & Operations Build and manage cloud-based data infrastructure using cloud-native services. Implement Infrastructure-as-Code (IaC) using Terraform. Ensure compliance with cloud security, governance, and data protection standards. Support platform monitoring, optimisation, and operational excellence. Technical Leadership Provide technical guidance and mentorship to junior engineers. Participate in architecture reviews and contribute to technology roadmaps and best practices. Collaborate closely with solution architects, developers, data scientists, and business stakeholders to deliver enterprise data solutions. Requirements Essential Skills & Experience Bachelor's Degree in Computer Science, Information Technology, Computer Engineering, or a related discipline. Minimum 3 years of experience in Data Engineering, Data Platform Engineering, or Data Architecture. Proven experience designing and implementing production-scale data pipelines and cloud-based data platforms. Strong understanding of:Data Lakehouse architectureDataOps principlesCloud-native architecturesDistributed systemsInfrastructure-as-Code (IaC)Microservices architectureCloud security and Identity & Access Management (IAM) Strong hands-on experience with:SQLPythonApache Spark Experience with data orchestration and streaming technologies such as:Apache KafkaApache AirflowSimilar workflow orchestration tools Ability to translate business requirements into scalable technical solutions. Strong communication and stakeholder management skills. All information will be kept strictly confidential. Only shortlisted candidates will be contacted. TALENT PULSE PTE. LTD. EA License No: 25S2956