Lead Big Data Engineer

We are seeking a skilled and detail-oriented Data Engineer to design, develop, and maintain robust data pipelines and ETL solutions. This role involves working closely with cross-functional teams to ensure data quality, scalability, and alignment with business and technical requirements. Design, develop, test, and maintain scalable ETL pipelines to meet business, technical, and user requirements. Collect, refine, and integrate new datasets. Maintain comprehensive documentation and data mappings across multiple systems. Create optimized and scalable data models that align with organizational data architecture standards and best practices. Drive continuous improvement in data quality through optimization, testing, and solution design reviews. Ensure all solutions conform to big data architecture guidelines and long-term roadmap. Implement robust monitoring, logging, and alerting systems to ensure pipeline reliability and data accuracy. Apply best practices in data engineering to design and build reliable data marts within the Hadoop ecosystem for planning, reporting, and analytics. Maintain and optimize data pipelines to ensure data accuracy, integrity, and timeliness. Manage code in a centralized repository with clear branching strategies and well-documented commit messages. Coordinate with stakeholders to ensure smooth production deployment and adherence to data governance policies. Proactively identify and implement improvements to data engineering processes and workflows. Develop end-to-end solutions for data modeling in the data warehouse, including data acquisition, contextualization, and integration with business processes. Ensure adherence to development standards and perform periodic reviews to maintain pipeline performance and sustainability. Coordinate and conduct testing with stakeholders to ensure effective deployment of data pipelines and dashboards. Serve as the primary data engineering contact at the stakeholder location, ensuring clear communication and alignment on priorities Monitor data pipelines continuously and collaborate with stakeholders to troubleshoot and optimize performance. Leverage domain knowledge in insurance to design data models and pipelines that support business processes and analytics. Work closely with business stakeholders to understand requirements and translate them into scalable data engineering solutions. We are looking for people who Diploma with at least 10 years’ working experience, preferably in Life Insurance Proven experience in data engineering, ETL development, and big data technologies A strong team player who is meticulous, detail-oriented, and capable of performing under pressure Proficiency in tools and platforms such as Hadoop, Spark, Hive, and cloud data services(e.g., AWS, Azure, GCP). Possesses strong problem-solving and interpersonal skills. Committed, dependable, and adaptable with the flexibility to support during peak periods and tight deadlines Demonstrate high integrity, accountability, and a collaborative mindset Takes initiative to improve current state of things and embrace change How you succeed Champion and embody our Core Values in everyday tasks and interactions. Demonstrate high level of integrity and accountability. Take initiative to drive improvements and embrace change. Take accountability of business and regulatory compliance risks, implementing measures to mitigate them effectively. Keep abreast with industry trends, regulatory compliance, and emerging threats and technologies to understand and highlight potential concerns/ risks to safeguard our company proactively. Who we are Founded in 1908, Great Eastern is a well-established market leader and trusted brand in Singapore and Malaysia. With over S$100 billion in assets and more than 16million policyholders, including 12.5 million from government schemes, it provides insurance solutions to customers through three successful distribution channels – a tied agency force, bancassurance, and financial advisory firm Great Eastern Financial Advisers. The Group also operates in Indonesia and Brunei. The Great Eastern Life Assurance Company Limited and Great Eastern General Insurance Limited have been assigned the financial strength and counterparty credit ratings of "AA-" by S&P Global Ratings since 2010, one of the highest among Asian life insurance companies. Great Eastern's asset management subsidiary, Lion Global Investors Limited, is one of the leading asset management companies in Southea…