Data Engineer - Data Lake
- Level
- Mid
Not stated in the posting: salary, work type, visa.
Open. First seen 10 November 2026.
About the role
Develop and deliver scalable transformation frameworks across Hadoop platforms by building robust data pipelines, ingestion frameworks, and automation capabilities. Ensure efficient data processing, performance optimization, and reliable integration of enterprise data sources, while supporting data warehouse, enterprise analytics and downstream consumption requirements. This role offers an opportunity to work on large-scale data platforms handling structured, semi-structured, and streaming data across critical banking domains.
Requirements
Data Engineering & Integration
· Design, develop, and maintain scalable data pipelines within the Enterprise Data Lake platform using Cloudera CDP, Hadoop, Spark, Hive, Java, Python, and SQL.
· Develop high-performance batch and near real-time data ingestion frameworks for onboarding enterprise source systems into the Data Lake.
· Develop complex transformation logic using Spark, HiveQL, SQL, and Java-based processing frameworks.
· Design and implement data ingestion patterns supporting structured, semi-structured, and unstructured datasets.
· Build and maintain batch and near real-time data integration solutions.
· Implement source-to-target mappings and ingestion specifications.
Hadoop & Cloudera Platform Development
· Develop and support solutions within the Cloudera Data Platform ecosystem.
· Build and maintain data pipelines leveraging:
· Hadoop HDFS
· Hive
· Impala
· Spark
· Kafka
· YARN, Oozie
· Perform deployment, troubleshooting, and performance tuning of applications running on the Hadoop ecosystem.
· Partner with platform teams to ensure optimal cluster utilization and workload management.
Data Quality & Governance
· Ensure adherence to Data Lake onboarding standards and governance requirements.
· Investigate and resolve data quality issues and production incidents.
· Ensure compliance with enterprise data governance standards.
DevOps & Platform Automation
· Integrate data engineering solutions into CI/CD pipelines using Git, Jenkins, Azure DevOps, or equivalent tools.
· Automate deployment, testing, monitoring, and operational support activities.
· Develop reusable frameworks and utilities to improve engineering productivity and platform scalability.
Production Support & Incident Management
· Provide L3 support for Data Lake application.
· Perform root cause analysis for production incidents and implement permanent fixes.
· Monitor pipeline execution, cluster health, and workload performance.
· Participate in release implementation, deployment validation, and post-production support activities.
· Strong hands on experience with Hadoop ecosystem and data pipeline orchestration.
· Hadoop/HDFS
· Hive
· Spark
· Unix/Linux scripting
· Shell scripting
· ETL/ELT development experience.
· Data modelling fundamentals.
· Performance tuning and optimization.
· Experience in Data Warehousing and Data Lake environments.
· Strong Java / Python competency with experiences.
· Strong SQL development skills.
What this role asks for
Particular to this role
Azure DevOps · Bash · Hadoop · Kafka · Linux · Unix
Rare in Unison Group's other 169 open postings.
Standard for data engineering roles
Azure · CI/CD · Data Warehousing · ETL · Python · Spark
Common in data engineering postings at any company.
In most of Unison Group's ads
SQL
Named in most of its open postings, whatever the role.
Compared with Unison Group's other open jobs.
The team: Manish HIRES STEADILY
This role is one of 49 open in Manish. 18 were posted in the last 30 days and the oldest in May: a team that hires all year rather than one being built.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
SQL (29 of 49), Python (20 of 49), CI/CD (19 of 49), Azure (18 of 49), Machine Learning (15 of 49), AWS (14 of 49), ETL (14 of 49)
OTHER ROLES ON THIS TEAM
- Angular Developer (Banking Domain) posted Nov 18
- Technical Delivery Manager - API, Microservices and Data posted Nov 18
- Senior Java Microservices Developer posted Nov 17
- Technical Delivery Manager - Microservices & Data Platform posted Nov 17
- Inside Sales Executive (AI & Data Solutions - APAC Market) posted Nov 13
- Technical Delivery Manager - Data Lake posted Nov 10
- Murex Application Engineer posted Nov 5
- QlikSense Developer posted Nov 3
- QlikSense Developer - Wholesale Banking posted Nov 3
- Qlik Architect - Banking posted Oct 29
- Teradata Developer - Banking posted Oct 28
- Qlik Developer - Banking posted Oct 28
- Teradata Architect - Banking posted Oct 28
- GenAI Architect - Banking posted Oct 26
- Data Engineering Manager - Big Data posted Oct 22
- Technology Governance Analyst posted Oct 21
- Data Scientist - Manufacturing Analytics posted Oct 20
- SAS Data Engineering & Financial Risk Analytics Specialist posted Oct 14
- Full Stack Developer - Precious Metals Clearing (PMC) posted Oct 13
- Java Microservices Developer posted Oct 13
- AI Solution Architect posted Oct 2
- Senior AI Engineer - Banking posted Oct 1
- Scrum Master posted Sep 29
- AWS Cloud Architect posted Sep 25
- Data Architect - Banking posted Sep 25
- Java Microservices API Developer posted Sep 25
- Gen AI Engineer - Banking posted Sep 25
- AI/ML Architect - Banking posted Sep 25
- Qlik Developer - Banking posted Sep 25
- Polisy Asia Developer - WFH posted Sep 24
- Technical Recruiter posted Sep 22
- AI Software Engineer posted Sep 7
- SUPPORT SPECIALIST & SOFTWARE INTEGRATOR posted Sep 4
- Chief Architect - Data Engineering (Databricks Practice) posted Aug 20
- Senior Databricks Solution Architect posted Aug 19
- AI Program Delivery Lead posted Aug 4
- Senior Databricks Solution Architect posted Jul 23
- AI Engineer (GenAI / RAG / LangGraph / Python) posted Jul 20
- AI Engineer (GenAI / RAG / LangGraph / Python) posted Jul 19
- AI Engineer (Generative AI / AI-ML / Microsoft Copilot) posted Jul 16
- AI Engineer - Forward Deployed Engineer posted Jul 16
- Senior Technical Recruiter - Singapore Market posted Jul 13
- Life400 Developer posted Jun 29
- Life400 Developer posted Jun 29
- AI Engineer (Azure AI Solutions) posted Jun 23
- AI Engineer (GenAI) posted Jun 23
- AI Data Scientist posted Jun 19
- Life400 Developer posted May 13
From the team and dates on Unison Group's own job board.
Similar jobs
- Data Engineer (Public Sector) at Xtremax Pte. Ltd.
Shares 9 skills: Hadoop, Data Warehousing, ETL… · same seniority · same city - Senior Consultant-Senior Software Engineer at Infosys Singapore & Australia
Shares 11 skills: Hadoop, Unix, Data Warehousing… · same city - Senior Python Engineer (Backend and Data) at GSSTech Group
Shares 12 skills: Hadoop, Azure DevOps, Data Warehousing… - Big Data Engineer (Libra) - Data Platform at ByteDance
Shares 8 skills: Hadoop, Data Warehousing, ETL… · same city - Software Engineer - CI/CD (TS/SCI Clearance Required) at North Point Technology
Shares 12 skills: Hadoop, Unix, Azure DevOps… · same seniority - Technical Delivery Manager - API, Microservices and Data at Unison Group
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.