Databricks Architect
- Level
- Lead
Not stated in the posting: salary, work type, visa.
Open. First seen 13 November 2026.
About the role
Role Overview
We are looking for an experienced Senior Databricks Consultant / Architect to lead the design, architecture, development, and implementation of enterprise-scale data engineering and analytics solutions using Azure Databricks. The ideal candidate should have strong expertise in Lakehouse architecture, PySpark, Delta Lake, cloud data platforms, and data governance.
Key Responsibilities
- Design and architect scalable, secure, and high-performance Lakehouse solutions using Databricks.
- Lead end-to-end data engineering and data platform implementation.
- Define enterprise data architecture, standards, best practices, and technical roadmaps.
- Design and implement data pipelines using PySpark, Spark SQL, Delta Lake, and Databricks Workflows.
- Develop and optimize ETL/ELT pipelines for batch and streaming data processing.
- Implement Medallion Architecture (Bronze, Silver, Gold) and Delta Live Tables (DLT).
- Work extensively with Unity Catalog for data governance, security, access control, and lineage.
- Integrate Databricks with Azure services such as ADLS Gen2, Azure Data Factory, Event Hubs, and Azure Key Vault.
- Optimize Spark workloads, cluster configurations, SQL queries, and overall platform performance.
- Implement CI/CD pipelines, automated deployments, and DevOps practices.
- Provide technical leadership, conduct design reviews, and mentor data engineering teams.
- Collaborate with business stakeholders, architects, and engineering teams to translate business requirements into technical solutions.
Mandatory Technical Skills
- Strong hands-on experience with Azure Databricks and Apache Spark.
- Expertise in PySpark, Spark SQL, Python, and SQL.
- Strong knowledge of Delta Lake and Lakehouse architecture.
- Experience implementing Medallion Architecture.
- Expertise in Unity Catalog, Delta Live Tables (DLT), and Auto Loader.
- Strong understanding of ETL/ELT design and data pipeline development.
- Experience with Azure Data Lake Storage (ADLS Gen2) and Azure Data Factory.
- Knowledge of Databricks Workflows, cluster management, and performance tuning.
- Experience with data security, governance, and access management.
- Hands-on experience with Git, Azure DevOps, and CI/CD.
Good to Have
- Experience with AWS Databricks or GCP Databricks.
- Knowledge of Kafka, Event Hubs, and real-time data streaming.
- Experience with Databricks SQL and Lakehouse Monitoring.
- Knowledge of Terraform and Infrastructure as Code.
- Experience with MLflow and the Databricks Machine Learning ecosystem.
- Databricks Professional-level certifications.
Candidate Profile
- Strong experience in enterprise data architecture and large-scale data engineering implementations.
- Ability to independently drive architecture decisions and technical delivery.
- Excellent communication, stakeholder management, and problem-solving skills.
- Ability to work with cross-functional teams and provide technical direction.
What this role asks for
Particular to this role
Azure DevOps · Delta Lake · Kafka · MLflow · Terraform
Rare in Unison Group's other 169 open postings.
In most of Unison Group's ads
SQL
Named in most of its open postings, whatever the role.
Compared with Unison Group's other open jobs.
The team: Bharat HIRES STEADILY
This role is one of 30 open in Bharat. 9 were posted in the last 30 days and the oldest in March: a team that hires all year rather than one being built.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
SQL (23 of 30), Azure (20 of 30), Python (20 of 30), CI/CD (19 of 30), Databricks (14 of 30), ETL (13 of 30), GCP (13 of 30)
OTHER ROLES ON THIS TEAM
- Databricks Data Architect posted Nov 18
- C++ Developer posted Nov 11
- Machine Learning Manager (AI) posted Nov 10
- AI & Machine Learning Manager posted Nov 10
- AI & Machine Learning Manager (Techno-Functional) posted Nov 10
- Cloud Engineer ( Google Cloud Engineer) posted Oct 30
- GCP Cloud Engineer - GCP & GKE posted Oct 28
- Teradata Data Architect posted Oct 26
- Data Manager - Databricks posted Oct 16
- Ontology Specialist - Data & AI posted Oct 16
- Data Engineering Manager - Databricks & Lakehouse posted Oct 16
- Ontology Specialist - Data & AI posted Oct 16
- SAP HANA CLOUD Consultant posted Oct 16
- Low Code Engineer (OutSystems Platform) posted Oct 14
- Fullstack Developer posted Oct 14
- Data Engineer (Quantexa) posted Oct 13
- Java Backend Developer (Microservices) posted Oct 12
- Java & Microservices Developer posted Oct 10
- Java & Microservices Developer posted Oct 10
- Java & Microservices Developer posted Oct 10
- Quantexa Data Engineer posted Oct 8
- Resident Solution Architect Databricks posted Oct 6
- Sr Data Engineer (Databricks) posted Oct 2
- Senior Databricks Data Engineer posted Oct 2
- Data Analyst/Business Analyst (SAP BW) posted Sep 25
- Lead Data Engineer (Banking) posted Sep 25
- Techanical Business Analyst - (SAP BW, Python, SQL, Power BI) posted Sep 22
- Senior Data Analyst - SAP BW/ECC, Databricks & BI posted Sep 8
- Business Development Manager - IT Consulting posted Mar 19
From the team and dates on Unison Group's own job board.
Similar jobs
- Databricks Resident Solutions Architect at Ultra Tendency
Shares 13 skills: Delta Lake, MLflow, ETL… · Lead level · same city - Senior Technical Data Security Architect- Remote (Anywhere in the U.S.) at GuidePoint Security
Shares 13 skills: Delta Lake, MLflow, Azure DevOps… · Lead level - Lead ETL Developer / Technical Architect – Big Data & Credit Risk (Databricks) (all humans) at erstedigital
Shares 13 skills: Delta Lake, Azure DevOps, ETL… · Lead level - Resident Solution Architect (RSA) - Data & Databricks at Weekday AI
Shares 13 skills: Delta Lake, MLflow, ETL… · Lead level - Senior Lead Data Engineer - Databricks at Integrant
Shares 13 skills: Delta Lake, MLflow, Azure DevOps… · Lead level - Technical Delivery Manager - API, Microservices and Data at Unison Group
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.