Lead Data Engineer, Databricks (Remote, US)
- Level
- Lead
- Work type
- Remote · US only
Not stated in the posting: salary, visa.
Open. First seen 13 November 2026.
About the role
About V4C.ai
V4C is a pure-play Databricks partner, and in under two years we have earned 850+ Databricks certifications across 325+ customers and been named Databricks' 2026 Partner of the Year (C&SI Emerging).
As a Lead Data Engineer, you will lead the build of production Lakehouse pipelines on customer engagements, working directly with customers and often Databricks' own field teams. Every technical hire here gets a certification roadmap built for them and taught in-house by Databricks-approved trainers, plus a dedicated Employee Success Manager whose only responsibility is your experience at V4C.
The Role
Lead Data Engineers are the technical backbone of V4C delivery. You lead the engineering workstream on an engagement — translating an architecture into working pipelines, setting the patterns the team follows, and owning the quality of what ships. You will work across batch and streaming, on messy enterprise source systems, under real deadlines, and in front of the customer explaining what you built and why. The difference from a Data Engineer is ownership: you are accountable for a workstream and the engineers on it.
Responsibilities
- Lead engineering on customer engagements, from design through production handover
- Build and optimize batch and streaming pipelines using PySpark, SQL, and Delta Lake on Databricks
- Implement Medallion architecture across cloud ecosystems and set the layer conventions the team follows
- Own performance and cost: benchmark Spark jobs, tune SQL, right-size compute, and explain the trade-offs to the customer
- Implement data quality and validation as code, including Lakeflow expectations and automated testing in CI
- Mentor mid-level and junior engineers through code review, pairing, and design feedback
- Partner with the Data Architect on design decisions, and escalate when implementation reveals the design will not hold
Requirements
- 7+ years of data engineering plus experience leading projects or teams
- Strong proficiency in Python, SQL, Apache Spark, and Delta Lake
- Production experience building both batch and streaming pipelines at enterprise scale
- Hands-on experience with AWS, Azure, or GCP and its data services
- Experience with data modeling, Git, and CI/CD for data workloads
- Demonstrated experience optimizing Spark performance and managing platform cost
- Strong client communication skills, including the ability to explain technical trade-offs to a non-technical stakeholder
Preferences
- Healthcare or life sciences experience preferred but not required
- Existing Databricks Certified Data Engineer Associate or Professional certification
- Hands-on experience with Unity Catalog, Lakeflow, or Databricks Asset Bundles
- Experience with dbt, Airflow, or equivalent orchestration and transformation tooling
- Experience migrating a legacy ETL estate to a modern cloud platform
- Consulting or client-facing engineering background
Benefits
- Unlimited PTO
- Health Care Plan (Medical, Dental & Vision)
- Retirement Plan (401k, IRA)
- Life Insurance (Basic, Voluntary & AD&D)
- Family Leave (Maternity, Paternity)
- Short Term & Long Term Disability
- Training & Development
What this role asks for
Particular to this role
Airflow · Git · Test Automation
Rare in V4C.ai's other 13 open postings.
Standard for data engineering roles
AWS · Azure · CI/CD · ETL · dbt
Common in data engineering postings at any company.
In most of V4C.ai's ads
Databricks · Delta Lake · Python · SQL · Spark
Named in most of its open postings, whatever the role.
Compared with V4C.ai's other open jobs.
The team: Delivery HIRES STEADILY
This role is one of 10 open in Delivery. 6 were posted in the last 30 days and the oldest in July: a team that hires all year rather than one being built.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
Python (9 of 10), SQL (9 of 10), Databricks (8 of 10), Delta Lake (8 of 10), CI/CD (7 of 10), Spark (7 of 10), Unity (6 of 10)
OTHER ROLES ON THIS TEAM
- Sr. Business Analyst / Solutions Architect (Remote, US) posted Nov 16
- Databricks Engineer (Remote, US) posted Nov 13
- Databricks Architect (Remote, US) posted Nov 13
- Databricks QA Engineer (Remote, US) posted Nov 13
- Databricks Architect (hybrid) - Dallas, TX posted Nov 13
- Databricks Engineer-Canada posted Oct 17
- Data Engineer-Onshore posted Oct 13
- Associate Data Scientist (W) posted Jul 6
- Associate Data Engineer (W) posted Jul 6
From the team and dates on V4C.ai's own job board.
See Data Engineer salaries in the United States →
Similar jobs
- Senior Data Engineer (Databricks) at Livefront
Shares 12 skills: Delta Lake, Unity, dbt… · same remote region - Databricks Architect | US at Cuesta Partners
Shares 11 skills: Delta Lake, Unity, ETL… · Lead level · same remote region - Data Engineer Consultant at Indicium AI
Shares 13 skills: Delta Lake, Unity, Airflow… · same country - Resident Solution Architect (RSA) - Data & Databricks at Weekday AI
Shares 12 skills: Delta Lake, Unity, dbt… · Lead level - Senior Lead Data Engineer - Databricks at Integrant
Shares 12 skills: Delta Lake, Unity, Airflow… · Lead level - Sr. Business Analyst / Solutions Architect (Remote, US) at V4C.ai
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.